Jul 13 17:15:31.399023 ip-10-0-141-144 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 13 17:15:31.399033 ip-10-0-141-144 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 13 17:15:31.399040 ip-10-0-141-144 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 13 17:15:31.399262 ip-10-0-141-144 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 13 17:15:41.497934 ip-10-0-141-144 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 13 17:15:41.497954 ip-10-0-141-144 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d04a03f1860a43a6b4c6fda9b2096dba --
Jul 13 17:17:19.205618 ip-10-0-141-144 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 17:17:19.672565 ip-10-0-141-144 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 17:17:19.672565 ip-10-0-141-144 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 17:17:19.672565 ip-10-0-141-144 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 17:17:19.672565 ip-10-0-141-144 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 17:17:19.672565 ip-10-0-141-144 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 17:17:19.672565 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.662386    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 17:17:19.672565 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670179    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:17:19.672565 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670193    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:17:19.672565 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670197    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:17:19.672565 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670200    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:17:19.672565 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670203    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:17:19.672565 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670207    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:17:19.672565 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670209    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:17:19.672565 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670214    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670217    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670219    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670222    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670225    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670228    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670232    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670235    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670238    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670240    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670244    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670247    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670250    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670253    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670257    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670260    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670262    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670265    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670268    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670271    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:17:19.683567 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670273    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670276    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670278    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670281    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670283    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670286    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670288    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670291    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670293    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670296    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670299    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670303    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670306    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670309    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670312    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670315    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670317    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670320    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670322    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670325    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:17:19.685281 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670328    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670331    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670333    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670336    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670339    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670341    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670344    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670358    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670361    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670363    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670366    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670369    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670371    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670374    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670377    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670379    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670382    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670384    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670387    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670390    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:17:19.687336 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670392    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670395    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670397    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670400    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670403    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670405    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670409    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670411    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670414    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670417    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670419    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670422    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670425    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670427    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670430    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670433    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670439    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670443    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670446    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:17:19.699129 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670450    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670453    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670457    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670460    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670463    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670466    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670469    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670473    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670477    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670480    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670482    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670485    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.670487    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671170    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671176    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671179    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671182    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671184    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671187    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:17:19.701554 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671191    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671197    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671200    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671203    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671205    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671208    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671210    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671213    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671216    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671218    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671224    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671229    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671233    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671237    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671239    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671242    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671244    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671249    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671254    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:17:19.759585 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671257    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:17:19.743308 ip-10-0-141-144 systemd[1]: Started Kubernetes Kubelet.
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671260    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671263    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671266    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671269    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671272    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671275    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671278    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671281    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671284    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671286    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671289    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671291    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671293    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671296    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671299    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671302    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671305    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671307    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671310    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:17:19.778596 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671312    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671315    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671318    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671322    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671324    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671327    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671330    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671332    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671335    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671339    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671342    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671362    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671365    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671368    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671371    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671374    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671376    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671379    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671381    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671384    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:17:19.975092 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671387    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671390    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671393    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671395    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671398    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671400    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671403    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671406    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671409    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671411    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671414    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671416    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671419    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671422    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671424    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671428    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671431    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671433    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671435    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:17:19.986834 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671438    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671440    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671444    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671447    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671449    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671452    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671454    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671457    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671460    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671462    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671464    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671467    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671469    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671472    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671474    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671841    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671846    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671848    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671851    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671854    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:17:19.987598 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671856    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671860    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671863    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671865    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671868    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671870    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671873    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671876    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671879    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671882    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671884    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671887    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671890    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671892    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671896    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671898    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671901    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671903    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671906    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671908    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:17:19.988230 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671911    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671913    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671916    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671918    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671921    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671923    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671926    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671929    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671932    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671934    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671938    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671941    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671944    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671946    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671949    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671952    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671954    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671958    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671962    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:17:19.988853 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671965    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671969    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671972    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671975    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671978    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671981    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671984    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671988    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671991    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671993    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671996    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.671999    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672001    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672004    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672006    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672009    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672011    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672014    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672016    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672019    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:17:19.989486 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672021    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672024    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672026    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672028    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672031    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672033    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672036    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672038    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672041    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672044    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672046    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672049    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672052    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672056    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672058    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672061    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672063    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672066    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672068    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672071    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:17:19.990053 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672074    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672076    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672079    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672082    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672084    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672086    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672089    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672091    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672094    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672097    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672101    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672104    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672107    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672110    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672112    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672183    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672189    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672196    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672200    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672205    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672208    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 17:17:19.990693 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672213    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672218    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672221    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672225    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672229    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672233    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672236    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672239    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672242    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672245    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672249    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672252    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672257    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672259    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672262    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672266    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672269    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672273    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672276    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672279    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672283    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672286    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672289    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672292    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 17:17:19.991308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672295    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672298    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672301    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672304    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672307    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672310    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672313    2579 flags.go:64] FLAG: --enable-server="true"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672316    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672320    2579 flags.go:64] FLAG: --event-burst="100"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672324    2579 flags.go:64] FLAG: --event-qps="50"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672327    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672330    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672334    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672338    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672341    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672343    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672361    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672364    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672368    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672371    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672374    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672377    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672380    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672383    2579 flags.go:64] FLAG: --feature-gates=""
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672387    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 17:17:19.992033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672389    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672392    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672396    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672399    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672402    2579 flags.go:64] FLAG: --help="false"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672405    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-141-144.ec2.internal"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672408    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672411    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672413    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672417    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672420    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672423    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672425    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672428    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672431    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672434    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672437    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672443    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672446    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672450    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672453    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672456    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672459    2579 flags.go:64] FLAG: --lock-file=""
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672461    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 17:17:19.992824 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672464    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672468    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672473    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672476    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672478    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672481    2579 flags.go:64] FLAG: --logging-format="text"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672484    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672487    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672490    2579 flags.go:64] FLAG: --manifest-url=""
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672493    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672497    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672500    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672504    2579 flags.go:64] FLAG: --max-pods="110"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672507    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672510    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672513    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672516    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672519    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672522    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672525    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672531    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672534    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672537    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 17:17:19.993593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672540    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672543    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672549    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672552    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672557    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672560    2579 flags.go:64] FLAG: --port="10250"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672563    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672566    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01a8b87bc854688d1"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672569    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672573    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672576    2579 flags.go:64] FLAG: --register-node="true"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672580    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672584    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672586    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672590    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672593    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672596    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672599    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672602    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672605    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672608    2579 flags.go:64] FLAG: --runonce="false"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672611    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672614    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672617    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672620    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 17:17:19.994203 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672622    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672625    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672628    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672631    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672634    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672637    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672640    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672643    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672646    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672648    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672651    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672658    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672661    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672664    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672668    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672671    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672674    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672677    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672681    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672684    2579 flags.go:64] FLAG: --v="2"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672688    2579 flags.go:64] FLAG: --version="false"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672691    2579 flags.go:64] FLAG: --vmodule=""
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672695    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.672698    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672809    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:17:19.994905 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672812    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672816    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672819    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672821    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672824    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672827    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672830    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672833    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672836    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672838    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672841    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672844    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672846    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672849    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672851    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672854    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672857    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672860    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672864    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672867    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:17:19.995568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672869    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672872    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672875    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672878    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672880    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672884    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672887    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672889    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672892    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672895    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672897    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672901    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672904    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672907    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672910    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672912    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672915    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672918    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672921    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672923    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:17:19.996140 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672926    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672930    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672933    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672936    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672939    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672942    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672944    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672947    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672950    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672953    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672957    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672959    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672962    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672965    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672967    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672970    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672973    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672977    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672980    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:17:19.996716 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672982    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672985    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672988    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672990    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672993    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672995    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.672998    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673000    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673003    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673005    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673008    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673010    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673013    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673015    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673018    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673021    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673023    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673026    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673028    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673031    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:17:19.997308 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673033    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673036    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673039    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673044    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673047    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673049    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673052    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673055    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673057    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673060    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673063    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673066    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673069    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673071    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673074    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673076    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673079    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673081    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:17:19.997852 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.673084    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:17:20.000564 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.673092    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 17:17:20.000564 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.681700    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 17:17:20.000564 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.681716    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 17:17:20.000564 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.681735    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 17:17:20.000564 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.681745    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 17:17:20.000564 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681820    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:17:20.000564 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681827    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:17:20.000564 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681831    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:17:20.000564 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681834    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:17:20.000564 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681838    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:17:20.000564 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681841    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:17:20.000564 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681843    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:17:20.000564 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681846    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:17:20.000564 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681850    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681853    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681856    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681860    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681863    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681866    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681870    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681872    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681875    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681877    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681879    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681882    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681885    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681887    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681890    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681893    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681896    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681898    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681901    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:17:20.001442 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681905    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681907    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681910    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681912    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681915    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681918    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681921    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681923    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681926    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681929    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681932    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681934    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681937    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681940    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681943    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681945    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681948    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681951    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681954    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681958    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:17:20.001981 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681961    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681963    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681966    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681968    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681971    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681974    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681976    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681979    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681981    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681984    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681987    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681990    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681992    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681995    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.681998    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682000    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682003    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682005    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682008    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682011    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:17:20.230319 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682014    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682016    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682019    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682024    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682027    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682029    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682032    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682034    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682039    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682042    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682044    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682054    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682058    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682061    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682063    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682066    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682069    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682072    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.682074    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683494    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:17:20.231313 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683498    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:17:20.231935 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683501    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:17:20.231935 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683504    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:17:20.231935 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683506    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:17:20.231935 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683509    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:17:20.231935 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683512    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:17:20.231935 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683515    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:17:20.231935 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683517    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:17:20.231935 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683520    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:17:20.231935 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683523    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:17:20.231935 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683527    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:17:20.231935 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683531    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:17:20.231935 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.683537    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 17:17:20.231935 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683658    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:17:20.231935 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683664    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683668    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683671    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683675    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683678    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683680    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683685    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683689    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683692    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683695    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683699    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683704    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683707    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683710    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683713    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683716    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683719    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683722    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:17:20.232382 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683725    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683729    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683732    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683736    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683739    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683743    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683745    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683748    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683751    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683753    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683756    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683758    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683761    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683763    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683766    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683768    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683771    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683773    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683776    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:17:20.232864 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683778    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683782    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683785    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683787    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683790    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683792    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683795    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683798    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683800    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683802    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683805    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683807    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683810    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683813    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683816    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683819    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683821    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683824    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683827    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683830    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:17:20.233414 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683832    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683834    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683837    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683839    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683842    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683844    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683847    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683849    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683852    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683855    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683857    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683859    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683862    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683865    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683868    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683871    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683873    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683876    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683878    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683880    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:17:20.233936 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683883    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683886    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683888    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683891    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683894    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683899    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683902    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683905    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683908    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683910    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683913    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683915    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683918    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683921    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683923    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683925    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683928    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683931    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683934    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683936    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:17:20.234515 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:19.683939    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:17:20.235032 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.683943    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 17:17:20.235032 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.684053    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 17:17:20.235032 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.688940    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 17:17:20.235032 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.691372    2579 server.go:1019] "Starting client certificate rotation"
Jul 13 17:17:20.235032 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.691468    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 17:17:20.235032 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.691501    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 17:17:20.235032 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.694102    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 17:17:20.235032 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.695261    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 17:17:20.235032 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.707935    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 13 17:17:20.235032 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.711455    2579 log.go:25] "Validated CRI v1 image API"
Jul 13 17:17:20.235032 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.712192    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 17:17:20.235032 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.715123    2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9e879c20-bac3-4f0d-9a26-c76f8a94e7ae:/dev/nvme0n1p3 b36aef40-db0d-4e23-a346-c65626e3f7c7:/dev/nvme0n1p4]
Jul 13 17:17:20.235435 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.715138    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 17:17:20.235506 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.721681    2579 manager.go:216] Machine: {Timestamp:2026-07-13 17:17:19.719312851 +0000 UTC m=+0.371435467 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098587 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2515641a3af75cc742c07ff3ba872b SystemUUID:ec251564-1a3a-f75c-c742-c07ff3ba872b BootID:d04a03f1-860a-43a6-b4c6-fda9b2096dba Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:85:1f:81:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:85:1f:81:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:c3:35:fd:6b:36 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 17:17:20.235506 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.721784    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 17:17:20.235506 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.721865    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 17:17:20.235506 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.724331    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 17:17:20.235506 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.724478    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 17:17:20.235506 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.724505    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-144.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 17:17:20.235506 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.725328    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.725337    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.725356    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.725370    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.727289    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.730903    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.731012    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.731039    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.731048    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.731068    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.731077    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.731100    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.732155    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.732180    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.735633    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.738238    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.738266    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.738435    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.738453    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.738463    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.738478    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.738495    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.738506    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.739048    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.739056    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.739063    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.739068    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.739077    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.739085    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.739108    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.739116    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.742362    2579 server.go:1268] "Started kubelet"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.742457    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.742605    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.742675    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.743611    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-144.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:19.744269    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.744278    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:19.744317    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 17:17:20.235784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.744672    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:19.749413    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:19.750339    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-144.ec2.internal.18c1e8eecc445957  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-144.ec2.internal,UID:ip-10-0-141-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-144.ec2.internal,},FirstTimestamp:2026-07-13 17:17:19.742318935 +0000 UTC m=+0.394441551,LastTimestamp:2026-07-13 17:17:19.742318935 +0000 UTC m=+0.394441551,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-144.ec2.internal,}"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.753999    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.754009    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:19.754108    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.754781    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.754824    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.754843    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.754955    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.754961    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.760087    2579 factory.go:55] Registering systemd factory
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.760100    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.760316    2579 factory.go:153] Registering CRI-O factory
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.760330    2579 factory.go:223] Registration of the crio container factory successfully
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.760413    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.760437    2579 factory.go:103] Registering Raw factory
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.760453    2579 manager.go:1196] Started watching for new ooms in manager
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.760909    2579 manager.go:349] Starting recovery of all containers
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:19.762312    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:19.762431    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.772680    2579 manager.go:354] Recovery completed
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.782962    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.784965    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.785006    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.785020    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.785656    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.785669    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.785682    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.785687    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.786998    2579 policy_none.go:49] "None policy: Start"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.787011    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 17:17:20.236821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.787031    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:19.787220    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-144.ec2.internal.18c1e8eececf72b6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-144.ec2.internal,UID:ip-10-0-141-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-144.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-144.ec2.internal,},FirstTimestamp:2026-07-13 17:17:19.784989366 +0000 UTC m=+0.437111985,LastTimestamp:2026-07-13 17:17:19.784989366 +0000 UTC m=+0.437111985,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-144.ec2.internal,}"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.788092    2579 policy_none.go:47] "Start"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.788251    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.788279    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.788293    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.788419    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c287v"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.796837    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c287v"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:19.798497    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-144.ec2.internal.18c1e8eececfcac6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-144.ec2.internal,UID:ip-10-0-141-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-144.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-144.ec2.internal,},FirstTimestamp:2026-07-13 17:17:19.78501191 +0000 UTC m=+0.437134527,LastTimestamp:2026-07-13 17:17:19.78501191 +0000 UTC m=+0.437134527,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-144.ec2.internal,}"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.841918    2579 manager.go:337] "Starting Device Plugin manager"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:19.841947    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.841958    2579 server.go:87] "Starting device plugin registration server"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.842221    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.842235    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.842330    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.842416    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.842424    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:19.842877    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:19.842922    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.942591    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.943671    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.943700    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.943710    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.943739    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-144.ec2.internal"
Jul 13 17:17:20.237707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:19.952535    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-144.ec2.internal"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:19.952560    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-144.ec2.internal\": node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:19.997064    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.063185    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.064433    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.064466    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.064488    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:20.064517    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.066700    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:20.097844    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.165309    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-144.ec2.internal"]
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.165436    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.166467    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.166494    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.166503    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.167769    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.167876    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.167903    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.168691    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.168712    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.168721    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.169343    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.169379    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.169388    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.169806    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-144.ec2.internal"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.169831    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.170923    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.170939    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.170948    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:20.192967    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-144.ec2.internal\" not found" node="ip-10-0-141-144.ec2.internal"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:20.197055    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-144.ec2.internal\" not found" node="ip-10-0-141-144.ec2.internal"
Jul 13 17:17:20.238411 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:20.198036    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:20.340060 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.257432    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c5781ace799c1d43c4431c9f5a2f6c98-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal\" (UID: \"c5781ace799c1d43c4431c9f5a2f6c98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal"
Jul 13 17:17:20.340060 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.257459    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5781ace799c1d43c4431c9f5a2f6c98-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal\" (UID: \"c5781ace799c1d43c4431c9f5a2f6c98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal"
Jul 13 17:17:20.340060 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.257478    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b903a136f96045e7d3d6d1be0500b2d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-144.ec2.internal\" (UID: \"1b903a136f96045e7d3d6d1be0500b2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-144.ec2.internal"
Jul 13 17:17:20.340060 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:20.298546    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:20.454105 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.357779    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c5781ace799c1d43c4431c9f5a2f6c98-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal\" (UID: \"c5781ace799c1d43c4431c9f5a2f6c98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal"
Jul 13 17:17:20.454105 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.357812    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5781ace799c1d43c4431c9f5a2f6c98-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal\" (UID: \"c5781ace799c1d43c4431c9f5a2f6c98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal"
Jul 13 17:17:20.454105 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.357835    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b903a136f96045e7d3d6d1be0500b2d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-144.ec2.internal\" (UID: \"1b903a136f96045e7d3d6d1be0500b2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-144.ec2.internal"
Jul 13 17:17:20.454105 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.357865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b903a136f96045e7d3d6d1be0500b2d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-144.ec2.internal\" (UID: \"1b903a136f96045e7d3d6d1be0500b2d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-144.ec2.internal"
Jul 13 17:17:20.454105 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.357888    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5781ace799c1d43c4431c9f5a2f6c98-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal\" (UID: \"c5781ace799c1d43c4431c9f5a2f6c98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal"
Jul 13 17:17:20.454105 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:20.357865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c5781ace799c1d43c4431c9f5a2f6c98-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal\" (UID: \"c5781ace799c1d43c4431c9f5a2f6c98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal"
Jul 13 17:17:20.454105 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:20.398905    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:20.577122 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:20.499131    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:20.717904 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:20.599508    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:20.717904 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:20.699890    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:20.847803 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:20.800311    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:20.982790 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:20.900741    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:21.116963 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:21.001028    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:21.116963 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:21.085093    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:17:21.116963 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:21.101461    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:21.245149 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:21.201689    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:21.373577 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:21.301962    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:21.518183 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:21.402275    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:21.518183 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:21.502502    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:21.648448 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:21.602744    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:21.781280 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:21.704308    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:21.909075 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:21.805459    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:22.023816 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:21.912852    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:22.023816 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:22.020242    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-144.ec2.internal\" not found"
Jul 13 17:17:22.079420 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.079394    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 17:17:22.079572 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.079479    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:17:22.079655 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.079573    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal"
Jul 13 17:17:22.079655 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.079646    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-144.ec2.internal"
Jul 13 17:17:22.092557 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.079493    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 17:12:20 +0000 UTC" deadline="2028-04-24 18:47:48.809045306 +0000 UTC"
Jul 13 17:17:22.092665 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.092561    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15625h30m26.716493571s"
Jul 13 17:17:22.092665 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.092640    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:17:22.092665 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.092665    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:17:22.092834 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.092675    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:17:22.107016 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.106996    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:17:22.107345 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.107331    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:17:22.154270 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.154236    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-144.ec2.internal"
Jul 13 17:17:22.170149 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.170093    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 17:17:22.171237 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.171223    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal"
Jul 13 17:17:22.195437 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.195413    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 17:17:22.622391 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:22.622350    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5781ace799c1d43c4431c9f5a2f6c98.slice/crio-f84a84c22acf56c8f776437fd4f59ef0410e213af086d09a66ddf65b4d629d33 WatchSource:0}: Error finding container f84a84c22acf56c8f776437fd4f59ef0410e213af086d09a66ddf65b4d629d33: Status 404 returned error can't find the container with id f84a84c22acf56c8f776437fd4f59ef0410e213af086d09a66ddf65b4d629d33
Jul 13 17:17:22.630782 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:22.630761    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:17:22.636549 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:22.636522    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b903a136f96045e7d3d6d1be0500b2d.slice/crio-aee0c1d1c8cfa9a12eb0908c9f99b546b40d2359c17b63ac26ebba8de904c502 WatchSource:0}: Error finding container aee0c1d1c8cfa9a12eb0908c9f99b546b40d2359c17b63ac26ebba8de904c502: Status 404 returned error can't find the container with id aee0c1d1c8cfa9a12eb0908c9f99b546b40d2359c17b63ac26ebba8de904c502
Jul 13 17:17:23.079935 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.079893    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 17:17:23.079935 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.079933    2579 apiserver.go:52] "Watching apiserver"
Jul 13 17:17:23.088405 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.088384    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 17:17:23.088776 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.088755    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-x4xxd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal","openshift-multus/multus-7cppw","openshift-multus/network-metrics-daemon-h26bb","openshift-network-diagnostics/network-check-target-m9fqx","kube-system/konnectivity-agent-fs6kx","openshift-cluster-node-tuning-operator/tuned-mwd8g","openshift-image-registry/node-ca-jgf4v","openshift-multus/multus-additional-cni-plugins-mg8xv","openshift-network-operator/iptables-alerter-f6h2p","openshift-ovn-kubernetes/ovnkube-node-5tt87","kube-system/global-pull-secret-syncer-5n7fg","kube-system/kube-apiserver-proxy-ip-10-0-141-144.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"]
Jul 13 17:17:23.090549 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.090528    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.091915 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.091892    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.093033 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.093012    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:17:23.093123 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.093066    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rk8tm\""
Jul 13 17:17:23.093326 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.093262    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.094064 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.094047    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b74ph\""
Jul 13 17:17:23.094184 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.094150    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 17:17:23.094384 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.094342    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 17:17:23.094589 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.094569    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 17:17:23.094589 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.094579    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 17:17:23.094896 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.094869    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 17:17:23.096854 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.096573    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 17:17:23.096854 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.096654    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 17:17:23.096854 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.096674    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 17:17:23.096854 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.096714    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 17:17:23.096854 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.096728    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 17:17:23.096854 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.096744    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gt2zw\""
Jul 13 17:17:23.096854 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.096778    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 17:17:23.097212 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.096881    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:23.097212 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.096889    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 17:17:23.097212 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.096939    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:23.098118 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.098102    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:23.098181 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.098168    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:23.099276 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.099258    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fs6kx"
Jul 13 17:17:23.100707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.100691    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.101945 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.101928    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.103398 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.103382    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jgf4v"
Jul 13 17:17:23.104648 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.104627    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f6h2p"
Jul 13 17:17:23.105878 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.105857    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 17:17:23.108268 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.106302    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 17:17:23.108555 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.108535    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 17:17:23.108555 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.108549    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7krws\""
Jul 13 17:17:23.108712 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.108544    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-72vfs\""
Jul 13 17:17:23.108712 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.108532    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 17:17:23.108712 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.108685    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vnd2c\""
Jul 13 17:17:23.108868 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.108764    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 17:17:23.108925 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.108878    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 17:17:23.108925 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.108905    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 17:17:23.109029 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.108954    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9mg2h\""
Jul 13 17:17:23.109029 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.109024    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x4xxd"
Jul 13 17:17:23.109135 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.108882    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 17:17:23.109135 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.109047    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 17:17:23.109336 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.109320    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:17:23.109421 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.109350    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gsbzk\""
Jul 13 17:17:23.109800 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.109783    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 17:17:23.109800 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.109790    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 17:17:23.109931 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.109847    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 17:17:23.110685 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.110645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-144.ec2.internal" event={"ID":"1b903a136f96045e7d3d6d1be0500b2d","Type":"ContainerStarted","Data":"aee0c1d1c8cfa9a12eb0908c9f99b546b40d2359c17b63ac26ebba8de904c502"}
Jul 13 17:17:23.110765 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.110687    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal" event={"ID":"c5781ace799c1d43c4431c9f5a2f6c98","Type":"ContainerStarted","Data":"f84a84c22acf56c8f776437fd4f59ef0410e213af086d09a66ddf65b4d629d33"}
Jul 13 17:17:23.110765 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.110734    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:23.110890 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.110795    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:23.113862 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.113843    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 17:17:23.114905 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.114884    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dzjjg\""
Jul 13 17:17:23.114984 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.114958    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 17:17:23.141913 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.141893    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ll2nd"
Jul 13 17:17:23.152326 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.152308    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ll2nd"
Jul 13 17:17:23.155972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.155956    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 17:17:23.188847 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.188807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdcwk\" (UniqueName: \"kubernetes.io/projected/be5b5dde-24ca-4827-a78e-b178518d45cd-kube-api-access-wdcwk\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.189009 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.188855    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-kubernetes\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.189009 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.188886    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j2cd\" (UniqueName: \"kubernetes.io/projected/04050fbe-991d-4d80-a89b-70a4cc814981-kube-api-access-9j2cd\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.189009 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.188915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be5b5dde-24ca-4827-a78e-b178518d45cd-os-release\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.189009 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.188969    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89ab2977-0020-43c9-9b3a-eb2d910f52bb-host-slash\") pod \"iptables-alerter-f6h2p\" (UID: \"89ab2977-0020-43c9-9b3a-eb2d910f52bb\") " pod="openshift-network-operator/iptables-alerter-f6h2p"
Jul 13 17:17:23.189009 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-slash\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.189299 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189031    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-node-log\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.189299 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-cni-netd\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.189299 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189095    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89ab2977-0020-43c9-9b3a-eb2d910f52bb-iptables-alerter-script\") pod \"iptables-alerter-f6h2p\" (UID: \"89ab2977-0020-43c9-9b3a-eb2d910f52bb\") " pod="openshift-network-operator/iptables-alerter-f6h2p"
Jul 13 17:17:23.189299 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189123    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-hostroot\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.189299 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be5b5dde-24ca-4827-a78e-b178518d45cd-cnibin\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.189299 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e81c2d84-cf2f-403d-a6de-8da683e40aba-ovn-node-metrics-cert\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.189299 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-var-lib-openvswitch\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.189299 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189231    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be5b5dde-24ca-4827-a78e-b178518d45cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.189299 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189257    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-device-dir\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.189299 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-sys-fs\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.189816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189306    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-sysconfig\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.189816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-os-release\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.189816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l8sh\" (UniqueName: \"kubernetes.io/projected/6498731f-325a-4950-b8f5-54c8d3f53373-kube-api-access-7l8sh\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.189816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189379    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db0bf4bc-76e1-40ca-9d7f-8bd50243db39-host\") pod \"node-ca-jgf4v\" (UID: \"db0bf4bc-76e1-40ca-9d7f-8bd50243db39\") " pod="openshift-image-registry/node-ca-jgf4v"
Jul 13 17:17:23.189816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189427    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-log-socket\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.189816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189451    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-run-netns\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.189816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-run-ovn-kubernetes\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.189816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-sysctl-d\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.189816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-run-netns\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.189816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189597    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be5b5dde-24ca-4827-a78e-b178518d45cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.189816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e81c2d84-cf2f-403d-a6de-8da683e40aba-ovnkube-script-lib\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.189816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189647    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/106d80d3-2c06-4715-90e2-a5b2fb627cb9-cni-binary-copy\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.189816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189671    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be5b5dde-24ca-4827-a78e-b178518d45cd-system-cni-dir\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.189816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189696    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-socket-dir\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.190511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189733    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db0bf4bc-76e1-40ca-9d7f-8bd50243db39-serviceca\") pod \"node-ca-jgf4v\" (UID: \"db0bf4bc-76e1-40ca-9d7f-8bd50243db39\") " pod="openshift-image-registry/node-ca-jgf4v"
Jul 13 17:17:23.190511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:23.190511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-run-openvswitch\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.190511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189830    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.190511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189851    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e81c2d84-cf2f-403d-a6de-8da683e40aba-ovnkube-config\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.190511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189875    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-host\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.190511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189902    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be5b5dde-24ca-4827-a78e-b178518d45cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.190511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:23.190511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189956    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-sysctl-conf\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.190511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.189978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-sys\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.190511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190005    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/106d80d3-2c06-4715-90e2-a5b2fb627cb9-multus-daemon-config\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.190511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190025    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/504c70e2-e9b9-4bbe-973d-9037d326099b-konnectivity-ca\") pod \"konnectivity-agent-fs6kx\" (UID: \"504c70e2-e9b9-4bbe-973d-9037d326099b\") " pod="kube-system/konnectivity-agent-fs6kx"
Jul 13 17:17:23.190511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190045    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-etc-openvswitch\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.190511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36370993-71ea-41fa-89c7-743d6ff32ee5-tmp-dir\") pod \"node-resolver-x4xxd\" (UID: \"36370993-71ea-41fa-89c7-743d6ff32ee5\") " pod="openshift-dns/node-resolver-x4xxd"
Jul 13 17:17:23.191161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190098    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk8fj\" (UniqueName: \"kubernetes.io/projected/36370993-71ea-41fa-89c7-743d6ff32ee5-kube-api-access-rk8fj\") pod \"node-resolver-x4xxd\" (UID: \"36370993-71ea-41fa-89c7-743d6ff32ee5\") " pod="openshift-dns/node-resolver-x4xxd"
Jul 13 17:17:23.191161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04050fbe-991d-4d80-a89b-70a4cc814981-tmp\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.191161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190164    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-multus-cni-dir\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.191161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/504c70e2-e9b9-4bbe-973d-9037d326099b-agent-certs\") pod \"konnectivity-agent-fs6kx\" (UID: \"504c70e2-e9b9-4bbe-973d-9037d326099b\") " pod="kube-system/konnectivity-agent-fs6kx"
Jul 13 17:17:23.191161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.191161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190262    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-run-ovn\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.191161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36370993-71ea-41fa-89c7-743d6ff32ee5-hosts-file\") pod \"node-resolver-x4xxd\" (UID: \"36370993-71ea-41fa-89c7-743d6ff32ee5\") " pod="openshift-dns/node-resolver-x4xxd"
Jul 13 17:17:23.191161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190338    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-systemd\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.191161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-run\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.191161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190399    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-var-lib-kubelet\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.191161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190423    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzmv4\" (UniqueName: \"kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4\") pod \"network-check-target-m9fqx\" (UID: \"403ea272-31db-42da-b356-9fb9a9aca3a6\") " pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:23.191161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190467    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-etc-selinux\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.191161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190515    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84fgl\" (UniqueName: \"kubernetes.io/projected/db0bf4bc-76e1-40ca-9d7f-8bd50243db39-kube-api-access-84fgl\") pod \"node-ca-jgf4v\" (UID: \"db0bf4bc-76e1-40ca-9d7f-8bd50243db39\") " pod="openshift-image-registry/node-ca-jgf4v"
Jul 13 17:17:23.191161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190541    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-cni-bin\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.191850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68c215bc-8805-4045-bfc2-16b86752c850-kubelet-config\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:23.191850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04050fbe-991d-4d80-a89b-70a4cc814981-etc-tuned\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.191850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190614    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-multus-conf-dir\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.191850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg54t\" (UniqueName: \"kubernetes.io/projected/5cf84bf3-8941-43b9-b255-3b74ceb51b71-kube-api-access-fg54t\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:23.191850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190663    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-modprobe-d\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.191850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190688    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-cnibin\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.191850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-var-lib-cni-bin\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.191850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-var-lib-cni-multus\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.191850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190766    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnnl5\" (UniqueName: \"kubernetes.io/projected/89ab2977-0020-43c9-9b3a-eb2d910f52bb-kube-api-access-rnnl5\") pod \"iptables-alerter-f6h2p\" (UID: \"89ab2977-0020-43c9-9b3a-eb2d910f52bb\") " pod="openshift-network-operator/iptables-alerter-f6h2p"
Jul 13 17:17:23.191850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190789    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68c215bc-8805-4045-bfc2-16b86752c850-dbus\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:23.191850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-multus-socket-dir-parent\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.191850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190851    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-etc-kubernetes\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.191850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190904    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl29r\" (UniqueName: \"kubernetes.io/projected/106d80d3-2c06-4715-90e2-a5b2fb627cb9-kube-api-access-fl29r\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.191850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190948    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-kubelet\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.192386 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190969    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5thk\" (UniqueName: \"kubernetes.io/projected/e81c2d84-cf2f-403d-a6de-8da683e40aba-kube-api-access-m5thk\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.192386 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.190987    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-systemd-units\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.192386 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.191022    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-run-systemd\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.192386 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.191050    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e81c2d84-cf2f-403d-a6de-8da683e40aba-env-overrides\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.192386 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.191083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-var-lib-kubelet\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.192386 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.191106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-registration-dir\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.192386 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.191129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-lib-modules\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.192386 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.191152    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-system-cni-dir\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.192386 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.191178    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-run-k8s-cni-cncf-io\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.192386 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.191199    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-run-multus-certs\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.192386 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.191214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be5b5dde-24ca-4827-a78e-b178518d45cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.292301 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292262    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-multus-cni-dir\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.292301 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/504c70e2-e9b9-4bbe-973d-9037d326099b-agent-certs\") pod \"konnectivity-agent-fs6kx\" (UID: \"504c70e2-e9b9-4bbe-973d-9037d326099b\") " pod="kube-system/konnectivity-agent-fs6kx"
Jul 13 17:17:23.292657 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292594    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-multus-cni-dir\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.292657 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.292780 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292692    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-run-ovn\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.292780 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36370993-71ea-41fa-89c7-743d6ff32ee5-hosts-file\") pod \"node-resolver-x4xxd\" (UID: \"36370993-71ea-41fa-89c7-743d6ff32ee5\") " pod="openshift-dns/node-resolver-x4xxd"
Jul 13 17:17:23.292780 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292745    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-systemd\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.292780 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-run\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.293030 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292792    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-var-lib-kubelet\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.293030 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292819    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzmv4\" (UniqueName: \"kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4\") pod \"network-check-target-m9fqx\" (UID: \"403ea272-31db-42da-b356-9fb9a9aca3a6\") " pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:23.293030 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-etc-selinux\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.293030 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292872    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84fgl\" (UniqueName: \"kubernetes.io/projected/db0bf4bc-76e1-40ca-9d7f-8bd50243db39-kube-api-access-84fgl\") pod \"node-ca-jgf4v\" (UID: \"db0bf4bc-76e1-40ca-9d7f-8bd50243db39\") " pod="openshift-image-registry/node-ca-jgf4v"
Jul 13 17:17:23.293030 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292895    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-cni-bin\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.293030 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292917    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36370993-71ea-41fa-89c7-743d6ff32ee5-hosts-file\") pod \"node-resolver-x4xxd\" (UID: \"36370993-71ea-41fa-89c7-743d6ff32ee5\") " pod="openshift-dns/node-resolver-x4xxd"
Jul 13 17:17:23.293030 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68c215bc-8805-4045-bfc2-16b86752c850-kubelet-config\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:23.293030 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04050fbe-991d-4d80-a89b-70a4cc814981-etc-tuned\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.293030 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-multus-conf-dir\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.293030 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293018    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-systemd\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.293030 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg54t\" (UniqueName: \"kubernetes.io/projected/5cf84bf3-8941-43b9-b255-3b74ceb51b71-kube-api-access-fg54t\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:23.293629 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-modprobe-d\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.293629 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293066    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-run\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.293629 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293123    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-var-lib-kubelet\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.293629 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292791    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 17:17:23.293629 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293251    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-modprobe-d\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.293629 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293283    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-cnibin\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.293629 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-var-lib-cni-bin\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.293629 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293338    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-var-lib-cni-multus\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.293629 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293368    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnnl5\" (UniqueName: \"kubernetes.io/projected/89ab2977-0020-43c9-9b3a-eb2d910f52bb-kube-api-access-rnnl5\") pod \"iptables-alerter-f6h2p\" (UID: \"89ab2977-0020-43c9-9b3a-eb2d910f52bb\") " pod="openshift-network-operator/iptables-alerter-f6h2p"
Jul 13 17:17:23.293629 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68c215bc-8805-4045-bfc2-16b86752c850-dbus\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:23.293629 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293416    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-multus-socket-dir-parent\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.293629 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293520    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-etc-kubernetes\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.293629 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293540    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-etc-selinux\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.293629 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293549    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl29r\" (UniqueName: \"kubernetes.io/projected/106d80d3-2c06-4715-90e2-a5b2fb627cb9-kube-api-access-fl29r\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.293629 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293588    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-kubelet\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.294348 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293617    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5thk\" (UniqueName: \"kubernetes.io/projected/e81c2d84-cf2f-403d-a6de-8da683e40aba-kube-api-access-m5thk\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.294348 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-systemd-units\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.294348 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293683    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-run-systemd\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.294348 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e81c2d84-cf2f-403d-a6de-8da683e40aba-env-overrides\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.294348 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293736    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-var-lib-kubelet\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.294348 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293766    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-registration-dir\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.294348 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-lib-modules\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.294348 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-system-cni-dir\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.294348 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-run-k8s-cni-cncf-io\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.294348 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293856    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.294348 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-run-multus-certs\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.294348 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293905    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-run-ovn\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.294348 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be5b5dde-24ca-4827-a78e-b178518d45cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.294348 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293940    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdcwk\" (UniqueName: \"kubernetes.io/projected/be5b5dde-24ca-4827-a78e-b178518d45cd-kube-api-access-wdcwk\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.295107 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-kubernetes\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.295107 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293991    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-var-lib-cni-bin\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.295107 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.293994    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j2cd\" (UniqueName: \"kubernetes.io/projected/04050fbe-991d-4d80-a89b-70a4cc814981-kube-api-access-9j2cd\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.295107 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be5b5dde-24ca-4827-a78e-b178518d45cd-os-release\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.295107 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294071    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89ab2977-0020-43c9-9b3a-eb2d910f52bb-host-slash\") pod \"iptables-alerter-f6h2p\" (UID: \"89ab2977-0020-43c9-9b3a-eb2d910f52bb\") " pod="openshift-network-operator/iptables-alerter-f6h2p"
Jul 13 17:17:23.295107 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-slash\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.295107 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294122    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-node-log\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.295107 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294151    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-cni-netd\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.295107 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294177    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89ab2977-0020-43c9-9b3a-eb2d910f52bb-iptables-alerter-script\") pod \"iptables-alerter-f6h2p\" (UID: \"89ab2977-0020-43c9-9b3a-eb2d910f52bb\") " pod="openshift-network-operator/iptables-alerter-f6h2p"
Jul 13 17:17:23.295107 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-hostroot\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.295107 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294224    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-multus-socket-dir-parent\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.295107 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294248    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-hostroot\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.295107 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.292976    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/68c215bc-8805-4045-bfc2-16b86752c850-kubelet-config\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:23.295107 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294272    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-etc-kubernetes\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.295107 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294301    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-multus-conf-dir\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.295972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294318    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89ab2977-0020-43c9-9b3a-eb2d910f52bb-host-slash\") pod \"iptables-alerter-f6h2p\" (UID: \"89ab2977-0020-43c9-9b3a-eb2d910f52bb\") " pod="openshift-network-operator/iptables-alerter-f6h2p"
Jul 13 17:17:23.295972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294340    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-slash\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.295972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294404    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-node-log\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.295972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294409    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-kubelet\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.295972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-cni-netd\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.295972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294532    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-var-lib-cni-multus\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.295972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294645    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-systemd-units\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.295972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294692    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-run-systemd\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.295972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294947    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be5b5dde-24ca-4827-a78e-b178518d45cd-os-release\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.295972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295006    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-run-k8s-cni-cncf-io\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.295972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295046    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-var-lib-kubelet\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.295972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295064    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89ab2977-0020-43c9-9b3a-eb2d910f52bb-iptables-alerter-script\") pod \"iptables-alerter-f6h2p\" (UID: \"89ab2977-0020-43c9-9b3a-eb2d910f52bb\") " pod="openshift-network-operator/iptables-alerter-f6h2p"
Jul 13 17:17:23.295972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295114    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e81c2d84-cf2f-403d-a6de-8da683e40aba-env-overrides\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.295972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295135    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-registration-dir\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.295972 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-cnibin\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.296756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-run-multus-certs\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.296756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295233    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-lib-modules\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.296756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295307    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-system-cni-dir\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.296756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295443    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-kubernetes\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.296756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be5b5dde-24ca-4827-a78e-b178518d45cd-cnibin\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.296756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295510    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e81c2d84-cf2f-403d-a6de-8da683e40aba-ovn-node-metrics-cert\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.296756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.294177    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/68c215bc-8805-4045-bfc2-16b86752c850-dbus\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:23.296756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-var-lib-openvswitch\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.296756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295568    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be5b5dde-24ca-4827-a78e-b178518d45cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.296756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295586    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be5b5dde-24ca-4827-a78e-b178518d45cd-cnibin\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.296756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-device-dir\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.296756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295623    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-sys-fs\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.296756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295630    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-var-lib-openvswitch\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.296756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-sysconfig\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.297523 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-os-release\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.297523 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295697    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be5b5dde-24ca-4827-a78e-b178518d45cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.297523 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295701    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l8sh\" (UniqueName: \"kubernetes.io/projected/6498731f-325a-4950-b8f5-54c8d3f53373-kube-api-access-7l8sh\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.297523 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db0bf4bc-76e1-40ca-9d7f-8bd50243db39-host\") pod \"node-ca-jgf4v\" (UID: \"db0bf4bc-76e1-40ca-9d7f-8bd50243db39\") " pod="openshift-image-registry/node-ca-jgf4v"
Jul 13 17:17:23.297523 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295761    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-cni-bin\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.297523 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295769    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-log-socket\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.297523 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295797    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-run-netns\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.297523 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-run-ovn-kubernetes\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.297523 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295852    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-sysctl-d\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.297523 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295893    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-run-netns\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.297523 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be5b5dde-24ca-4827-a78e-b178518d45cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.297523 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e81c2d84-cf2f-403d-a6de-8da683e40aba-ovnkube-script-lib\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.297523 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.295988    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/106d80d3-2c06-4715-90e2-a5b2fb627cb9-cni-binary-copy\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.297523 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be5b5dde-24ca-4827-a78e-b178518d45cd-system-cni-dir\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.298247 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-socket-dir\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.298247 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db0bf4bc-76e1-40ca-9d7f-8bd50243db39-serviceca\") pod \"node-ca-jgf4v\" (UID: \"db0bf4bc-76e1-40ca-9d7f-8bd50243db39\") " pod="openshift-image-registry/node-ca-jgf4v"
Jul 13 17:17:23.298247 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296086    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-sys-fs\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.298247 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:23.298247 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296133    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-run-openvswitch\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.298247 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.298247 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296164    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-sysconfig\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.298247 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e81c2d84-cf2f-403d-a6de-8da683e40aba-ovnkube-config\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.298247 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296203    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be5b5dde-24ca-4827-a78e-b178518d45cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.298247 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296233    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-os-release\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.298247 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296248    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-run-openvswitch\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.298247 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296263    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-host\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.298247 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-host\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.298247 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296307    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be5b5dde-24ca-4827-a78e-b178518d45cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.298993 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296313    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.298993 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296309    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-run-ovn-kubernetes\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.298993 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296337    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db0bf4bc-76e1-40ca-9d7f-8bd50243db39-host\") pod \"node-ca-jgf4v\" (UID: \"db0bf4bc-76e1-40ca-9d7f-8bd50243db39\") " pod="openshift-image-registry/node-ca-jgf4v"
Jul 13 17:17:23.298993 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296343    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:23.298993 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296383    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-sysctl-conf\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.298993 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.296389    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:23.298993 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-sys\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.298993 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/106d80d3-2c06-4715-90e2-a5b2fb627cb9-multus-daemon-config\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.298993 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296459    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-sysctl-d\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.298993 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.296495    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs podName:5cf84bf3-8941-43b9-b255-3b74ceb51b71 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:23.796459202 +0000 UTC m=+4.448581807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs") pod "network-metrics-daemon-h26bb" (UID: "5cf84bf3-8941-43b9-b255-3b74ceb51b71") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:23.298993 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296508    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/106d80d3-2c06-4715-90e2-a5b2fb627cb9-host-run-netns\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.298993 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296691    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be5b5dde-24ca-4827-a78e-b178518d45cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.298993 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296981    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be5b5dde-24ca-4827-a78e-b178518d45cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.298993 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.297072    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/106d80d3-2c06-4715-90e2-a5b2fb627cb9-multus-daemon-config\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.299747 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.297176    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e81c2d84-cf2f-403d-a6de-8da683e40aba-ovnkube-script-lib\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.299747 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.297333    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-log-socket\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.299747 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.297349    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-host-run-netns\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.299747 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.297401    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/504c70e2-e9b9-4bbe-973d-9037d326099b-konnectivity-ca\") pod \"konnectivity-agent-fs6kx\" (UID: \"504c70e2-e9b9-4bbe-973d-9037d326099b\") " pod="kube-system/konnectivity-agent-fs6kx"
Jul 13 17:17:23.299747 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.297463    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:23.299747 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.297500    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-etc-openvswitch\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.299747 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.297513    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret podName:68c215bc-8805-4045-bfc2-16b86752c850 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:23.79749761 +0000 UTC m=+4.449620230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret") pod "global-pull-secret-syncer-5n7fg" (UID: "68c215bc-8805-4045-bfc2-16b86752c850") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:23.299747 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.297464    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e81c2d84-cf2f-403d-a6de-8da683e40aba-etc-openvswitch\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.299747 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.297552    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36370993-71ea-41fa-89c7-743d6ff32ee5-tmp-dir\") pod \"node-resolver-x4xxd\" (UID: \"36370993-71ea-41fa-89c7-743d6ff32ee5\") " pod="openshift-dns/node-resolver-x4xxd"
Jul 13 17:17:23.299747 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.297589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk8fj\" (UniqueName: \"kubernetes.io/projected/36370993-71ea-41fa-89c7-743d6ff32ee5-kube-api-access-rk8fj\") pod \"node-resolver-x4xxd\" (UID: \"36370993-71ea-41fa-89c7-743d6ff32ee5\") " pod="openshift-dns/node-resolver-x4xxd"
Jul 13 17:17:23.299747 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.297613    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04050fbe-991d-4d80-a89b-70a4cc814981-tmp\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.299747 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.297994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/504c70e2-e9b9-4bbe-973d-9037d326099b-konnectivity-ca\") pod \"konnectivity-agent-fs6kx\" (UID: \"504c70e2-e9b9-4bbe-973d-9037d326099b\") " pod="kube-system/konnectivity-agent-fs6kx"
Jul 13 17:17:23.299747 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.298047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be5b5dde-24ca-4827-a78e-b178518d45cd-system-cni-dir\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.299747 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.298134    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-etc-sysctl-conf\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.300603 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.298157    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-socket-dir\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.300603 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.298169    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/106d80d3-2c06-4715-90e2-a5b2fb627cb9-cni-binary-copy\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.300603 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.296037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6498731f-325a-4950-b8f5-54c8d3f53373-device-dir\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.300603 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.298205    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04050fbe-991d-4d80-a89b-70a4cc814981-sys\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.300603 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.298486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36370993-71ea-41fa-89c7-743d6ff32ee5-tmp-dir\") pod \"node-resolver-x4xxd\" (UID: \"36370993-71ea-41fa-89c7-743d6ff32ee5\") " pod="openshift-dns/node-resolver-x4xxd"
Jul 13 17:17:23.300603 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.298610    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db0bf4bc-76e1-40ca-9d7f-8bd50243db39-serviceca\") pod \"node-ca-jgf4v\" (UID: \"db0bf4bc-76e1-40ca-9d7f-8bd50243db39\") " pod="openshift-image-registry/node-ca-jgf4v"
Jul 13 17:17:23.300603 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.299367    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e81c2d84-cf2f-403d-a6de-8da683e40aba-ovnkube-config\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.300951 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.300772    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/504c70e2-e9b9-4bbe-973d-9037d326099b-agent-certs\") pod \"konnectivity-agent-fs6kx\" (UID: \"504c70e2-e9b9-4bbe-973d-9037d326099b\") " pod="kube-system/konnectivity-agent-fs6kx"
Jul 13 17:17:23.301870 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.301848    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e81c2d84-cf2f-403d-a6de-8da683e40aba-ovn-node-metrics-cert\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.303083 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.302881    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04050fbe-991d-4d80-a89b-70a4cc814981-tmp\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.303083 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.303038    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/04050fbe-991d-4d80-a89b-70a4cc814981-etc-tuned\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.312484 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.312459    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:17:23.312601 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.312490    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:17:23.312601 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.312506    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wzmv4 for pod openshift-network-diagnostics/network-check-target-m9fqx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:23.312732 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.312609    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4 podName:403ea272-31db-42da-b356-9fb9a9aca3a6 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:23.812590387 +0000 UTC m=+4.464713014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wzmv4" (UniqueName: "kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4") pod "network-check-target-m9fqx" (UID: "403ea272-31db-42da-b356-9fb9a9aca3a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:23.316004 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.314767    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnnl5\" (UniqueName: \"kubernetes.io/projected/89ab2977-0020-43c9-9b3a-eb2d910f52bb-kube-api-access-rnnl5\") pod \"iptables-alerter-f6h2p\" (UID: \"89ab2977-0020-43c9-9b3a-eb2d910f52bb\") " pod="openshift-network-operator/iptables-alerter-f6h2p"
Jul 13 17:17:23.317397 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.317373    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl29r\" (UniqueName: \"kubernetes.io/projected/106d80d3-2c06-4715-90e2-a5b2fb627cb9-kube-api-access-fl29r\") pod \"multus-7cppw\" (UID: \"106d80d3-2c06-4715-90e2-a5b2fb627cb9\") " pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.317925 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.317906    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg54t\" (UniqueName: \"kubernetes.io/projected/5cf84bf3-8941-43b9-b255-3b74ceb51b71-kube-api-access-fg54t\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:23.319343 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.319317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdcwk\" (UniqueName: \"kubernetes.io/projected/be5b5dde-24ca-4827-a78e-b178518d45cd-kube-api-access-wdcwk\") pod \"multus-additional-cni-plugins-mg8xv\" (UID: \"be5b5dde-24ca-4827-a78e-b178518d45cd\") " pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.324252 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.324221    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84fgl\" (UniqueName: \"kubernetes.io/projected/db0bf4bc-76e1-40ca-9d7f-8bd50243db39-kube-api-access-84fgl\") pod \"node-ca-jgf4v\" (UID: \"db0bf4bc-76e1-40ca-9d7f-8bd50243db39\") " pod="openshift-image-registry/node-ca-jgf4v"
Jul 13 17:17:23.325061 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.325017    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk8fj\" (UniqueName: \"kubernetes.io/projected/36370993-71ea-41fa-89c7-743d6ff32ee5-kube-api-access-rk8fj\") pod \"node-resolver-x4xxd\" (UID: \"36370993-71ea-41fa-89c7-743d6ff32ee5\") " pod="openshift-dns/node-resolver-x4xxd"
Jul 13 17:17:23.326597 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.326555    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l8sh\" (UniqueName: \"kubernetes.io/projected/6498731f-325a-4950-b8f5-54c8d3f53373-kube-api-access-7l8sh\") pod \"aws-ebs-csi-driver-node-qgqdg\" (UID: \"6498731f-325a-4950-b8f5-54c8d3f53373\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.327130 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.327086    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5thk\" (UniqueName: \"kubernetes.io/projected/e81c2d84-cf2f-403d-a6de-8da683e40aba-kube-api-access-m5thk\") pod \"ovnkube-node-5tt87\" (UID: \"e81c2d84-cf2f-403d-a6de-8da683e40aba\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.327230 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.327152    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j2cd\" (UniqueName: \"kubernetes.io/projected/04050fbe-991d-4d80-a89b-70a4cc814981-kube-api-access-9j2cd\") pod \"tuned-mwd8g\" (UID: \"04050fbe-991d-4d80-a89b-70a4cc814981\") " pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.401736 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.401648    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mwd8g"
Jul 13 17:17:23.410255 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.410225    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:23.414104 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:23.414069    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04050fbe_991d_4d80_a89b_70a4cc814981.slice/crio-d2e9e609ed175e3596952da692aeae790ec3c82f6b071e1743a8efea8b7c8df2 WatchSource:0}: Error finding container d2e9e609ed175e3596952da692aeae790ec3c82f6b071e1743a8efea8b7c8df2: Status 404 returned error can't find the container with id d2e9e609ed175e3596952da692aeae790ec3c82f6b071e1743a8efea8b7c8df2
Jul 13 17:17:23.418419 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.418393    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7cppw"
Jul 13 17:17:23.420090 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:23.420066    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81c2d84_cf2f_403d_a6de_8da683e40aba.slice/crio-a580324627397a76f274bf5525fcfcc9961a7c5034ab9eed868054bdd1be93db WatchSource:0}: Error finding container a580324627397a76f274bf5525fcfcc9961a7c5034ab9eed868054bdd1be93db: Status 404 returned error can't find the container with id a580324627397a76f274bf5525fcfcc9961a7c5034ab9eed868054bdd1be93db
Jul 13 17:17:23.422835 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.422814    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fs6kx"
Jul 13 17:17:23.427353 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.427304    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mg8xv"
Jul 13 17:17:23.427566 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:23.427542    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod106d80d3_2c06_4715_90e2_a5b2fb627cb9.slice/crio-c2dcb9df7bcdf300bfa693b1fce4ee88d71826e40580232baa96108ad59027e2 WatchSource:0}: Error finding container c2dcb9df7bcdf300bfa693b1fce4ee88d71826e40580232baa96108ad59027e2: Status 404 returned error can't find the container with id c2dcb9df7bcdf300bfa693b1fce4ee88d71826e40580232baa96108ad59027e2
Jul 13 17:17:23.433187 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.433117    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg"
Jul 13 17:17:23.433840 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:23.433562    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504c70e2_e9b9_4bbe_973d_9037d326099b.slice/crio-5f0d2de23a45bab5ea527fc41a8742b4fabdd83c6ce9b253a2798082090bd61f WatchSource:0}: Error finding container 5f0d2de23a45bab5ea527fc41a8742b4fabdd83c6ce9b253a2798082090bd61f: Status 404 returned error can't find the container with id 5f0d2de23a45bab5ea527fc41a8742b4fabdd83c6ce9b253a2798082090bd61f
Jul 13 17:17:23.438517 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.438482    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jgf4v"
Jul 13 17:17:23.439565 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:23.439529    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe5b5dde_24ca_4827_a78e_b178518d45cd.slice/crio-c9ba8594bc86ccc9c744a43878bf9c1276625e963542171c18f84b9612d0fea0 WatchSource:0}: Error finding container c9ba8594bc86ccc9c744a43878bf9c1276625e963542171c18f84b9612d0fea0: Status 404 returned error can't find the container with id c9ba8594bc86ccc9c744a43878bf9c1276625e963542171c18f84b9612d0fea0
Jul 13 17:17:23.444790 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.444624    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f6h2p"
Jul 13 17:17:23.445843 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:23.445816    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6498731f_325a_4950_b8f5_54c8d3f53373.slice/crio-24df30aff0626a92039204493d609a37a055db1c5a401be4570314106deed8cb WatchSource:0}: Error finding container 24df30aff0626a92039204493d609a37a055db1c5a401be4570314106deed8cb: Status 404 returned error can't find the container with id 24df30aff0626a92039204493d609a37a055db1c5a401be4570314106deed8cb
Jul 13 17:17:23.449187 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.449160    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x4xxd"
Jul 13 17:17:23.450193 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:23.450158    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0bf4bc_76e1_40ca_9d7f_8bd50243db39.slice/crio-ed155b0c3b286816d0d80d20bb5e8cdf79aa41829d52cd3a96561888e50d901b WatchSource:0}: Error finding container ed155b0c3b286816d0d80d20bb5e8cdf79aa41829d52cd3a96561888e50d901b: Status 404 returned error can't find the container with id ed155b0c3b286816d0d80d20bb5e8cdf79aa41829d52cd3a96561888e50d901b
Jul 13 17:17:23.456537 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:23.456514    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ab2977_0020_43c9_9b3a_eb2d910f52bb.slice/crio-d12a8ecc3bde3349124a3f5d6f71ace99a8f1ae3072ac87f2ccbc9d2dec6d217 WatchSource:0}: Error finding container d12a8ecc3bde3349124a3f5d6f71ace99a8f1ae3072ac87f2ccbc9d2dec6d217: Status 404 returned error can't find the container with id d12a8ecc3bde3349124a3f5d6f71ace99a8f1ae3072ac87f2ccbc9d2dec6d217
Jul 13 17:17:23.467562 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:23.467510    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36370993_71ea_41fa_89c7_743d6ff32ee5.slice/crio-594f68bc09fd98c64d236da6815a08d25f0b3c7b1e8e5b679104b891fac2d0e1 WatchSource:0}: Error finding container 594f68bc09fd98c64d236da6815a08d25f0b3c7b1e8e5b679104b891fac2d0e1: Status 404 returned error can't find the container with id 594f68bc09fd98c64d236da6815a08d25f0b3c7b1e8e5b679104b891fac2d0e1
Jul 13 17:17:23.801635 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.801502    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:23.801635 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.801560    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:23.801874 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.801698    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:23.801874 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.801758    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:23.801874 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.801786    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs podName:5cf84bf3-8941-43b9-b255-3b74ceb51b71 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:24.8017635 +0000 UTC m=+5.453886123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs") pod "network-metrics-daemon-h26bb" (UID: "5cf84bf3-8941-43b9-b255-3b74ceb51b71") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:23.801874 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.801826    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret podName:68c215bc-8805-4045-bfc2-16b86752c850 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:24.801804071 +0000 UTC m=+5.453926695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret") pod "global-pull-secret-syncer-5n7fg" (UID: "68c215bc-8805-4045-bfc2-16b86752c850") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:23.902870 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:23.902101    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzmv4\" (UniqueName: \"kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4\") pod \"network-check-target-m9fqx\" (UID: \"403ea272-31db-42da-b356-9fb9a9aca3a6\") " pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:23.902870 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.902331    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:17:23.902870 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.902384    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:17:23.902870 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.902399    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wzmv4 for pod openshift-network-diagnostics/network-check-target-m9fqx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:23.902870 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:23.902491    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4 podName:403ea272-31db-42da-b356-9fb9a9aca3a6 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:24.90247028 +0000 UTC m=+5.554592889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzmv4" (UniqueName: "kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4") pod "network-check-target-m9fqx" (UID: "403ea272-31db-42da-b356-9fb9a9aca3a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:24.106642 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:24.106486    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jgf4v" event={"ID":"db0bf4bc-76e1-40ca-9d7f-8bd50243db39","Type":"ContainerStarted","Data":"ed155b0c3b286816d0d80d20bb5e8cdf79aa41829d52cd3a96561888e50d901b"}
Jul 13 17:17:24.111295 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:24.111136    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg" event={"ID":"6498731f-325a-4950-b8f5-54c8d3f53373","Type":"ContainerStarted","Data":"24df30aff0626a92039204493d609a37a055db1c5a401be4570314106deed8cb"}
Jul 13 17:17:24.115349 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:24.115316    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7cppw" event={"ID":"106d80d3-2c06-4715-90e2-a5b2fb627cb9","Type":"ContainerStarted","Data":"c2dcb9df7bcdf300bfa693b1fce4ee88d71826e40580232baa96108ad59027e2"}
Jul 13 17:17:24.121492 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:24.121464    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87" event={"ID":"e81c2d84-cf2f-403d-a6de-8da683e40aba","Type":"ContainerStarted","Data":"a580324627397a76f274bf5525fcfcc9961a7c5034ab9eed868054bdd1be93db"}
Jul 13 17:17:24.123339 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:24.123312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x4xxd" event={"ID":"36370993-71ea-41fa-89c7-743d6ff32ee5","Type":"ContainerStarted","Data":"594f68bc09fd98c64d236da6815a08d25f0b3c7b1e8e5b679104b891fac2d0e1"}
Jul 13 17:17:24.126055 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:24.126030    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f6h2p" event={"ID":"89ab2977-0020-43c9-9b3a-eb2d910f52bb","Type":"ContainerStarted","Data":"d12a8ecc3bde3349124a3f5d6f71ace99a8f1ae3072ac87f2ccbc9d2dec6d217"}
Jul 13 17:17:24.129865 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:24.129816    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mg8xv" event={"ID":"be5b5dde-24ca-4827-a78e-b178518d45cd","Type":"ContainerStarted","Data":"c9ba8594bc86ccc9c744a43878bf9c1276625e963542171c18f84b9612d0fea0"}
Jul 13 17:17:24.134713 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:24.134688    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fs6kx" event={"ID":"504c70e2-e9b9-4bbe-973d-9037d326099b","Type":"ContainerStarted","Data":"5f0d2de23a45bab5ea527fc41a8742b4fabdd83c6ce9b253a2798082090bd61f"}
Jul 13 17:17:24.143164 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:24.143131    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mwd8g" event={"ID":"04050fbe-991d-4d80-a89b-70a4cc814981","Type":"ContainerStarted","Data":"d2e9e609ed175e3596952da692aeae790ec3c82f6b071e1743a8efea8b7c8df2"}
Jul 13 17:17:24.154478 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:24.154420    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 17:12:23 +0000 UTC" deadline="2028-04-06 05:43:15.082187358 +0000 UTC"
Jul 13 17:17:24.154478 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:24.154480    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15180h25m50.927711992s"
Jul 13 17:17:24.810798 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:24.810759    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:24.810989 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:24.810818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:24.810989 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:24.810984    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:24.811132 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:24.811047    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret podName:68c215bc-8805-4045-bfc2-16b86752c850 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:26.811026616 +0000 UTC m=+7.463149224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret") pod "global-pull-secret-syncer-5n7fg" (UID: "68c215bc-8805-4045-bfc2-16b86752c850") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:24.811504 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:24.811482    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:24.811612 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:24.811541    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs podName:5cf84bf3-8941-43b9-b255-3b74ceb51b71 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:26.811523494 +0000 UTC m=+7.463646114 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs") pod "network-metrics-daemon-h26bb" (UID: "5cf84bf3-8941-43b9-b255-3b74ceb51b71") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:24.912380 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:24.912342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzmv4\" (UniqueName: \"kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4\") pod \"network-check-target-m9fqx\" (UID: \"403ea272-31db-42da-b356-9fb9a9aca3a6\") " pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:24.912591 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:24.912563    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:17:24.912591 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:24.912583    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:17:24.912710 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:24.912596    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wzmv4 for pod openshift-network-diagnostics/network-check-target-m9fqx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:24.912710 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:24.912658    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4 podName:403ea272-31db-42da-b356-9fb9a9aca3a6 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:26.912637944 +0000 UTC m=+7.564760551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzmv4" (UniqueName: "kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4") pod "network-check-target-m9fqx" (UID: "403ea272-31db-42da-b356-9fb9a9aca3a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:25.066694 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:25.065203    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:25.066694 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:25.065341    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:25.066694 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:25.065807    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:25.066694 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:25.065920    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:25.066694 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:25.065988    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:25.066694 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:25.066064    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:25.155524 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:25.155398    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 17:12:23 +0000 UTC" deadline="2028-03-02 01:31:28.315755656 +0000 UTC"
Jul 13 17:17:25.155524 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:25.155450    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14336h14m3.160310858s"
Jul 13 17:17:26.829603 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:26.829564    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:26.829603 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:26.829628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:26.830226 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:26.829828    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:26.830226 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:26.829894    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret podName:68c215bc-8805-4045-bfc2-16b86752c850 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:30.829874042 +0000 UTC m=+11.481996673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret") pod "global-pull-secret-syncer-5n7fg" (UID: "68c215bc-8805-4045-bfc2-16b86752c850") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:26.830348 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:26.830303    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:26.830410 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:26.830371    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs podName:5cf84bf3-8941-43b9-b255-3b74ceb51b71 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:30.830354297 +0000 UTC m=+11.482476916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs") pod "network-metrics-daemon-h26bb" (UID: "5cf84bf3-8941-43b9-b255-3b74ceb51b71") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:26.931823 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:26.931161    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzmv4\" (UniqueName: \"kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4\") pod \"network-check-target-m9fqx\" (UID: \"403ea272-31db-42da-b356-9fb9a9aca3a6\") " pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:26.931823 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:26.931341    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:17:26.931823 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:26.931367    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:17:26.931823 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:26.931381    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wzmv4 for pod openshift-network-diagnostics/network-check-target-m9fqx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:26.931823 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:26.931462    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4 podName:403ea272-31db-42da-b356-9fb9a9aca3a6 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:30.931440279 +0000 UTC m=+11.583562921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzmv4" (UniqueName: "kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4") pod "network-check-target-m9fqx" (UID: "403ea272-31db-42da-b356-9fb9a9aca3a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:27.065429 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:27.065391    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:27.065645 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:27.065536    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:27.065965 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:27.065947    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:27.066087 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:27.066057    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:27.066144 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:27.066108    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:27.066210 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:27.066181    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:29.065742 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:29.065640    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:29.066217 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:29.065778    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:29.066217 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:29.065786    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:29.066217 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:29.065930    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:29.066217 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:29.065995    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:29.066217 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:29.066063    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:30.863973 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:30.863407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:30.863973 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:30.863465    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:30.863973 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:30.863576    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:30.863973 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:30.863578    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:30.863973 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:30.863640    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret podName:68c215bc-8805-4045-bfc2-16b86752c850 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:38.863621636 +0000 UTC m=+19.515744253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret") pod "global-pull-secret-syncer-5n7fg" (UID: "68c215bc-8805-4045-bfc2-16b86752c850") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:30.863973 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:30.863659    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs podName:5cf84bf3-8941-43b9-b255-3b74ceb51b71 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:38.863650302 +0000 UTC m=+19.515772908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs") pod "network-metrics-daemon-h26bb" (UID: "5cf84bf3-8941-43b9-b255-3b74ceb51b71") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:30.964786 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:30.964744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzmv4\" (UniqueName: \"kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4\") pod \"network-check-target-m9fqx\" (UID: \"403ea272-31db-42da-b356-9fb9a9aca3a6\") " pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:30.964980 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:30.964907    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:17:30.964980 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:30.964931    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:17:30.964980 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:30.964945    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wzmv4 for pod openshift-network-diagnostics/network-check-target-m9fqx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:30.965130 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:30.965003    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4 podName:403ea272-31db-42da-b356-9fb9a9aca3a6 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:38.96498523 +0000 UTC m=+19.617107837 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzmv4" (UniqueName: "kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4") pod "network-check-target-m9fqx" (UID: "403ea272-31db-42da-b356-9fb9a9aca3a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:31.065089 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:31.065048    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:31.065260 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:31.065091    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:31.065260 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:31.065173    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:31.065260 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:31.065187    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:31.065473 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:31.065264    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:31.065473 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:31.065365    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:33.065592 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:33.065506    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:33.065592 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:33.065562    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:33.066072 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:33.065645    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:33.066072 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:33.065647    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:33.066072 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:33.065749    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:33.066072 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:33.065829    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:35.065586 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:35.065327    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:35.066005 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:35.065396    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:35.066005 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:35.065698    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:35.066005 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:35.065396    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:35.066005 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:35.065769    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:35.066005 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:35.065904    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:35.173002 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:35.172966    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-144.ec2.internal" event={"ID":"1b903a136f96045e7d3d6d1be0500b2d","Type":"ContainerStarted","Data":"e79d61a54a7fe8445e61d262fa58dbef69e16c634ea6e8afa7e1eed9f07051be"}
Jul 13 17:17:35.174557 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:35.174524    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mwd8g" event={"ID":"04050fbe-991d-4d80-a89b-70a4cc814981","Type":"ContainerStarted","Data":"8a45b71880c137df98162e8d9bfaf2c7abe733b0acc5c918881c9943b57dddd7"}
Jul 13 17:17:35.192417 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:35.192371    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-144.ec2.internal" podStartSLOduration=13.192333184 podStartE2EDuration="13.192333184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:17:35.191986293 +0000 UTC m=+15.844108919" watchObservedRunningTime="2026-07-13 17:17:35.192333184 +0000 UTC m=+15.844455809"
Jul 13 17:17:35.214147 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:35.214101    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mwd8g" podStartSLOduration=4.278956207 podStartE2EDuration="15.214086143s" totalImagesPullingTime="10.935129936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:17:35.213782075 +0000 UTC m=+15.865904701" watchObservedRunningTime="2026-07-13 17:17:35.214086143 +0000 UTC m=+15.866208767"
Jul 13 17:17:36.178121 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:36.178038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fs6kx" event={"ID":"504c70e2-e9b9-4bbe-973d-9037d326099b","Type":"ContainerStarted","Data":"9e3619b30ad10b81c4735d0c83525041624a0c3eb12ca13f02fa3fbb2fa2d183"}
Jul 13 17:17:36.179540 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:36.179487    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal" event={"ID":"c5781ace799c1d43c4431c9f5a2f6c98","Type":"ContainerStarted","Data":"05afd1f4509a5f528639637598f0bc8da003329dbaddc10dfe3a75abdbf03a40"}
Jul 13 17:17:36.181238 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:36.181211    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jgf4v" event={"ID":"db0bf4bc-76e1-40ca-9d7f-8bd50243db39","Type":"ContainerStarted","Data":"6d9c735a213fee4cf520a1690f43ba66d190f41a48d8935304d8421072b51819"}
Jul 13 17:17:36.182922 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:36.182895    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg" event={"ID":"6498731f-325a-4950-b8f5-54c8d3f53373","Type":"ContainerStarted","Data":"98eb139082ad94d0f4cff629a726fff744ee38706def420ee7822524efac9d9a"}
Jul 13 17:17:36.184445 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:36.184414    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x4xxd" event={"ID":"36370993-71ea-41fa-89c7-743d6ff32ee5","Type":"ContainerStarted","Data":"d55c2ffbd088f104e9732271678be3b23b1b6712e6041c468052418a9533957c"}
Jul 13 17:17:36.185958 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:36.185928    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f6h2p" event={"ID":"89ab2977-0020-43c9-9b3a-eb2d910f52bb","Type":"ContainerStarted","Data":"0747912d601148354c63a9a57d9b1fc12dceb6c9b905ebec4e7e6c3703e2f359"}
Jul 13 17:17:36.187463 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:36.187424    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mg8xv" event={"ID":"be5b5dde-24ca-4827-a78e-b178518d45cd","Type":"ContainerStarted","Data":"a1976bc4a364cfb306f28ec6c9b5ab28f904316873d92cd98290190c090d0ac0"}
Jul 13 17:17:36.227987 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:36.227926    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fs6kx" podStartSLOduration=5.312228444 podStartE2EDuration="16.227904724s" totalImagesPullingTime="10.91567628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:17:36.203439229 +0000 UTC m=+16.855561855" watchObservedRunningTime="2026-07-13 17:17:36.227904724 +0000 UTC m=+16.880027350"
Jul 13 17:17:36.301209 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:36.301148    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jgf4v" podStartSLOduration=5.406175698 podStartE2EDuration="16.301127971s" totalImagesPullingTime="10.894952273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:17:36.277824852 +0000 UTC m=+16.929947478" watchObservedRunningTime="2026-07-13 17:17:36.301127971 +0000 UTC m=+16.953250596"
Jul 13 17:17:36.327784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:36.327558    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f6h2p" podStartSLOduration=5.436187896 podStartE2EDuration="16.327543211s" totalImagesPullingTime="10.891355315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:17:36.301338853 +0000 UTC m=+16.953461478" watchObservedRunningTime="2026-07-13 17:17:36.327543211 +0000 UTC m=+16.979665835"
Jul 13 17:17:37.065011 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:37.064972    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:37.065204 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:37.065085    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:37.065204 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:37.065092    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:37.065305 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:37.065203    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:37.065305 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:37.065263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:37.065417 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:37.065367    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:38.922961 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:38.922915    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:38.922961 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:38.922969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:38.923673 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:38.923441    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:38.923673 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:38.923510    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:38.923673 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:38.923542    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs podName:5cf84bf3-8941-43b9-b255-3b74ceb51b71 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:54.923497753 +0000 UTC m=+35.575620358 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs") pod "network-metrics-daemon-h26bb" (UID: "5cf84bf3-8941-43b9-b255-3b74ceb51b71") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:38.923673 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:38.923584    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret podName:68c215bc-8805-4045-bfc2-16b86752c850 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:54.923553501 +0000 UTC m=+35.575676122 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret") pod "global-pull-secret-syncer-5n7fg" (UID: "68c215bc-8805-4045-bfc2-16b86752c850") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:39.024084 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:39.023790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzmv4\" (UniqueName: \"kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4\") pod \"network-check-target-m9fqx\" (UID: \"403ea272-31db-42da-b356-9fb9a9aca3a6\") " pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:39.024084 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:39.023941    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:17:39.024084 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:39.023961    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:17:39.024084 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:39.023972    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wzmv4 for pod openshift-network-diagnostics/network-check-target-m9fqx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:39.024084 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:39.024035    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4 podName:403ea272-31db-42da-b356-9fb9a9aca3a6 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:55.024014546 +0000 UTC m=+35.676137173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzmv4" (UniqueName: "kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4") pod "network-check-target-m9fqx" (UID: "403ea272-31db-42da-b356-9fb9a9aca3a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:39.065578 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:39.065546    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:39.065721 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:39.065649    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:39.065827 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:39.065807    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:39.065957 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:39.065920    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:39.065957 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:39.065807    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:39.066150 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:39.066063    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:39.483533 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:39.483498    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fs6kx"
Jul 13 17:17:39.593640 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:39.593609    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fs6kx"
Jul 13 17:17:39.594306 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:39.594286    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fs6kx"
Jul 13 17:17:39.611708 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:39.611659    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x4xxd" podStartSLOduration=8.660970469 podStartE2EDuration="19.611641365s" totalImagesPullingTime="10.950670896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:17:36.326998614 +0000 UTC m=+16.979121240" watchObservedRunningTime="2026-07-13 17:17:39.611641365 +0000 UTC m=+20.263764194"
Jul 13 17:17:40.196507 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:40.196471    2579 generic.go:356] "Generic (PLEG): container finished" podID="be5b5dde-24ca-4827-a78e-b178518d45cd" containerID="a1976bc4a364cfb306f28ec6c9b5ab28f904316873d92cd98290190c090d0ac0" exitCode=0
Jul 13 17:17:40.197188 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:40.196560    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mg8xv" event={"ID":"be5b5dde-24ca-4827-a78e-b178518d45cd","Type":"ContainerDied","Data":"a1976bc4a364cfb306f28ec6c9b5ab28f904316873d92cd98290190c090d0ac0"}
Jul 13 17:17:40.198255 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:40.198222    2579 generic.go:356] "Generic (PLEG): container finished" podID="c5781ace799c1d43c4431c9f5a2f6c98" containerID="05afd1f4509a5f528639637598f0bc8da003329dbaddc10dfe3a75abdbf03a40" exitCode=0
Jul 13 17:17:40.198374 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:40.198266    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal" event={"ID":"c5781ace799c1d43c4431c9f5a2f6c98","Type":"ContainerDied","Data":"05afd1f4509a5f528639637598f0bc8da003329dbaddc10dfe3a75abdbf03a40"}
Jul 13 17:17:40.199079 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:40.199059    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fs6kx"
Jul 13 17:17:41.065161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:41.065137    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:41.065311 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:41.065138    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:41.065311 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:41.065257    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:41.065394 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:41.065330    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:41.065394 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:41.065138    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:41.065488 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:41.065418    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:43.064949 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:43.064906    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:43.065440 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:43.064917    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:43.065440 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:43.065041    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:43.065440 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:43.065059    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:43.065440 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:43.065166    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:43.065440 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:43.065268    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:43.624937 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:43.624697    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 17:17:44.092065 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:44.091914    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T17:17:43.624934437Z","UUID":"aa4b2a31-b916-4a54-a2e6-9dc6d7333fad","Handler":null,"Name":"","Endpoint":""}
Jul 13 17:17:44.093775 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:44.093751    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 17:17:44.093885 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:44.093788    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 17:17:44.208621 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:44.208577    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal" event={"ID":"c5781ace799c1d43c4431c9f5a2f6c98","Type":"ContainerStarted","Data":"89ca3846e738a4fcc1deddbc24ec3d0be06490bae79f1ccb1ef1375336cb2fcf"}
Jul 13 17:17:44.210495 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:44.210471    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg" event={"ID":"6498731f-325a-4950-b8f5-54c8d3f53373","Type":"ContainerStarted","Data":"58eccc2c33b1e14e0b7ac0d646fb4a20f757917f5eaa9f343a1caae56eafad6c"}
Jul 13 17:17:44.212001 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:44.211972    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7cppw" event={"ID":"106d80d3-2c06-4715-90e2-a5b2fb627cb9","Type":"ContainerStarted","Data":"33b9d023e27b5a0532c1855ab6e1f0b39e6b07eea3312b5447e3b53aa0aa8995"}
Jul 13 17:17:44.215019 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:44.215003    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:17:44.215406 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:44.215382    2579 generic.go:356] "Generic (PLEG): container finished" podID="e81c2d84-cf2f-403d-a6de-8da683e40aba" containerID="a9406f84279f8cbacb620d585bb19974de1c04dbe4c3ef46ec903f3132f71362" exitCode=1
Jul 13 17:17:44.215503 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:44.215428    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87" event={"ID":"e81c2d84-cf2f-403d-a6de-8da683e40aba","Type":"ContainerStarted","Data":"2c468317ee0502455f89840bd854958537a47d9c32e48a267e9640d2cbec4204"}
Jul 13 17:17:44.215503 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:44.215494    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87" event={"ID":"e81c2d84-cf2f-403d-a6de-8da683e40aba","Type":"ContainerStarted","Data":"c590df413f56e2af3f3bca6e601cdc5c9245ca678c7a5f2dd938cc1d0b6a3a46"}
Jul 13 17:17:44.215611 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:44.215544    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87" event={"ID":"e81c2d84-cf2f-403d-a6de-8da683e40aba","Type":"ContainerStarted","Data":"3af1b4cdfbd03ce6d5c56826da0bd7a6964a3ecf5967752fad46e8cc80e3e4bf"}
Jul 13 17:17:44.215611 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:44.215595    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87" event={"ID":"e81c2d84-cf2f-403d-a6de-8da683e40aba","Type":"ContainerStarted","Data":"0f345d5ffb01eab2dc323817339c5231c9e81d482ce529f0cf35b6aa556311a2"}
Jul 13 17:17:44.215717 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:44.215645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87" event={"ID":"e81c2d84-cf2f-403d-a6de-8da683e40aba","Type":"ContainerDied","Data":"a9406f84279f8cbacb620d585bb19974de1c04dbe4c3ef46ec903f3132f71362"}
Jul 13 17:17:44.215717 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:44.215696    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87" event={"ID":"e81c2d84-cf2f-403d-a6de-8da683e40aba","Type":"ContainerStarted","Data":"8c425bdae781a3da46f6ef7553cc2bdf85cb3f23ed78144a0274634f3638edd7"}
Jul 13 17:17:44.247775 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:44.247730    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-144.ec2.internal" podStartSLOduration=22.247716889 podStartE2EDuration="22.247716889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:17:44.247443253 +0000 UTC m=+24.899565879" watchObservedRunningTime="2026-07-13 17:17:44.247716889 +0000 UTC m=+24.899839514"
Jul 13 17:17:45.064956 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:45.064746    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:45.065172 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:45.064779    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:45.065172 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:45.065048    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:45.065172 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:45.064780    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:45.065172 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:45.065142    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:45.065421 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:45.065251    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:47.064757 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:47.064729    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:47.065110 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:47.064729    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:47.065110 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:47.064831    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:47.065110 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:47.064729    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:47.065110 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:47.064897    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:47.065110 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:47.064959    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:48.225394 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:48.225338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg" event={"ID":"6498731f-325a-4950-b8f5-54c8d3f53373","Type":"ContainerStarted","Data":"64cbd34b372974ef30a30a513761640856ea59e8b6e1d61f551b090b1203b6fd"}
Jul 13 17:17:48.228235 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:48.228218    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:17:48.228641 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:48.228621    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87" event={"ID":"e81c2d84-cf2f-403d-a6de-8da683e40aba","Type":"ContainerStarted","Data":"a7feebfbfa9431393553641df7ad25ae7ed88977a927bbe01b28e21ce8e7c821"}
Jul 13 17:17:48.230264 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:48.230240    2579 generic.go:356] "Generic (PLEG): container finished" podID="be5b5dde-24ca-4827-a78e-b178518d45cd" containerID="222284198f143edf771c87462ab46babc2afa165f1f04ab0b7b780141f4f431d" exitCode=0
Jul 13 17:17:48.230387 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:48.230276    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mg8xv" event={"ID":"be5b5dde-24ca-4827-a78e-b178518d45cd","Type":"ContainerDied","Data":"222284198f143edf771c87462ab46babc2afa165f1f04ab0b7b780141f4f431d"}
Jul 13 17:17:48.246003 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:48.245962    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qgqdg" podStartSLOduration=5.766638473 podStartE2EDuration="28.245950898s" totalImagesPullingTime="22.479312425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:17:48.245722755 +0000 UTC m=+28.897845379" watchObservedRunningTime="2026-07-13 17:17:48.245950898 +0000 UTC m=+28.898073522"
Jul 13 17:17:48.246142 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:48.246123    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7cppw" podStartSLOduration=8.16063707 podStartE2EDuration="28.246119091s" totalImagesPullingTime="20.085482021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:17:44.312040563 +0000 UTC m=+24.964163188" watchObservedRunningTime="2026-07-13 17:17:48.246119091 +0000 UTC m=+28.898241716"
Jul 13 17:17:49.065189 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:49.065154    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:49.065437 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:49.065243    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:49.065437 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:49.065368    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:49.065437 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:49.065382    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:49.065596 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:49.065502    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:49.065637 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:49.065594    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:50.238099 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:50.237925    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:17:50.238644 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:50.238463    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87" event={"ID":"e81c2d84-cf2f-403d-a6de-8da683e40aba","Type":"ContainerStarted","Data":"7fd38deff0b2ad541be113d0c27fc4a147b5ff37ff8bb9bd58c7b4b6aec4ba76"}
Jul 13 17:17:50.238726 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:50.238707    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:50.238803 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:50.238779    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:50.238867 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:50.238853    2579 scope.go:117] "RemoveContainer" containerID="a9406f84279f8cbacb620d585bb19974de1c04dbe4c3ef46ec903f3132f71362"
Jul 13 17:17:50.240664 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:50.240641    2579 generic.go:356] "Generic (PLEG): container finished" podID="be5b5dde-24ca-4827-a78e-b178518d45cd" containerID="afc01ff42313f1000f752643239ffb4be024315ad929e57c8aba38ae4879bb2f" exitCode=0
Jul 13 17:17:50.240748 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:50.240681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mg8xv" event={"ID":"be5b5dde-24ca-4827-a78e-b178518d45cd","Type":"ContainerDied","Data":"afc01ff42313f1000f752643239ffb4be024315ad929e57c8aba38ae4879bb2f"}
Jul 13 17:17:50.254903 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:50.254885    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:51.065571 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:51.065534    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:51.065755 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:51.065540    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:51.065755 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:51.065637    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:51.065845 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:51.065540    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:51.065845 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:51.065761    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:51.065845 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:51.065835    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:51.246197 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:51.246170    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:17:51.246569 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:51.246548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87" event={"ID":"e81c2d84-cf2f-403d-a6de-8da683e40aba","Type":"ContainerStarted","Data":"1451c8ee793786f497083e26617aceaa7c684d51e3b7cf5bdd971f70b1b3c7ee"}
Jul 13 17:17:51.246757 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:51.246740    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:51.263384 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:51.263339    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:17:51.297665 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:51.297609    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87" podStartSLOduration=15.110009235 podStartE2EDuration="31.297593711s" totalImagesPullingTime="16.187584476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:17:51.29205818 +0000 UTC m=+31.944180805" watchObservedRunningTime="2026-07-13 17:17:51.297593711 +0000 UTC m=+31.949716336"
Jul 13 17:17:51.996954 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:51.996875    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5n7fg"]
Jul 13 17:17:51.997095 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:51.996982    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:51.997095 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:51.997073    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:52.000009 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:51.999985    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h26bb"]
Jul 13 17:17:52.000121 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:52.000073    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:52.000176 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:52.000154    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:52.029024 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:52.028997    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m9fqx"]
Jul 13 17:17:52.029157 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:52.029087    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:52.029201 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:52.029172    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:52.251446 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:52.251336    2579 generic.go:356] "Generic (PLEG): container finished" podID="be5b5dde-24ca-4827-a78e-b178518d45cd" containerID="7043bc83a10fd496e60d8ca55a44b6a7fa27f40ac86cb8819c4f6101641b4eca" exitCode=0
Jul 13 17:17:52.251446 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:52.251377    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mg8xv" event={"ID":"be5b5dde-24ca-4827-a78e-b178518d45cd","Type":"ContainerDied","Data":"7043bc83a10fd496e60d8ca55a44b6a7fa27f40ac86cb8819c4f6101641b4eca"}
Jul 13 17:17:54.065217 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:54.065175    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:54.065665 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:54.065189    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:54.065665 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:54.065298    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:54.065665 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:54.065369    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:54.065665 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:54.065481    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:54.065665 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:54.065579    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:54.944184 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:54.944152    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:54.944184 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:54.944191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:54.944435 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:54.944318    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:54.944435 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:54.944328    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:54.944435 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:54.944395    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret podName:68c215bc-8805-4045-bfc2-16b86752c850 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:26.944377911 +0000 UTC m=+67.596500523 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret") pod "global-pull-secret-syncer-5n7fg" (UID: "68c215bc-8805-4045-bfc2-16b86752c850") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:17:54.944435 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:54.944409    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs podName:5cf84bf3-8941-43b9-b255-3b74ceb51b71 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:26.944403254 +0000 UTC m=+67.596525856 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs") pod "network-metrics-daemon-h26bb" (UID: "5cf84bf3-8941-43b9-b255-3b74ceb51b71") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:17:55.045362 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:55.045315    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzmv4\" (UniqueName: \"kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4\") pod \"network-check-target-m9fqx\" (UID: \"403ea272-31db-42da-b356-9fb9a9aca3a6\") " pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:55.045537 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:55.045515    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:17:55.045595 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:55.045543    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:17:55.045595 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:55.045556    2579 projected.go:196] Error preparing data for projected volume kube-api-access-wzmv4 for pod openshift-network-diagnostics/network-check-target-m9fqx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:55.045681 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:55.045621    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4 podName:403ea272-31db-42da-b356-9fb9a9aca3a6 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:27.045600632 +0000 UTC m=+67.697723242 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzmv4" (UniqueName: "kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4") pod "network-check-target-m9fqx" (UID: "403ea272-31db-42da-b356-9fb9a9aca3a6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:17:56.065857 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.065605    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:56.066299 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.065605    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:56.066299 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.065986    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:17:56.066299 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.066052    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n7fg" podUID="68c215bc-8805-4045-bfc2-16b86752c850"
Jul 13 17:17:56.066299 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.065605    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:56.066299 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.066149    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m9fqx" podUID="403ea272-31db-42da-b356-9fb9a9aca3a6"
Jul 13 17:17:56.091094 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.091060    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-144.ec2.internal" event="NodeReady"
Jul 13 17:17:56.091241 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.091195    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 17:17:56.172835 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.172802    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5857f69948-4rpbc"]
Jul 13 17:17:56.176095 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.176067    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"]
Jul 13 17:17:56.176237 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.176197    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.180383 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.178301    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"]
Jul 13 17:17:56.180492 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.180410    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:17:56.181249 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.181224    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"]
Jul 13 17:17:56.181461 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.181428    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:17:56.183441 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.183420    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27"]
Jul 13 17:17:56.183874 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.183622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.183874 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.183633    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 17:17:56.183874 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.183680    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 13 17:17:56.183874 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.183684    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 17:17:56.184115 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.184027    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 13 17:17:56.184115 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.184055    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 13 17:17:56.184214 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.184126    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2rlnn\""
Jul 13 17:17:56.184214 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.184159    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 13 17:17:56.185062 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.185042    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27"
Jul 13 17:17:56.185454 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.185430    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 13 17:17:56.185599 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.185580    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 13 17:17:56.191735 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.191715    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 13 17:17:56.192342 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.192322    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cgmf8\""
Jul 13 17:17:56.192942 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.192925    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2qfwx\""
Jul 13 17:17:56.193480 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.193459    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 13 17:17:56.193894 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.193872    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 13 17:17:56.194612 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.194488    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 17:17:56.195666 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.195648    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 13 17:17:56.197706 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.197688    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 17:17:56.205687 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.205615    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5857f69948-4rpbc"]
Jul 13 17:17:56.206182 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.206164    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"]
Jul 13 17:17:56.215192 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.215088    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"]
Jul 13 17:17:56.216061 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.216037    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"]
Jul 13 17:17:56.218004 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.217980    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-74f6n"]
Jul 13 17:17:56.220863 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.220846    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8fncn"]
Jul 13 17:17:56.221004 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.220986    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-74f6n"
Jul 13 17:17:56.221141 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.220995    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 13 17:17:56.222825 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.222805    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8fncn"
Jul 13 17:17:56.225723 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.225703    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 17:17:56.227917 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.227900    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 17:17:56.227997 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.227956    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vvlgt\""
Jul 13 17:17:56.227997 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.227974    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 17:17:56.228168 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.228146    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 17:17:56.228313 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.228206    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f7qlt\""
Jul 13 17:17:56.228384 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.228365    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 17:17:56.232599 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.232580    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27"]
Jul 13 17:17:56.240139 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.240116    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8fncn"]
Jul 13 17:17:56.256420 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.256172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-lhf7r\" (UID: \"5571bd9a-9e0a-4361-af35-c68a2e789240\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:17:56.256420 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.256214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5ec2a65-1853-4cee-a9f8-415e3cd29618-ca-trust-extracted\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.256420 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.256241    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5ec2a65-1853-4cee-a9f8-415e3cd29618-trusted-ca\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.256420 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.256302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-certificates\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.256691 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.256444    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmvfw\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-kube-api-access-tmvfw\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.256691 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.256566    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0078c5f7-e675-4c1e-b5d1-ff764834241d-tmp\") pod \"klusterlet-addon-workmgr-76444cff49-hpp8t\" (UID: \"0078c5f7-e675-4c1e-b5d1-ff764834241d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:17:56.256691 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.256630    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0078c5f7-e675-4c1e-b5d1-ff764834241d-klusterlet-config\") pod \"klusterlet-addon-workmgr-76444cff49-hpp8t\" (UID: \"0078c5f7-e675-4c1e-b5d1-ff764834241d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:17:56.256691 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.256678    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-bound-sa-token\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.256876 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.256714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.256876 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.256769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5ec2a65-1853-4cee-a9f8-415e3cd29618-installation-pull-secrets\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.256876 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.256817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5571bd9a-9e0a-4361-af35-c68a2e789240-nginx-conf\") pod \"networking-console-plugin-6cf856758c-lhf7r\" (UID: \"5571bd9a-9e0a-4361-af35-c68a2e789240\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:17:56.256876 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.256854    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5ec2a65-1853-4cee-a9f8-415e3cd29618-image-registry-private-configuration\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.256876 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.256876    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs74q\" (UniqueName: \"kubernetes.io/projected/0078c5f7-e675-4c1e-b5d1-ff764834241d-kube-api-access-hs74q\") pod \"klusterlet-addon-workmgr-76444cff49-hpp8t\" (UID: \"0078c5f7-e675-4c1e-b5d1-ff764834241d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:17:56.257112 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.257073    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-74f6n"]
Jul 13 17:17:56.360763 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.357538    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5ec2a65-1853-4cee-a9f8-415e3cd29618-ca-trust-extracted\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.360763 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.357630    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5099f672-6f0f-4f21-91ec-2141e149b826-tmp-dir\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:17:56.360763 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.357688    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vckbp\" (UniqueName: \"kubernetes.io/projected/5099f672-6f0f-4f21-91ec-2141e149b826-kube-api-access-vckbp\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:17:56.360763 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.357777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmvfw\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-kube-api-access-tmvfw\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.360763 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.357813    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0078c5f7-e675-4c1e-b5d1-ff764834241d-tmp\") pod \"klusterlet-addon-workmgr-76444cff49-hpp8t\" (UID: \"0078c5f7-e675-4c1e-b5d1-ff764834241d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:17:56.360763 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.357858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0078c5f7-e675-4c1e-b5d1-ff764834241d-klusterlet-config\") pod \"klusterlet-addon-workmgr-76444cff49-hpp8t\" (UID: \"0078c5f7-e675-4c1e-b5d1-ff764834241d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:17:56.360763 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.357896    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-425bm\" (UniqueName: \"kubernetes.io/projected/c25ca52e-783f-4c9e-ae13-6abb444e19c6-kube-api-access-425bm\") pod \"ingress-canary-8fncn\" (UID: \"c25ca52e-783f-4c9e-ae13-6abb444e19c6\") " pod="openshift-ingress-canary/ingress-canary-8fncn"
Jul 13 17:17:56.360763 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.357927    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e87f480c-805a-4e46-aa2e-38c08c2c2c05-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bb5894848-8jx27\" (UID: \"e87f480c-805a-4e46-aa2e-38c08c2c2c05\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27"
Jul 13 17:17:56.360763 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.357968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5ec2a65-1853-4cee-a9f8-415e3cd29618-installation-pull-secrets\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.360763 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.357996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5571bd9a-9e0a-4361-af35-c68a2e789240-nginx-conf\") pod \"networking-console-plugin-6cf856758c-lhf7r\" (UID: \"5571bd9a-9e0a-4361-af35-c68a2e789240\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:17:56.360763 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358013    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5ec2a65-1853-4cee-a9f8-415e3cd29618-ca-trust-extracted\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.360763 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358026    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fc7351f8-d77a-4919-acec-3e1f262123b1-hub\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.360763 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5ec2a65-1853-4cee-a9f8-415e3cd29618-image-registry-private-configuration\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.361529 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358127    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:17:56.361529 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358157    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fc7351f8-d77a-4919-acec-3e1f262123b1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.361529 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5ec2a65-1853-4cee-a9f8-415e3cd29618-trusted-ca\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.361529 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-certificates\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.361529 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fc7351f8-d77a-4919-acec-3e1f262123b1-ca\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.361529 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358293    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5099f672-6f0f-4f21-91ec-2141e149b826-config-volume\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:17:56.361529 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-bound-sa-token\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.361529 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358385    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg6vk\" (UniqueName: \"kubernetes.io/projected/e87f480c-805a-4e46-aa2e-38c08c2c2c05-kube-api-access-tg6vk\") pod \"managed-serviceaccount-addon-agent-7bb5894848-8jx27\" (UID: \"e87f480c-805a-4e46-aa2e-38c08c2c2c05\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27"
Jul 13 17:17:56.361529 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358416    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fc7351f8-d77a-4919-acec-3e1f262123b1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.361529 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.361529 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358481    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc7351f8-d77a-4919-acec-3e1f262123b1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.361529 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358514    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs74q\" (UniqueName: \"kubernetes.io/projected/0078c5f7-e675-4c1e-b5d1-ff764834241d-kube-api-access-hs74q\") pod \"klusterlet-addon-workmgr-76444cff49-hpp8t\" (UID: \"0078c5f7-e675-4c1e-b5d1-ff764834241d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:17:56.361529 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c25ca52e-783f-4c9e-ae13-6abb444e19c6-cert\") pod \"ingress-canary-8fncn\" (UID: \"c25ca52e-783f-4c9e-ae13-6abb444e19c6\") " pod="openshift-ingress-canary/ingress-canary-8fncn"
Jul 13 17:17:56.362115 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7n99\" (UniqueName: \"kubernetes.io/projected/fc7351f8-d77a-4919-acec-3e1f262123b1-kube-api-access-g7n99\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.362115 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.358611    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-lhf7r\" (UID: \"5571bd9a-9e0a-4361-af35-c68a2e789240\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:17:56.362115 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.358749    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 17:17:56.362115 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.358813    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert podName:5571bd9a-9e0a-4361-af35-c68a2e789240 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:56.858787996 +0000 UTC m=+37.510910602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-lhf7r" (UID: "5571bd9a-9e0a-4361-af35-c68a2e789240") : secret "networking-console-plugin-cert" not found
Jul 13 17:17:56.362115 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.361007    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:17:56.362115 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.361025    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5857f69948-4rpbc: secret "image-registry-tls" not found
Jul 13 17:17:56.362115 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.361214    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls podName:f5ec2a65-1853-4cee-a9f8-415e3cd29618 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:56.861190935 +0000 UTC m=+37.513313552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls") pod "image-registry-5857f69948-4rpbc" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618") : secret "image-registry-tls" not found
Jul 13 17:17:56.362115 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.361448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0078c5f7-e675-4c1e-b5d1-ff764834241d-tmp\") pod \"klusterlet-addon-workmgr-76444cff49-hpp8t\" (UID: \"0078c5f7-e675-4c1e-b5d1-ff764834241d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:17:56.362115 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.361598    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5571bd9a-9e0a-4361-af35-c68a2e789240-nginx-conf\") pod \"networking-console-plugin-6cf856758c-lhf7r\" (UID: \"5571bd9a-9e0a-4361-af35-c68a2e789240\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:17:56.362115 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.361665    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-certificates\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.362115 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.362048    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5ec2a65-1853-4cee-a9f8-415e3cd29618-trusted-ca\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.363681 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.363660    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5ec2a65-1853-4cee-a9f8-415e3cd29618-image-registry-private-configuration\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.363757 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.363694    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5ec2a65-1853-4cee-a9f8-415e3cd29618-installation-pull-secrets\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.363833 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.363809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0078c5f7-e675-4c1e-b5d1-ff764834241d-klusterlet-config\") pod \"klusterlet-addon-workmgr-76444cff49-hpp8t\" (UID: \"0078c5f7-e675-4c1e-b5d1-ff764834241d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:17:56.391497 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.391471    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-bound-sa-token\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.406147 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.406115    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs74q\" (UniqueName: \"kubernetes.io/projected/0078c5f7-e675-4c1e-b5d1-ff764834241d-kube-api-access-hs74q\") pod \"klusterlet-addon-workmgr-76444cff49-hpp8t\" (UID: \"0078c5f7-e675-4c1e-b5d1-ff764834241d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:17:56.408760 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.408736    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmvfw\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-kube-api-access-tmvfw\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.459287 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.459198    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc7351f8-d77a-4919-acec-3e1f262123b1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.459287 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.459243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c25ca52e-783f-4c9e-ae13-6abb444e19c6-cert\") pod \"ingress-canary-8fncn\" (UID: \"c25ca52e-783f-4c9e-ae13-6abb444e19c6\") " pod="openshift-ingress-canary/ingress-canary-8fncn"
Jul 13 17:17:56.459287 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.459274    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7n99\" (UniqueName: \"kubernetes.io/projected/fc7351f8-d77a-4919-acec-3e1f262123b1-kube-api-access-g7n99\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.459562 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.459315    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5099f672-6f0f-4f21-91ec-2141e149b826-tmp-dir\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:17:56.459562 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.459340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vckbp\" (UniqueName: \"kubernetes.io/projected/5099f672-6f0f-4f21-91ec-2141e149b826-kube-api-access-vckbp\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:17:56.459562 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.459421    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-425bm\" (UniqueName: \"kubernetes.io/projected/c25ca52e-783f-4c9e-ae13-6abb444e19c6-kube-api-access-425bm\") pod \"ingress-canary-8fncn\" (UID: \"c25ca52e-783f-4c9e-ae13-6abb444e19c6\") " pod="openshift-ingress-canary/ingress-canary-8fncn"
Jul 13 17:17:56.459562 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.459447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e87f480c-805a-4e46-aa2e-38c08c2c2c05-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bb5894848-8jx27\" (UID: \"e87f480c-805a-4e46-aa2e-38c08c2c2c05\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27"
Jul 13 17:17:56.459744 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.459649    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fc7351f8-d77a-4919-acec-3e1f262123b1-hub\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.459744 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.459709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:17:56.459744 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.459739    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fc7351f8-d77a-4919-acec-3e1f262123b1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.459890 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.459752    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5099f672-6f0f-4f21-91ec-2141e149b826-tmp-dir\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:17:56.459890 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.459786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fc7351f8-d77a-4919-acec-3e1f262123b1-ca\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.459890 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.459814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5099f672-6f0f-4f21-91ec-2141e149b826-config-volume\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:17:56.459890 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.459844    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg6vk\" (UniqueName: \"kubernetes.io/projected/e87f480c-805a-4e46-aa2e-38c08c2c2c05-kube-api-access-tg6vk\") pod \"managed-serviceaccount-addon-agent-7bb5894848-8jx27\" (UID: \"e87f480c-805a-4e46-aa2e-38c08c2c2c05\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27"
Jul 13 17:17:56.459890 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.459869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fc7351f8-d77a-4919-acec-3e1f262123b1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.460123 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.459846    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:17:56.460123 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.459982    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls podName:5099f672-6f0f-4f21-91ec-2141e149b826 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:56.95996505 +0000 UTC m=+37.612087673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls") pod "dns-default-74f6n" (UID: "5099f672-6f0f-4f21-91ec-2141e149b826") : secret "dns-default-metrics-tls" not found
Jul 13 17:17:56.460123 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.460051    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc7351f8-d77a-4919-acec-3e1f262123b1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.460604 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.460580    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5099f672-6f0f-4f21-91ec-2141e149b826-config-volume\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:17:56.462531 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.462487    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e87f480c-805a-4e46-aa2e-38c08c2c2c05-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7bb5894848-8jx27\" (UID: \"e87f480c-805a-4e46-aa2e-38c08c2c2c05\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27"
Jul 13 17:17:56.462726 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.462708    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/fc7351f8-d77a-4919-acec-3e1f262123b1-ca\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.462937 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.462914    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/fc7351f8-d77a-4919-acec-3e1f262123b1-hub\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.462969 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.462932    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/fc7351f8-d77a-4919-acec-3e1f262123b1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.463066 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.463045    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fc7351f8-d77a-4919-acec-3e1f262123b1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.464176 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.464158    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c25ca52e-783f-4c9e-ae13-6abb444e19c6-cert\") pod \"ingress-canary-8fncn\" (UID: \"c25ca52e-783f-4c9e-ae13-6abb444e19c6\") " pod="openshift-ingress-canary/ingress-canary-8fncn"
Jul 13 17:17:56.476727 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.476701    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vckbp\" (UniqueName: \"kubernetes.io/projected/5099f672-6f0f-4f21-91ec-2141e149b826-kube-api-access-vckbp\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:17:56.482091 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.482071    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7n99\" (UniqueName: \"kubernetes.io/projected/fc7351f8-d77a-4919-acec-3e1f262123b1-kube-api-access-g7n99\") pod \"cluster-proxy-proxy-agent-6df9658544-kgtnr\" (UID: \"fc7351f8-d77a-4919-acec-3e1f262123b1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.489739 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.489713    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg6vk\" (UniqueName: \"kubernetes.io/projected/e87f480c-805a-4e46-aa2e-38c08c2c2c05-kube-api-access-tg6vk\") pod \"managed-serviceaccount-addon-agent-7bb5894848-8jx27\" (UID: \"e87f480c-805a-4e46-aa2e-38c08c2c2c05\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27"
Jul 13 17:17:56.491835 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.491816    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-425bm\" (UniqueName: \"kubernetes.io/projected/c25ca52e-783f-4c9e-ae13-6abb444e19c6-kube-api-access-425bm\") pod \"ingress-canary-8fncn\" (UID: \"c25ca52e-783f-4c9e-ae13-6abb444e19c6\") " pod="openshift-ingress-canary/ingress-canary-8fncn"
Jul 13 17:17:56.497296 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.497274    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:17:56.520104 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.520078    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:17:56.536008 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.535987    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27"
Jul 13 17:17:56.550646 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.550613    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8fncn"
Jul 13 17:17:56.865759 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.864821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:56.865759 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.864884    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-lhf7r\" (UID: \"5571bd9a-9e0a-4361-af35-c68a2e789240\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:17:56.865759 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.865031    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 17:17:56.865759 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.865098    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert podName:5571bd9a-9e0a-4361-af35-c68a2e789240 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:57.86507588 +0000 UTC m=+38.517198484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-lhf7r" (UID: "5571bd9a-9e0a-4361-af35-c68a2e789240") : secret "networking-console-plugin-cert" not found
Jul 13 17:17:56.865759 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.865558    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:17:56.865759 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.865575    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5857f69948-4rpbc: secret "image-registry-tls" not found
Jul 13 17:17:56.865759 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.865629    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls podName:f5ec2a65-1853-4cee-a9f8-415e3cd29618 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:57.865608641 +0000 UTC m=+38.517731249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls") pod "image-registry-5857f69948-4rpbc" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618") : secret "image-registry-tls" not found
Jul 13 17:17:56.965315 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.965290    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:17:56.965526 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.965488    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:17:56.965596 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:56.965576    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls podName:5099f672-6f0f-4f21-91ec-2141e149b826 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:57.965551644 +0000 UTC m=+38.617674266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls") pod "dns-default-74f6n" (UID: "5099f672-6f0f-4f21-91ec-2141e149b826") : secret "dns-default-metrics-tls" not found
Jul 13 17:17:56.993369 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:56.993325    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"]
Jul 13 17:17:56.999624 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:56.999429    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc7351f8_d77a_4919_acec_3e1f262123b1.slice/crio-c8994ad17af36b6884baff08ea1c6061d0fca86086330644b5d28e500b47c1ce WatchSource:0}: Error finding container c8994ad17af36b6884baff08ea1c6061d0fca86086330644b5d28e500b47c1ce: Status 404 returned error can't find the container with id c8994ad17af36b6884baff08ea1c6061d0fca86086330644b5d28e500b47c1ce
Jul 13 17:17:57.001067 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:57.001037    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8fncn"]
Jul 13 17:17:57.004669 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:57.004519    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc25ca52e_783f_4c9e_ae13_6abb444e19c6.slice/crio-7614ae3aca5e1a9c4d539b2c4713babe5d445accb922dd2a90f41bb4da9508c2 WatchSource:0}: Error finding container 7614ae3aca5e1a9c4d539b2c4713babe5d445accb922dd2a90f41bb4da9508c2: Status 404 returned error can't find the container with id 7614ae3aca5e1a9c4d539b2c4713babe5d445accb922dd2a90f41bb4da9508c2
Jul 13 17:17:57.006086 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:57.006051    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27"]
Jul 13 17:17:57.007000 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:57.006976    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"]
Jul 13 17:17:57.011267 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:57.011242    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0078c5f7_e675_4c1e_b5d1_ff764834241d.slice/crio-30dca481983ab6aff865a56300de7bedc2d3c03b87c23979919e0858e65647a5 WatchSource:0}: Error finding container 30dca481983ab6aff865a56300de7bedc2d3c03b87c23979919e0858e65647a5: Status 404 returned error can't find the container with id 30dca481983ab6aff865a56300de7bedc2d3c03b87c23979919e0858e65647a5
Jul 13 17:17:57.011840 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:17:57.011819    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode87f480c_805a_4e46_aa2e_38c08c2c2c05.slice/crio-af4b89e53873f7ca339a9e1ff74c47c308b41271cd631f85bfd4bc4e0e05af36 WatchSource:0}: Error finding container af4b89e53873f7ca339a9e1ff74c47c308b41271cd631f85bfd4bc4e0e05af36: Status 404 returned error can't find the container with id af4b89e53873f7ca339a9e1ff74c47c308b41271cd631f85bfd4bc4e0e05af36
Jul 13 17:17:57.267605 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:57.267571    2579 generic.go:356] "Generic (PLEG): container finished" podID="be5b5dde-24ca-4827-a78e-b178518d45cd" containerID="deb3f98fddeb5943997c8c48aa1956fbb540e4b7e3e58aa6b52070006cadf7bc" exitCode=0
Jul 13 17:17:57.268375 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:57.267637    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mg8xv" event={"ID":"be5b5dde-24ca-4827-a78e-b178518d45cd","Type":"ContainerDied","Data":"deb3f98fddeb5943997c8c48aa1956fbb540e4b7e3e58aa6b52070006cadf7bc"}
Jul 13 17:17:57.268786 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:57.268763    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t" event={"ID":"0078c5f7-e675-4c1e-b5d1-ff764834241d","Type":"ContainerStarted","Data":"30dca481983ab6aff865a56300de7bedc2d3c03b87c23979919e0858e65647a5"}
Jul 13 17:17:57.269916 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:57.269890    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr" event={"ID":"fc7351f8-d77a-4919-acec-3e1f262123b1","Type":"ContainerStarted","Data":"c8994ad17af36b6884baff08ea1c6061d0fca86086330644b5d28e500b47c1ce"}
Jul 13 17:17:57.270989 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:57.270967    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27" event={"ID":"e87f480c-805a-4e46-aa2e-38c08c2c2c05","Type":"ContainerStarted","Data":"af4b89e53873f7ca339a9e1ff74c47c308b41271cd631f85bfd4bc4e0e05af36"}
Jul 13 17:17:57.272007 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:57.271989    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8fncn" event={"ID":"c25ca52e-783f-4c9e-ae13-6abb444e19c6","Type":"ContainerStarted","Data":"7614ae3aca5e1a9c4d539b2c4713babe5d445accb922dd2a90f41bb4da9508c2"}
Jul 13 17:17:57.872638 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:57.871945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-lhf7r\" (UID: \"5571bd9a-9e0a-4361-af35-c68a2e789240\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:17:57.872638 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:57.872080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:57.872638 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:57.872220    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:17:57.872638 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:57.872236    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5857f69948-4rpbc: secret "image-registry-tls" not found
Jul 13 17:17:57.872638 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:57.872293    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls podName:f5ec2a65-1853-4cee-a9f8-415e3cd29618 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:59.872274926 +0000 UTC m=+40.524397543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls") pod "image-registry-5857f69948-4rpbc" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618") : secret "image-registry-tls" not found
Jul 13 17:17:57.873256 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:57.872848    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 17:17:57.873256 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:57.873013    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert podName:5571bd9a-9e0a-4361-af35-c68a2e789240 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:59.872994565 +0000 UTC m=+40.525117173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-lhf7r" (UID: "5571bd9a-9e0a-4361-af35-c68a2e789240") : secret "networking-console-plugin-cert" not found
Jul 13 17:17:57.973563 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:57.973524    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:17:57.973799 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:57.973781    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:17:57.973878 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:57.973848    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls podName:5099f672-6f0f-4f21-91ec-2141e149b826 nodeName:}" failed. No retries permitted until 2026-07-13 17:17:59.973830866 +0000 UTC m=+40.625953471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls") pod "dns-default-74f6n" (UID: "5099f672-6f0f-4f21-91ec-2141e149b826") : secret "dns-default-metrics-tls" not found
Jul 13 17:17:58.066558 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:58.066527    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:17:58.067293 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:58.067275    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:17:58.068065 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:58.068033    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:17:58.076831 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:58.076807    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 17:17:58.077052 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:58.077035    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 17:17:58.077724 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:58.077205    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 17:17:58.077724 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:58.077299    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-56qtx\""
Jul 13 17:17:58.077724 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:58.077623    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gkqtt\""
Jul 13 17:17:58.077898 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:58.077810    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 17:17:58.295788 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:58.294790    2579 generic.go:356] "Generic (PLEG): container finished" podID="be5b5dde-24ca-4827-a78e-b178518d45cd" containerID="47a8c908d4c4f7d6d765c1ec6e55719a0a1ee03f8391cf6c01283a88dbf75be8" exitCode=0
Jul 13 17:17:58.295788 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:58.294838    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mg8xv" event={"ID":"be5b5dde-24ca-4827-a78e-b178518d45cd","Type":"ContainerDied","Data":"47a8c908d4c4f7d6d765c1ec6e55719a0a1ee03f8391cf6c01283a88dbf75be8"}
Jul 13 17:17:58.396896 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:58.396826    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:58.583270 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:58.583084    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:59.304446 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:59.303623    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mg8xv" event={"ID":"be5b5dde-24ca-4827-a78e-b178518d45cd","Type":"ContainerStarted","Data":"6c5d61276ab924696134e898dcda4517b152a22495aebc976e4f10bf8fea59d5"}
Jul 13 17:17:59.345126 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:59.344635    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mg8xv" podStartSLOduration=14.109341592 podStartE2EDuration="39.344564062s" totalImagesPullingTime="25.23522247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:17:59.343964159 +0000 UTC m=+39.996086790" watchObservedRunningTime="2026-07-13 17:17:59.344564062 +0000 UTC m=+39.996686689"
Jul 13 17:17:59.531238 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:59.531132    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:59.661889 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:59.661810    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:17:59.889257 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:59.888971    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:17:59.889257 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:59.889031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-lhf7r\" (UID: \"5571bd9a-9e0a-4361-af35-c68a2e789240\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:17:59.889257 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:59.889156    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:17:59.889257 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:59.889178    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5857f69948-4rpbc: secret "image-registry-tls" not found
Jul 13 17:17:59.889257 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:59.889188    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 17:17:59.889257 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:59.889242    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls podName:f5ec2a65-1853-4cee-a9f8-415e3cd29618 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:03.889220484 +0000 UTC m=+44.541343108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls") pod "image-registry-5857f69948-4rpbc" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618") : secret "image-registry-tls" not found
Jul 13 17:17:59.889257 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:59.889261    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert podName:5571bd9a-9e0a-4361-af35-c68a2e789240 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:03.889251459 +0000 UTC m=+44.541374066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-lhf7r" (UID: "5571bd9a-9e0a-4361-af35-c68a2e789240") : secret "networking-console-plugin-cert" not found
Jul 13 17:17:59.989868 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:17:59.989777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:17:59.990031 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:59.989952    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:17:59.990107 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:17:59.990088    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls podName:5099f672-6f0f-4f21-91ec-2141e149b826 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:03.989998411 +0000 UTC m=+44.642121017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls") pod "dns-default-74f6n" (UID: "5099f672-6f0f-4f21-91ec-2141e149b826") : secret "dns-default-metrics-tls" not found
Jul 13 17:18:03.924849 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:03.924805    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:18:03.925324 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:03.924856    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-lhf7r\" (UID: \"5571bd9a-9e0a-4361-af35-c68a2e789240\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:18:03.925324 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:03.924954    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 17:18:03.925324 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:03.924958    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:18:03.925324 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:03.924973    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5857f69948-4rpbc: secret "image-registry-tls" not found
Jul 13 17:18:03.925324 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:03.925020    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert podName:5571bd9a-9e0a-4361-af35-c68a2e789240 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:11.925001895 +0000 UTC m=+52.577124498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-lhf7r" (UID: "5571bd9a-9e0a-4361-af35-c68a2e789240") : secret "networking-console-plugin-cert" not found
Jul 13 17:18:03.925324 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:03.925039    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls podName:f5ec2a65-1853-4cee-a9f8-415e3cd29618 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:11.925030536 +0000 UTC m=+52.577153141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls") pod "image-registry-5857f69948-4rpbc" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618") : secret "image-registry-tls" not found
Jul 13 17:18:04.025263 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:04.025223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:18:04.025471 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:04.025378    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:18:04.025471 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:04.025442    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls podName:5099f672-6f0f-4f21-91ec-2141e149b826 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:12.025425013 +0000 UTC m=+52.677547616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls") pod "dns-default-74f6n" (UID: "5099f672-6f0f-4f21-91ec-2141e149b826") : secret "dns-default-metrics-tls" not found
Jul 13 17:18:04.929568 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:04.929507    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:05.139390 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:05.139197    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:05.322805 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:05.322370    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t" event={"ID":"0078c5f7-e675-4c1e-b5d1-ff764834241d","Type":"ContainerStarted","Data":"216eb92a58a934cad2688e4d6c0c8fcf20f0878ac8e0138ee67866d5dd41df24"}
Jul 13 17:18:05.322805 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:05.322590    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:18:05.324690 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:05.324664    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:18:05.326118 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:05.326096    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr" event={"ID":"fc7351f8-d77a-4919-acec-3e1f262123b1","Type":"ContainerStarted","Data":"f4af54550d0893f64b247f4a5a9a307a11c61b5ab695341b1dbba28a8a67f7b1"}
Jul 13 17:18:05.326228 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:05.326127    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr" event={"ID":"fc7351f8-d77a-4919-acec-3e1f262123b1","Type":"ContainerStarted","Data":"795efd23c41ec0f142ae43453bd370fc83b0c16b5f67c3c06c7d9a0f158eda23"}
Jul 13 17:18:05.326228 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:05.326144    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr" event={"ID":"fc7351f8-d77a-4919-acec-3e1f262123b1","Type":"ContainerStarted","Data":"b1899bc10a63f849d7f82809494fa434cec027877c673faabb173f07a3e61087"}
Jul 13 17:18:05.327827 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:05.327802    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27" event={"ID":"e87f480c-805a-4e46-aa2e-38c08c2c2c05","Type":"ContainerStarted","Data":"e29a5ffb72419a00aa535e7338409f9ab4d0f20f2f3560f5982ee773459b95cf"}
Jul 13 17:18:05.329303 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:05.329279    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8fncn" event={"ID":"c25ca52e-783f-4c9e-ae13-6abb444e19c6","Type":"ContainerStarted","Data":"902fcd2c8e35f78992c45d21f8700c8282ccd3ce72ef703632c8ddc7722b0252"}
Jul 13 17:18:05.352766 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:05.352718    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t" podStartSLOduration=19.383676231 podStartE2EDuration="27.352703704s" totalImagesPullingTime="7.969027473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:05.352459121 +0000 UTC m=+46.004581747" watchObservedRunningTime="2026-07-13 17:18:05.352703704 +0000 UTC m=+46.004826307"
Jul 13 17:18:05.404704 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:05.404674    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:05.426881 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:05.426833    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27" podStartSLOduration=19.458277179 podStartE2EDuration="27.426818498s" totalImagesPullingTime="7.968541319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:05.426732559 +0000 UTC m=+46.078855185" watchObservedRunningTime="2026-07-13 17:18:05.426818498 +0000 UTC m=+46.078941123"
Jul 13 17:18:05.478188 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:05.478135    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8fncn" podStartSLOduration=1.495819038 podStartE2EDuration="9.478119601s" totalImagesPullingTime="7.982300563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:05.477478162 +0000 UTC m=+46.129600787" watchObservedRunningTime="2026-07-13 17:18:05.478119601 +0000 UTC m=+46.130242204"
Jul 13 17:18:05.616462 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:05.616423    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:05.897398 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:05.897283    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:06.027595 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:06.027564    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:06.378574 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:06.378520    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr" podStartSLOduration=20.398555975 podStartE2EDuration="28.378502144s" totalImagesPullingTime="7.979946169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:06.377489419 +0000 UTC m=+47.029612045" watchObservedRunningTime="2026-07-13 17:18:06.378502144 +0000 UTC m=+47.030624769"
Jul 13 17:18:06.854664 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:06.854576    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:06.972314 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:06.972273    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:07.732603 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:07.732566    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:09.058823 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:09.058784    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:09.179842 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:09.179805    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:09.952063 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:09.952004    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:11.989289 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:11.989197    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:18:11.989289 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:11.989246    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-lhf7r\" (UID: \"5571bd9a-9e0a-4361-af35-c68a2e789240\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:18:11.989718 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:11.989384    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 17:18:11.989718 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:11.989388    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:18:11.989718 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:11.989408    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5857f69948-4rpbc: secret "image-registry-tls" not found
Jul 13 17:18:11.989718 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:11.989454    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert podName:5571bd9a-9e0a-4361-af35-c68a2e789240 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:27.989435002 +0000 UTC m=+68.641557605 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-lhf7r" (UID: "5571bd9a-9e0a-4361-af35-c68a2e789240") : secret "networking-console-plugin-cert" not found
Jul 13 17:18:11.989718 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:11.989468    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls podName:f5ec2a65-1853-4cee-a9f8-415e3cd29618 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:27.989462536 +0000 UTC m=+68.641585139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls") pod "image-registry-5857f69948-4rpbc" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618") : secret "image-registry-tls" not found
Jul 13 17:18:12.089850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:12.089815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:18:12.089999 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:12.089915    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:18:12.089999 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:12.089966    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls podName:5099f672-6f0f-4f21-91ec-2141e149b826 nodeName:}" failed. No retries permitted until 2026-07-13 17:18:28.089951719 +0000 UTC m=+68.742074322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls") pod "dns-default-74f6n" (UID: "5099f672-6f0f-4f21-91ec-2141e149b826") : secret "dns-default-metrics-tls" not found
Jul 13 17:18:17.494856 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:17.494816    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:17.643730 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:17.643698    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:18.722920 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:18.722881    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:18.827859 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:18.827826    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:21.425425 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:21.425380    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:21.504927 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:21.504894    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:22.075009 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:22.074976    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:22.195308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:22.195274    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:22.295749 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:22.295719    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:22.637476 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:22.637439    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:22.818902 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:22.818874    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:23.069303 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:23.069210    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:23.255594 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:23.255558    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:23.264106 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:23.264085    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tt87"
Jul 13 17:18:24.197982 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:24.197946    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:24.318915 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:24.318887    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:27.007994 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.007957    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:18:27.008511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.008025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:18:27.012669 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.012647    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 17:18:27.012844 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.012687    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 17:18:27.019168 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:27.019153    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 17:18:27.019241 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:27.019232    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs podName:5cf84bf3-8941-43b9-b255-3b74ceb51b71 nodeName:}" failed. No retries permitted until 2026-07-13 17:19:31.0192161 +0000 UTC m=+131.671338704 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs") pod "network-metrics-daemon-h26bb" (UID: "5cf84bf3-8941-43b9-b255-3b74ceb51b71") : secret "metrics-daemon-secret" not found
Jul 13 17:18:27.023115 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.023097    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/68c215bc-8805-4045-bfc2-16b86752c850-original-pull-secret\") pod \"global-pull-secret-syncer-5n7fg\" (UID: \"68c215bc-8805-4045-bfc2-16b86752c850\") " pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:18:27.108915 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.108878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzmv4\" (UniqueName: \"kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4\") pod \"network-check-target-m9fqx\" (UID: \"403ea272-31db-42da-b356-9fb9a9aca3a6\") " pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:18:27.111643 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.111625    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 17:18:27.121981 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.121964    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 17:18:27.132135 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.132105    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzmv4\" (UniqueName: \"kubernetes.io/projected/403ea272-31db-42da-b356-9fb9a9aca3a6-kube-api-access-wzmv4\") pod \"network-check-target-m9fqx\" (UID: \"403ea272-31db-42da-b356-9fb9a9aca3a6\") " pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:18:27.185279 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.185244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n7fg"
Jul 13 17:18:27.208688 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.208663    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-56qtx\""
Jul 13 17:18:27.216936 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.216914    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:18:27.339141 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.339120    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5n7fg"]
Jul 13 17:18:27.340535 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:18:27.340508    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c215bc_8805_4045_bfc2_16b86752c850.slice/crio-78d218ff92f7624bb09e035cf9893ae8b52b921d9c0a3509386b1304f94af0ce WatchSource:0}: Error finding container 78d218ff92f7624bb09e035cf9893ae8b52b921d9c0a3509386b1304f94af0ce: Status 404 returned error can't find the container with id 78d218ff92f7624bb09e035cf9893ae8b52b921d9c0a3509386b1304f94af0ce
Jul 13 17:18:27.365786 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.365759    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m9fqx"]
Jul 13 17:18:27.369105 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:18:27.369081    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod403ea272_31db_42da_b356_9fb9a9aca3a6.slice/crio-98eae0effe02c95d22c4fd6f5b7c2509e41902abfd1b35a90ed7910a6f1def07 WatchSource:0}: Error finding container 98eae0effe02c95d22c4fd6f5b7c2509e41902abfd1b35a90ed7910a6f1def07: Status 404 returned error can't find the container with id 98eae0effe02c95d22c4fd6f5b7c2509e41902abfd1b35a90ed7910a6f1def07
Jul 13 17:18:27.394624 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.394599    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m9fqx" event={"ID":"403ea272-31db-42da-b356-9fb9a9aca3a6","Type":"ContainerStarted","Data":"98eae0effe02c95d22c4fd6f5b7c2509e41902abfd1b35a90ed7910a6f1def07"}
Jul 13 17:18:27.395551 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:27.395530    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5n7fg" event={"ID":"68c215bc-8805-4045-bfc2-16b86752c850","Type":"ContainerStarted","Data":"78d218ff92f7624bb09e035cf9893ae8b52b921d9c0a3509386b1304f94af0ce"}
Jul 13 17:18:28.016160 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:28.016120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-lhf7r\" (UID: \"5571bd9a-9e0a-4361-af35-c68a2e789240\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:18:28.016583 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:28.016200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:18:28.016583 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:28.016274    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 17:18:28.016583 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:28.016278    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:18:28.016583 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:28.016374    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5857f69948-4rpbc: secret "image-registry-tls" not found
Jul 13 17:18:28.016583 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:28.016377    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert podName:5571bd9a-9e0a-4361-af35-c68a2e789240 nodeName:}" failed. No retries permitted until 2026-07-13 17:19:00.016329928 +0000 UTC m=+100.668452531 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-lhf7r" (UID: "5571bd9a-9e0a-4361-af35-c68a2e789240") : secret "networking-console-plugin-cert" not found
Jul 13 17:18:28.016583 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:28.016414    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls podName:f5ec2a65-1853-4cee-a9f8-415e3cd29618 nodeName:}" failed. No retries permitted until 2026-07-13 17:19:00.016402017 +0000 UTC m=+100.668524620 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls") pod "image-registry-5857f69948-4rpbc" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618") : secret "image-registry-tls" not found
Jul 13 17:18:28.116950 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:28.116914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:18:28.117095 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:28.117063    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:18:28.117148 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:18:28.117127    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls podName:5099f672-6f0f-4f21-91ec-2141e149b826 nodeName:}" failed. No retries permitted until 2026-07-13 17:19:00.117111357 +0000 UTC m=+100.769233960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls") pod "dns-default-74f6n" (UID: "5099f672-6f0f-4f21-91ec-2141e149b826") : secret "dns-default-metrics-tls" not found
Jul 13 17:18:33.415766 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:33.415731    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m9fqx" event={"ID":"403ea272-31db-42da-b356-9fb9a9aca3a6","Type":"ContainerStarted","Data":"aa86297fbf5af569fe924bbfe661610ee3ffb529dda6bbce395212d0f9836047"}
Jul 13 17:18:33.416245 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:33.415850    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:18:33.417284 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:33.417264    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5n7fg" event={"ID":"68c215bc-8805-4045-bfc2-16b86752c850","Type":"ContainerStarted","Data":"d95f37279d2b20d5165b1b8d4f8e1f72346eda70795a463d964f1b66021de11b"}
Jul 13 17:18:33.476690 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:33.476639    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5n7fg" podStartSLOduration=68.407278039 podStartE2EDuration="1m13.476622015s" totalImagesPullingTime="5.069343976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:33.476603556 +0000 UTC m=+74.128726180" watchObservedRunningTime="2026-07-13 17:18:33.476622015 +0000 UTC m=+74.128744639"
Jul 13 17:18:33.476831 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:33.476747    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m9fqx" podStartSLOduration=68.440174067 podStartE2EDuration="1m13.476742539s" totalImagesPullingTime="5.036568472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:18:33.446691762 +0000 UTC m=+74.098814384" watchObservedRunningTime="2026-07-13 17:18:33.476742539 +0000 UTC m=+74.128865163"
Jul 13 17:18:43.305737 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:43.305692    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:18:43.448664 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:18:43.448620    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:00.065616 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:19:00.065576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:19:00.065616 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:19:00.065617    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-lhf7r\" (UID: \"5571bd9a-9e0a-4361-af35-c68a2e789240\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:19:00.066184 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:19:00.065713    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 17:19:00.066184 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:19:00.065719    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:19:00.066184 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:19:00.065735    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5857f69948-4rpbc: secret "image-registry-tls" not found
Jul 13 17:19:00.066184 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:19:00.065768    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert podName:5571bd9a-9e0a-4361-af35-c68a2e789240 nodeName:}" failed. No retries permitted until 2026-07-13 17:20:04.065755301 +0000 UTC m=+164.717877905 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-lhf7r" (UID: "5571bd9a-9e0a-4361-af35-c68a2e789240") : secret "networking-console-plugin-cert" not found
Jul 13 17:19:00.066184 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:19:00.065787    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls podName:f5ec2a65-1853-4cee-a9f8-415e3cd29618 nodeName:}" failed. No retries permitted until 2026-07-13 17:20:04.065774213 +0000 UTC m=+164.717896821 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls") pod "image-registry-5857f69948-4rpbc" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618") : secret "image-registry-tls" not found
Jul 13 17:19:00.166578 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:19:00.166537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:19:00.166747 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:19:00.166706    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:19:00.166787 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:19:00.166763    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls podName:5099f672-6f0f-4f21-91ec-2141e149b826 nodeName:}" failed. No retries permitted until 2026-07-13 17:20:04.16674847 +0000 UTC m=+164.818871074 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls") pod "dns-default-74f6n" (UID: "5099f672-6f0f-4f21-91ec-2141e149b826") : secret "dns-default-metrics-tls" not found
Jul 13 17:19:04.421911 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:19:04.421879    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m9fqx"
Jul 13 17:19:31.089214 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:19:31.089167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:19:31.089729 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:19:31.089322    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 17:19:31.089729 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:19:31.089418    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs podName:5cf84bf3-8941-43b9-b255-3b74ceb51b71 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:33.089400465 +0000 UTC m=+253.741523068 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs") pod "network-metrics-daemon-h26bb" (UID: "5cf84bf3-8941-43b9-b255-3b74ceb51b71") : secret "metrics-daemon-secret" not found
Jul 13 17:19:56.530388 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:19:56.530335    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:19:59.189993 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:19:59.189933    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5857f69948-4rpbc" podUID="f5ec2a65-1853-4cee-a9f8-415e3cd29618"
Jul 13 17:19:59.204504 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:19:59.204474    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r" podUID="5571bd9a-9e0a-4361-af35-c68a2e789240"
Jul 13 17:19:59.243775 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:19:59.243731    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-74f6n" podUID="5099f672-6f0f-4f21-91ec-2141e149b826"
Jul 13 17:19:59.650099 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:19:59.650066    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-74f6n"
Jul 13 17:19:59.650258 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:19:59.650069    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:19:59.650258 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:19:59.650069    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:20:01.099390 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:20:01.099329    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:20:04.141310 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:04.141261    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:20:04.141310 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:04.141319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-lhf7r\" (UID: \"5571bd9a-9e0a-4361-af35-c68a2e789240\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:20:04.141824 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:20:04.141447    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 17:20:04.141824 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:20:04.141448    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:20:04.141824 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:20:04.141473    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5857f69948-4rpbc: secret "image-registry-tls" not found
Jul 13 17:20:04.141824 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:20:04.141518    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert podName:5571bd9a-9e0a-4361-af35-c68a2e789240 nodeName:}" failed. No retries permitted until 2026-07-13 17:22:06.141502149 +0000 UTC m=+286.793624752 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-lhf7r" (UID: "5571bd9a-9e0a-4361-af35-c68a2e789240") : secret "networking-console-plugin-cert" not found
Jul 13 17:20:04.141824 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:20:04.141531    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls podName:f5ec2a65-1853-4cee-a9f8-415e3cd29618 nodeName:}" failed. No retries permitted until 2026-07-13 17:22:06.141524856 +0000 UTC m=+286.793647459 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls") pod "image-registry-5857f69948-4rpbc" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618") : secret "image-registry-tls" not found
Jul 13 17:20:04.241811 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:04.241767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:20:04.241992 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:20:04.241931    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:20:04.242038 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:20:04.241996    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls podName:5099f672-6f0f-4f21-91ec-2141e149b826 nodeName:}" failed. No retries permitted until 2026-07-13 17:22:06.241980005 +0000 UTC m=+286.894102615 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls") pod "dns-default-74f6n" (UID: "5099f672-6f0f-4f21-91ec-2141e149b826") : secret "dns-default-metrics-tls" not found
Jul 13 17:20:05.323305 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:05.323251    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t" podUID="0078c5f7-e675-4c1e-b5d1-ff764834241d" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/readyz\": dial tcp 10.132.0.7:8000: connect: connection refused"
Jul 13 17:20:05.667408 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:05.667377    2579 generic.go:356] "Generic (PLEG): container finished" podID="e87f480c-805a-4e46-aa2e-38c08c2c2c05" containerID="e29a5ffb72419a00aa535e7338409f9ab4d0f20f2f3560f5982ee773459b95cf" exitCode=255
Jul 13 17:20:05.667594 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:05.667465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27" event={"ID":"e87f480c-805a-4e46-aa2e-38c08c2c2c05","Type":"ContainerDied","Data":"e29a5ffb72419a00aa535e7338409f9ab4d0f20f2f3560f5982ee773459b95cf"}
Jul 13 17:20:05.667835 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:05.667814    2579 scope.go:117] "RemoveContainer" containerID="e29a5ffb72419a00aa535e7338409f9ab4d0f20f2f3560f5982ee773459b95cf"
Jul 13 17:20:05.668949 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:05.668926    2579 generic.go:356] "Generic (PLEG): container finished" podID="0078c5f7-e675-4c1e-b5d1-ff764834241d" containerID="216eb92a58a934cad2688e4d6c0c8fcf20f0878ac8e0138ee67866d5dd41df24" exitCode=1
Jul 13 17:20:05.669053 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:05.668954    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t" event={"ID":"0078c5f7-e675-4c1e-b5d1-ff764834241d","Type":"ContainerDied","Data":"216eb92a58a934cad2688e4d6c0c8fcf20f0878ac8e0138ee67866d5dd41df24"}
Jul 13 17:20:05.669239 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:05.669225    2579 scope.go:117] "RemoveContainer" containerID="216eb92a58a934cad2688e4d6c0c8fcf20f0878ac8e0138ee67866d5dd41df24"
Jul 13 17:20:06.497906 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:06.497867    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:20:06.536944 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:06.536903    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27"
Jul 13 17:20:06.673694 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:06.673657    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27" event={"ID":"e87f480c-805a-4e46-aa2e-38c08c2c2c05","Type":"ContainerStarted","Data":"7796b0318f2a80f32829cacd1655f699ff792c8b7e01990820b7c45e2ba97e14"}
Jul 13 17:20:06.675244 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:06.675223    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t" event={"ID":"0078c5f7-e675-4c1e-b5d1-ff764834241d","Type":"ContainerStarted","Data":"feaa8ffd9ce33bd008da3af77781bce3474cbe800454c6ea669145a542cb1bb0"}
Jul 13 17:20:06.675393 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:06.675378    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:20:06.676361 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:06.676331    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:20:14.064821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:14.064736    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:20:57.504647 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:20:57.504599    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:25.168433 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:25.168396    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:25.269180 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:25.269150    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:27.376826 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:27.376779    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:28.861520 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:28.861486    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qq2qh"]
Jul 13 17:21:28.863544 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:28.863523    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:28.868894 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:28.868865    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 17:21:28.869971 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:28.869952    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m4nm5\""
Jul 13 17:21:28.870079 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:28.869986    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 17:21:28.870079 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:28.869993    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 17:21:28.870079 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:28.869991    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 17:21:28.887081 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:28.887053    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qq2qh"]
Jul 13 17:21:28.912232 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:28.912189    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:28.975581 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:28.975544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph5cs\" (UniqueName: \"kubernetes.io/projected/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-api-access-ph5cs\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:28.975581 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:28.975591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b0248ec-0182-46f2-8dc8-52ce1e757c81-crio-socket\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:28.975806 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:28.975609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:28.975806 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:28.975634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:28.975806 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:28.975732    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b0248ec-0182-46f2-8dc8-52ce1e757c81-data-volume\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:29.016624 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:29.016579    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:29.076210 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:29.076177    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b0248ec-0182-46f2-8dc8-52ce1e757c81-data-volume\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:29.076377 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:29.076237    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph5cs\" (UniqueName: \"kubernetes.io/projected/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-api-access-ph5cs\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:29.076377 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:29.076263    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b0248ec-0182-46f2-8dc8-52ce1e757c81-crio-socket\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:29.076377 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:29.076281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:29.076377 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:29.076303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:29.076550 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:29.076398    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 17:21:29.076550 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:29.076407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b0248ec-0182-46f2-8dc8-52ce1e757c81-crio-socket\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:29.076550 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:29.076440    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:29.076550 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:29.076468    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm podName:6b0248ec-0182-46f2-8dc8-52ce1e757c81 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:29.57645008 +0000 UTC m=+250.228572704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qq2qh" (UID: "6b0248ec-0182-46f2-8dc8-52ce1e757c81") : configmap "kube-rbac-proxy" not found
Jul 13 17:21:29.076550 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:29.076511    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls podName:6b0248ec-0182-46f2-8dc8-52ce1e757c81 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:29.576492398 +0000 UTC m=+250.228615007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qq2qh" (UID: "6b0248ec-0182-46f2-8dc8-52ce1e757c81") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:29.076744 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:29.076591    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b0248ec-0182-46f2-8dc8-52ce1e757c81-data-volume\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:29.085161 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:29.085138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph5cs\" (UniqueName: \"kubernetes.io/projected/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-api-access-ph5cs\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:29.580143 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:29.580109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:29.580375 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:29.580160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:29.580375 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:29.580247    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 17:21:29.580375 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:29.580261    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:29.580375 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:29.580313    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm podName:6b0248ec-0182-46f2-8dc8-52ce1e757c81 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:30.580295504 +0000 UTC m=+251.232418123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qq2qh" (UID: "6b0248ec-0182-46f2-8dc8-52ce1e757c81") : configmap "kube-rbac-proxy" not found
Jul 13 17:21:29.580375 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:29.580331    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls podName:6b0248ec-0182-46f2-8dc8-52ce1e757c81 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:30.580322297 +0000 UTC m=+251.232444900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qq2qh" (UID: "6b0248ec-0182-46f2-8dc8-52ce1e757c81") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:29.683428 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:29.683387    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:29.748957 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:29.748914    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:29.928241 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:29.928186    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:30.025250 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:30.025208    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:30.126022 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:30.125989    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:30.364900 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:30.364870    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:30.465082 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:30.465006    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:30.589163 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:30.589128    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:30.589163 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:30.589170    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:30.589385 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:30.589291    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:30.589385 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:30.589371    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 17:21:30.589459 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:30.589386    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls podName:6b0248ec-0182-46f2-8dc8-52ce1e757c81 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:32.589369686 +0000 UTC m=+253.241492293 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qq2qh" (UID: "6b0248ec-0182-46f2-8dc8-52ce1e757c81") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:30.589459 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:30.589433    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm podName:6b0248ec-0182-46f2-8dc8-52ce1e757c81 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:32.589421214 +0000 UTC m=+253.241543818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qq2qh" (UID: "6b0248ec-0182-46f2-8dc8-52ce1e757c81") : configmap "kube-rbac-proxy" not found
Jul 13 17:21:31.023630 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:31.023604    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x4xxd_36370993-71ea-41fa-89c7-743d6ff32ee5/dns-node-resolver/0.log"
Jul 13 17:21:31.822897 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:31.822865    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jgf4v_db0bf4bc-76e1-40ca-9d7f-8bd50243db39/node-ca/0.log"
Jul 13 17:21:31.993604 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:31.993568    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:32.060153 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:32.060105    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:32.394028 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:32.393991    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:32.503862 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:32.503824    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:32.603659 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:32.603620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:32.603659 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:32.603663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:32.603872 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:32.603729    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 17:21:32.603872 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:32.603770    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:32.603872 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:32.603804    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm podName:6b0248ec-0182-46f2-8dc8-52ce1e757c81 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:36.603790325 +0000 UTC m=+257.255912928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qq2qh" (UID: "6b0248ec-0182-46f2-8dc8-52ce1e757c81") : configmap "kube-rbac-proxy" not found
Jul 13 17:21:32.603872 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:32.603842    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls podName:6b0248ec-0182-46f2-8dc8-52ce1e757c81 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:36.603824723 +0000 UTC m=+257.255947328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qq2qh" (UID: "6b0248ec-0182-46f2-8dc8-52ce1e757c81") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:32.627187 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:32.627158    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8fncn_c25ca52e-783f-4c9e-ae13-6abb444e19c6/serve-healthcheck-canary/0.log"
Jul 13 17:21:33.108227 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:33.108190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:21:33.108723 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:33.108375    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 17:21:33.108723 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:33.108452    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs podName:5cf84bf3-8941-43b9-b255-3b74ceb51b71 nodeName:}" failed. No retries permitted until 2026-07-13 17:23:35.108432534 +0000 UTC m=+375.760555152 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs") pod "network-metrics-daemon-h26bb" (UID: "5cf84bf3-8941-43b9-b255-3b74ceb51b71") : secret "metrics-daemon-secret" not found
Jul 13 17:21:33.109365 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:33.109329    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:34.202019 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:34.201981    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:34.302248 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:34.302213    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:34.384597 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:34.384566    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:34.517039 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:34.516959    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:34.621996 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:34.621968    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:34.721890 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:34.721858    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:35.099803 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:35.099769    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:36.271938 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:36.271903    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:36.349693 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:36.349662    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:36.550084 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:36.550003    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:36.636938 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:36.636904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:36.636938 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:36.636941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:36.637129 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:36.637048    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:36.637129 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:36.637109    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls podName:6b0248ec-0182-46f2-8dc8-52ce1e757c81 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:44.63709344 +0000 UTC m=+265.289216043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qq2qh" (UID: "6b0248ec-0182-46f2-8dc8-52ce1e757c81") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:21:36.637206 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:36.637047    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 17:21:36.637206 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:21:36.637181    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm podName:6b0248ec-0182-46f2-8dc8-52ce1e757c81 nodeName:}" failed. No retries permitted until 2026-07-13 17:21:44.637169807 +0000 UTC m=+265.289292410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qq2qh" (UID: "6b0248ec-0182-46f2-8dc8-52ce1e757c81") : configmap "kube-rbac-proxy" not found
Jul 13 17:21:36.702979 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:36.702935    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:36.900120 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:36.900082    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:37.102400 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:37.102362    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:37.299458 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:37.299367    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:38.088535 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:38.088503    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:38.189750 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:38.189718    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:38.503186 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:38.503151    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:38.728228 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:38.728194    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:38.891714 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:38.891677    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:39.088849 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:39.088815    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:39.295866 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:39.295765    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:40.288842 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:40.288808    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:40.694979 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:40.694948    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:40.795405 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:40.795371    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:40.897138 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:40.897107    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:41.092570 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:41.092487    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:41.290487 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:41.290451    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:42.038789 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:42.038734    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:42.140872 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:42.140790    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:42.701756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:42.701717    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:42.904787 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:42.904733    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:43.302756 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:43.302720    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:43.501678 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:43.501646    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:43.896862 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:43.896830    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:44.151794 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:44.151712    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:44.293821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:44.293788    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:44.694035 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:44.694002    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:44.698066 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:44.698043    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:44.698154 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:44.698080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:44.698639 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:44.698620    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b0248ec-0182-46f2-8dc8-52ce1e757c81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:44.700413 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:44.700389    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b0248ec-0182-46f2-8dc8-52ce1e757c81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qq2qh\" (UID: \"6b0248ec-0182-46f2-8dc8-52ce1e757c81\") " pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:44.772507 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:44.772478    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qq2qh"
Jul 13 17:21:44.896417 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:44.896379    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qq2qh"]
Jul 13 17:21:44.899663 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:21:44.899634    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0248ec_0182_46f2_8dc8_52ce1e757c81.slice/crio-23f89e6ad0a38672aa8705e6ddf6bbd9ef7df3bf1abf55196b25637e9084bcdd WatchSource:0}: Error finding container 23f89e6ad0a38672aa8705e6ddf6bbd9ef7df3bf1abf55196b25637e9084bcdd: Status 404 returned error can't find the container with id 23f89e6ad0a38672aa8705e6ddf6bbd9ef7df3bf1abf55196b25637e9084bcdd
Jul 13 17:21:44.960725 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:44.960646    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qq2qh" event={"ID":"6b0248ec-0182-46f2-8dc8-52ce1e757c81","Type":"ContainerStarted","Data":"23f89e6ad0a38672aa8705e6ddf6bbd9ef7df3bf1abf55196b25637e9084bcdd"}
Jul 13 17:21:45.009936 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:45.009897    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:48.975909 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:48.975874    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qq2qh" event={"ID":"6b0248ec-0182-46f2-8dc8-52ce1e757c81","Type":"ContainerStarted","Data":"38619331b8745b352f39566331302af600e920a08ca398fc9683c87fd174ae6d"}
Jul 13 17:21:49.199710 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:49.199668    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:49.301204 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:49.301178    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:49.497980 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:49.497886    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:49.672302 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:49.672264    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:49.733621 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:49.733584    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:49.981938 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:49.981902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qq2qh" event={"ID":"6b0248ec-0182-46f2-8dc8-52ce1e757c81","Type":"ContainerStarted","Data":"218faaf153e746c917479914549b2dd6336b407cf12db78911ae6b83ba29c9ad"}
Jul 13 17:21:50.078334 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:50.078299    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:50.178820 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:50.178788    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:50.279153 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:50.279058    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:50.378578 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:50.378542    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:50.880260 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:50.880227    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:51.022115 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:51.022073    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:51.123925 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:51.123887    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:51.904315 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:51.904285    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:51.990441 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:51.990412    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qq2qh" event={"ID":"6b0248ec-0182-46f2-8dc8-52ce1e757c81","Type":"ContainerStarted","Data":"97056b37992ca8847d7a5f0fbb0f17f899004dec00510e96d4919c99dc549d5c"}
Jul 13 17:21:52.004433 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:52.004406    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:52.008391 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:52.008331    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qq2qh" podStartSLOduration=17.168654296 podStartE2EDuration="24.008316488s" totalImagesPullingTime="6.839662192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:21:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:21:52.007505093 +0000 UTC m=+272.659627717" watchObservedRunningTime="2026-07-13 17:21:52.008316488 +0000 UTC m=+272.660439114"
Jul 13 17:21:55.885425 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:55.885384    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:55.986807 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:55.986775    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:56.087864 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:56.087826    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:56.510257 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:56.510222    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:56.610734 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:56.610696    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:59.491370 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:59.491318    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:59.600828 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:59.600778    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:59.696987 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:59.696959    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:21:59.802640 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:21:59.802555    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:02.500273 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:02.500243    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:02.602162 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:02.602134    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:02.651057 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:22:02.651024    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r" podUID="5571bd9a-9e0a-4361-af35-c68a2e789240"
Jul 13 17:22:02.651160 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:22:02.651024    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5857f69948-4rpbc" podUID="f5ec2a65-1853-4cee-a9f8-415e3cd29618"
Jul 13 17:22:02.651160 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:22:02.651024    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-74f6n" podUID="5099f672-6f0f-4f21-91ec-2141e149b826"
Jul 13 17:22:02.720768 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:02.720714    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:02.830223 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:02.830121    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:03.007617 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:03.007581    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:03.022623 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:03.022594    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:22:03.022772 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:03.022595    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:22:03.022772 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:03.022605    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-74f6n"
Jul 13 17:22:04.903445 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:04.903411    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:05.495117 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:05.495063    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:06.033482 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.033398    2579 generic.go:356] "Generic (PLEG): container finished" podID="0078c5f7-e675-4c1e-b5d1-ff764834241d" containerID="feaa8ffd9ce33bd008da3af77781bce3474cbe800454c6ea669145a542cb1bb0" exitCode=1
Jul 13 17:22:06.033874 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.033474    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t" event={"ID":"0078c5f7-e675-4c1e-b5d1-ff764834241d","Type":"ContainerDied","Data":"feaa8ffd9ce33bd008da3af77781bce3474cbe800454c6ea669145a542cb1bb0"}
Jul 13 17:22:06.033874 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.033576    2579 scope.go:117] "RemoveContainer" containerID="216eb92a58a934cad2688e4d6c0c8fcf20f0878ac8e0138ee67866d5dd41df24"
Jul 13 17:22:06.033874 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.033819    2579 scope.go:117] "RemoveContainer" containerID="feaa8ffd9ce33bd008da3af77781bce3474cbe800454c6ea669145a542cb1bb0"
Jul 13 17:22:06.034012 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:22:06.033984    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-76444cff49-hpp8t_open-cluster-management-agent-addon(0078c5f7-e675-4c1e-b5d1-ff764834241d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t" podUID="0078c5f7-e675-4c1e-b5d1-ff764834241d"
Jul 13 17:22:06.035159 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.035140    2579 generic.go:356] "Generic (PLEG): container finished" podID="e87f480c-805a-4e46-aa2e-38c08c2c2c05" containerID="7796b0318f2a80f32829cacd1655f699ff792c8b7e01990820b7c45e2ba97e14" exitCode=255
Jul 13 17:22:06.035241 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.035195    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27" event={"ID":"e87f480c-805a-4e46-aa2e-38c08c2c2c05","Type":"ContainerDied","Data":"7796b0318f2a80f32829cacd1655f699ff792c8b7e01990820b7c45e2ba97e14"}
Jul 13 17:22:06.035452 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.035440    2579 scope.go:117] "RemoveContainer" containerID="7796b0318f2a80f32829cacd1655f699ff792c8b7e01990820b7c45e2ba97e14"
Jul 13 17:22:06.035566 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:22:06.035552    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7bb5894848-8jx27_open-cluster-management-agent-addon(e87f480c-805a-4e46-aa2e-38c08c2c2c05)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27" podUID="e87f480c-805a-4e46-aa2e-38c08c2c2c05"
Jul 13 17:22:06.044399 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.044381    2579 scope.go:117] "RemoveContainer" containerID="e29a5ffb72419a00aa535e7338409f9ab4d0f20f2f3560f5982ee773459b95cf"
Jul 13 17:22:06.185415 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.185372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:22:06.185600 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.185434    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-lhf7r\" (UID: \"5571bd9a-9e0a-4361-af35-c68a2e789240\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:22:06.187821 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.187792    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5571bd9a-9e0a-4361-af35-c68a2e789240-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-lhf7r\" (UID: \"5571bd9a-9e0a-4361-af35-c68a2e789240\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:22:06.187962 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.187827    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls\") pod \"image-registry-5857f69948-4rpbc\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") " pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:22:06.286694 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.286600    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:22:06.288816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.288797    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5099f672-6f0f-4f21-91ec-2141e149b826-metrics-tls\") pod \"dns-default-74f6n\" (UID: \"5099f672-6f0f-4f21-91ec-2141e149b826\") " pod="openshift-dns/dns-default-74f6n"
Jul 13 17:22:06.326334 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.326310    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f7qlt\""
Jul 13 17:22:06.326493 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.326310    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2qfwx\""
Jul 13 17:22:06.326493 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.326310    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2rlnn\""
Jul 13 17:22:06.333173 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.333143    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:22:06.333173 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.333166    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-74f6n"
Jul 13 17:22:06.333297 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.333168    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"
Jul 13 17:22:06.478883 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.478848    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5857f69948-4rpbc"]
Jul 13 17:22:06.482424 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:22:06.482401    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5ec2a65_1853_4cee_a9f8_415e3cd29618.slice/crio-5a851fa1c41c7ae232ccac883321109e3aad1eecdd21f5cc84ae8101c389ca50 WatchSource:0}: Error finding container 5a851fa1c41c7ae232ccac883321109e3aad1eecdd21f5cc84ae8101c389ca50: Status 404 returned error can't find the container with id 5a851fa1c41c7ae232ccac883321109e3aad1eecdd21f5cc84ae8101c389ca50
Jul 13 17:22:06.498229 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.498189    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:22:06.521326 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.521299    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr" podUID="fc7351f8-d77a-4919-acec-3e1f262123b1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 13 17:22:06.536961 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.536908    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27"
Jul 13 17:22:06.676401 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.676367    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:22:06.698844 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.698688    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-lhf7r"]
Jul 13 17:22:06.701539 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.701510    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-74f6n"]
Jul 13 17:22:06.701683 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:22:06.701539    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5571bd9a_9e0a_4361_af35_c68a2e789240.slice/crio-08b890e6b95c6ecfcc66c3817406158b577574c252439b47729d9a2915a5087e WatchSource:0}: Error finding container 08b890e6b95c6ecfcc66c3817406158b577574c252439b47729d9a2915a5087e: Status 404 returned error can't find the container with id 08b890e6b95c6ecfcc66c3817406158b577574c252439b47729d9a2915a5087e
Jul 13 17:22:06.704866 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:22:06.704840    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5099f672_6f0f_4f21_91ec_2141e149b826.slice/crio-636dbedb167d00c02f18770fe610987d42596ecf1bbc8a1401e450ae24dc5458 WatchSource:0}: Error finding container 636dbedb167d00c02f18770fe610987d42596ecf1bbc8a1401e450ae24dc5458: Status 404 returned error can't find the container with id 636dbedb167d00c02f18770fe610987d42596ecf1bbc8a1401e450ae24dc5458
Jul 13 17:22:06.876819 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:06.876781    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:07.039580 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.039548    2579 scope.go:117] "RemoveContainer" containerID="7796b0318f2a80f32829cacd1655f699ff792c8b7e01990820b7c45e2ba97e14"
Jul 13 17:22:07.039999 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:22:07.039719    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7bb5894848-8jx27_open-cluster-management-agent-addon(e87f480c-805a-4e46-aa2e-38c08c2c2c05)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27" podUID="e87f480c-805a-4e46-aa2e-38c08c2c2c05"
Jul 13 17:22:07.040405 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.040338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r" event={"ID":"5571bd9a-9e0a-4361-af35-c68a2e789240","Type":"ContainerStarted","Data":"08b890e6b95c6ecfcc66c3817406158b577574c252439b47729d9a2915a5087e"}
Jul 13 17:22:07.041368 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.041324    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-74f6n" event={"ID":"5099f672-6f0f-4f21-91ec-2141e149b826","Type":"ContainerStarted","Data":"636dbedb167d00c02f18770fe610987d42596ecf1bbc8a1401e450ae24dc5458"}
Jul 13 17:22:07.042747 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.042724    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5857f69948-4rpbc" event={"ID":"f5ec2a65-1853-4cee-a9f8-415e3cd29618","Type":"ContainerStarted","Data":"1dfa1aaa16a8046bf348599a66f7d5248790f8c49961f25ad752ec92798b61c9"}
Jul 13 17:22:07.042846 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.042765    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5857f69948-4rpbc" event={"ID":"f5ec2a65-1853-4cee-a9f8-415e3cd29618","Type":"ContainerStarted","Data":"5a851fa1c41c7ae232ccac883321109e3aad1eecdd21f5cc84ae8101c389ca50"}
Jul 13 17:22:07.042846 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.042791    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:22:07.044166 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.044152    2579 scope.go:117] "RemoveContainer" containerID="feaa8ffd9ce33bd008da3af77781bce3474cbe800454c6ea669145a542cb1bb0"
Jul 13 17:22:07.044283 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:22:07.044266    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-76444cff49-hpp8t_open-cluster-management-agent-addon(0078c5f7-e675-4c1e-b5d1-ff764834241d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t" podUID="0078c5f7-e675-4c1e-b5d1-ff764834241d"
Jul 13 17:22:07.085000 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.084970    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:07.094159 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.094118    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5857f69948-4rpbc" podStartSLOduration=287.094103234 podStartE2EDuration="4m47.094103234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:22:07.09344106 +0000 UTC m=+287.745563676" watchObservedRunningTime="2026-07-13 17:22:07.094103234 +0000 UTC m=+287.746225874"
Jul 13 17:22:07.158476 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.158405    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x2vv6"]
Jul 13 17:22:07.163089 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.163074    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.165512 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.165482    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 17:22:07.165639 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.165493    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 17:22:07.165639 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.165539    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wlrkx\""
Jul 13 17:22:07.165639 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.165626    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 17:22:07.165827 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.165814    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 17:22:07.165867 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.165815    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 17:22:07.165908 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.165868    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 17:22:07.187288 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.187261    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:07.293133 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.293097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-sys\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.293380 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.293146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-textfile\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.293380 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.293200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-tls\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.293380 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.293230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.293380 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.293256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-accelerators-collector-config\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.293380 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.293309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-metrics-client-ca\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.293380 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.293335    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-root\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.293380 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.293381    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-wtmp\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.293723 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.293413    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghff4\" (UniqueName: \"kubernetes.io/projected/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-kube-api-access-ghff4\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.393953 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.393912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-metrics-client-ca\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.393953 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.393952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-root\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.394193 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.393979    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-wtmp\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.394193 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.394015    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghff4\" (UniqueName: \"kubernetes.io/projected/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-kube-api-access-ghff4\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.394193 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.394051    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-sys\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.394193 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.394087    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-textfile\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.394193 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.394142    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-tls\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.394193 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.394165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-wtmp\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.394193 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.394179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.394631 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.394051    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-root\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.394631 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.394208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-accelerators-collector-config\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.394631 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.394218    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-sys\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.394631 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:22:07.394285    2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 13 17:22:07.394631 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:22:07.394367    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-tls podName:f70b2ab0-fc99-42dd-a6f1-9ac388a46546 nodeName:}" failed. No retries permitted until 2026-07-13 17:22:07.894331843 +0000 UTC m=+288.546454448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-tls") pod "node-exporter-x2vv6" (UID: "f70b2ab0-fc99-42dd-a6f1-9ac388a46546") : secret "node-exporter-tls" not found
Jul 13 17:22:07.394631 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.394621    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-metrics-client-ca\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.394910 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.394760    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-textfile\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.394910 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.394784    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-accelerators-collector-config\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.396783 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.396759    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.406802 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.406777    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghff4\" (UniqueName: \"kubernetes.io/projected/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-kube-api-access-ghff4\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.428237 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.428146    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:07.525674 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.525607    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:07.626263 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.626228    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:07.898578 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.898540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-tls\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:07.901755 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:07.901727    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f70b2ab0-fc99-42dd-a6f1-9ac388a46546-node-exporter-tls\") pod \"node-exporter-x2vv6\" (UID: \"f70b2ab0-fc99-42dd-a6f1-9ac388a46546\") " pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:08.048537 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:08.048510    2579 scope.go:117] "RemoveContainer" containerID="feaa8ffd9ce33bd008da3af77781bce3474cbe800454c6ea669145a542cb1bb0"
Jul 13 17:22:08.049007 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:22:08.048718    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-76444cff49-hpp8t_open-cluster-management-agent-addon(0078c5f7-e675-4c1e-b5d1-ff764834241d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t" podUID="0078c5f7-e675-4c1e-b5d1-ff764834241d"
Jul 13 17:22:08.072772 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:08.072726    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x2vv6"
Jul 13 17:22:08.101086 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:22:08.101053    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70b2ab0_fc99_42dd_a6f1_9ac388a46546.slice/crio-bab2de07cae61b80c963289af17a15691d9c4509cbf2c9ce1974399b97c1f622 WatchSource:0}: Error finding container bab2de07cae61b80c963289af17a15691d9c4509cbf2c9ce1974399b97c1f622: Status 404 returned error can't find the container with id bab2de07cae61b80c963289af17a15691d9c4509cbf2c9ce1974399b97c1f622
Jul 13 17:22:08.104525 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:08.104479    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:08.192269 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:08.192180    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:08.510085 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:08.510001    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:08.711638 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:08.711577    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:08.812076 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:08.812046    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:09.053174 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:09.053094    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x2vv6" event={"ID":"f70b2ab0-fc99-42dd-a6f1-9ac388a46546","Type":"ContainerStarted","Data":"bab2de07cae61b80c963289af17a15691d9c4509cbf2c9ce1974399b97c1f622"}
Jul 13 17:22:09.055041 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:09.055007    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r" event={"ID":"5571bd9a-9e0a-4361-af35-c68a2e789240","Type":"ContainerStarted","Data":"d2d55bbc18e5b2f36bc9b8ad3bf3c20e70b4486adde1005d4acc5310a84a5857"}
Jul 13 17:22:09.057211 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:09.057130    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-74f6n" event={"ID":"5099f672-6f0f-4f21-91ec-2141e149b826","Type":"ContainerStarted","Data":"331e2f7374afb1e1a80185c6c9f35a2193532d1cb03aca7e2eda4fd87640fdbb"}
Jul 13 17:22:09.057211 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:09.057177    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-74f6n" event={"ID":"5099f672-6f0f-4f21-91ec-2141e149b826","Type":"ContainerStarted","Data":"f666043c92d7797911ccb97302dcaec73d385bab8752236c15a85be6815eb9c3"}
Jul 13 17:22:09.057415 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:09.057273    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-74f6n"
Jul 13 17:22:09.071986 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:09.071944    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-lhf7r" podStartSLOduration=285.191134513 podStartE2EDuration="4m47.071928606s" totalImagesPullingTime="1.880794093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:22:09.070941309 +0000 UTC m=+289.723063935" watchObservedRunningTime="2026-07-13 17:22:09.071928606 +0000 UTC m=+289.724051230"
Jul 13 17:22:09.093064 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:09.093000    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-74f6n" podStartSLOduration=251.162486529 podStartE2EDuration="4m13.092977953s" totalImagesPullingTime="1.930491424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:22:09.0923198 +0000 UTC m=+289.744442419" watchObservedRunningTime="2026-07-13 17:22:09.092977953 +0000 UTC m=+289.745100579"
Jul 13 17:22:09.216459 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:09.216414    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:09.312606 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:09.312537    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:09.505409 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:09.505375    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:09.605966 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:09.605877    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:10.060123 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:10.060084    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:10.062319 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:10.062287    2579 generic.go:356] "Generic (PLEG): container finished" podID="f70b2ab0-fc99-42dd-a6f1-9ac388a46546" containerID="1cf92c41a42dea89bb6904891694aef6d46fdb723ea93e123f5063cefef51df1" exitCode=0
Jul 13 17:22:10.062442 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:10.062382    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x2vv6" event={"ID":"f70b2ab0-fc99-42dd-a6f1-9ac388a46546","Type":"ContainerDied","Data":"1cf92c41a42dea89bb6904891694aef6d46fdb723ea93e123f5063cefef51df1"}
Jul 13 17:22:10.160112 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:10.160078    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:10.261293 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:10.261259    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:10.417435 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:10.417400    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:11.070075 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:11.070023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x2vv6" event={"ID":"f70b2ab0-fc99-42dd-a6f1-9ac388a46546","Type":"ContainerStarted","Data":"f9bf34cde976d0b7aaaaf6a97ab062435b2c4a2dda9bd5f93b0d554a0279b0f8"}
Jul 13 17:22:11.070514 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:11.070091    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x2vv6" event={"ID":"f70b2ab0-fc99-42dd-a6f1-9ac388a46546","Type":"ContainerStarted","Data":"c41690674c20cf010bac771e9ff772d38f15323ea6b51bd4f555e85977c6cb35"}
Jul 13 17:22:11.090790 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:11.090738    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x2vv6" podStartSLOduration=2.971852485 podStartE2EDuration="4.09069921s" totalImagesPullingTime="1.056160194s" totalInitContainerRuntime="62.686531ms" isStatefulPod=true podCreationTimestamp="2026-07-13 17:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:22:11.089236129 +0000 UTC m=+291.741358755" watchObservedRunningTime="2026-07-13 17:22:11.09069921 +0000 UTC m=+291.742821892"
Jul 13 17:22:11.893988 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:11.893948    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:11.950463 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:11.950416    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:12.141329 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:12.141284    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:12.242531 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:12.242427    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:12.403617 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:12.403568    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:13.337250 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:13.337211    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:13.825137 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:13.825106    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:16.521525 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:16.521484    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr" podUID="fc7351f8-d77a-4919-acec-3e1f262123b1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 13 17:22:17.065436 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:22:17.065372    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h26bb" podUID="5cf84bf3-8941-43b9-b255-3b74ceb51b71"
Jul 13 17:22:18.400192 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:18.400154    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:18.507052 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:18.507022    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:19.065010 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:19.064985    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-74f6n"
Jul 13 17:22:19.396317 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:19.396283    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:19.458122 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:19.458092    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:19.769565 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:19.769491    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:22:19.770700 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:19.770681    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:22:19.772291 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:19.772273    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 17:22:20.066606 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:20.066370    2579 scope.go:117] "RemoveContainer" containerID="7796b0318f2a80f32829cacd1655f699ff792c8b7e01990820b7c45e2ba97e14"
Jul 13 17:22:21.065548 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:21.065516    2579 scope.go:117] "RemoveContainer" containerID="feaa8ffd9ce33bd008da3af77781bce3474cbe800454c6ea669145a542cb1bb0"
Jul 13 17:22:21.102539 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:21.102512    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7bb5894848-8jx27" event={"ID":"e87f480c-805a-4e46-aa2e-38c08c2c2c05","Type":"ContainerStarted","Data":"c28841d303a3924ff17764ae8b3f2ef77b26b5314ffd637ac87bcdc567943cc8"}
Jul 13 17:22:22.106735 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:22.106700    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t" event={"ID":"0078c5f7-e675-4c1e-b5d1-ff764834241d","Type":"ContainerStarted","Data":"16a70008f22ced4c18576757e67cf4431535ca9c59b8274ba12987d203d688dd"}
Jul 13 17:22:22.107200 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:22.107066    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:22:22.108595 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:22.108576    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76444cff49-hpp8t"
Jul 13 17:22:24.757017 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:24.756983    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:24.818477 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:24.818438    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:26.191222 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:26.191190    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:26.247116 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:26.247081    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:26.338085 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:26.338054    2579 patch_prober.go:28] interesting pod/image-registry-5857f69948-4rpbc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 17:22:26.338228 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:26.338107    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5857f69948-4rpbc" podUID="f5ec2a65-1853-4cee-a9f8-415e3cd29618" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 17:22:26.521647 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:26.521560    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr" podUID="fc7351f8-d77a-4919-acec-3e1f262123b1" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 13 17:22:26.521647 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:26.521636    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr"
Jul 13 17:22:26.522211 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:26.522168    2579 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"f4af54550d0893f64b247f4a5a9a307a11c61b5ab695341b1dbba28a8a67f7b1"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 13 17:22:26.522251 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:26.522233    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr" podUID="fc7351f8-d77a-4919-acec-3e1f262123b1" containerName="service-proxy" containerID="cri-o://f4af54550d0893f64b247f4a5a9a307a11c61b5ab695341b1dbba28a8a67f7b1" gracePeriod=30
Jul 13 17:22:27.124742 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:27.124709    2579 generic.go:356] "Generic (PLEG): container finished" podID="fc7351f8-d77a-4919-acec-3e1f262123b1" containerID="f4af54550d0893f64b247f4a5a9a307a11c61b5ab695341b1dbba28a8a67f7b1" exitCode=2
Jul 13 17:22:27.124907 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:27.124771    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr" event={"ID":"fc7351f8-d77a-4919-acec-3e1f262123b1","Type":"ContainerDied","Data":"f4af54550d0893f64b247f4a5a9a307a11c61b5ab695341b1dbba28a8a67f7b1"}
Jul 13 17:22:27.124907 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:27.124806    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6df9658544-kgtnr" event={"ID":"fc7351f8-d77a-4919-acec-3e1f262123b1","Type":"ContainerStarted","Data":"6805f1a92e548d4283ba7d020c0e80f0caf1fd5f71171c50681c8f1d6a2ba00b"}
Jul 13 17:22:27.929750 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:27.929713    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:28.052148 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:28.052119    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:22:28.203045 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:28.202957    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:28.269043 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:28.269013    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:28.304207 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:28.304171    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5857f69948-4rpbc"]
Jul 13 17:22:28.394506 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:28.394465    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:28.452371 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:28.452321    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:32.065367 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:32.065319    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:22:33.072008 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:33.071967    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:33.176579 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:33.176529    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:33.277619 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:33.277584    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:35.143239 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:35.143205    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:35.267653 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:35.267619    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:35.385022 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:35.384988    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:49.549167 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:49.549133    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:49.649678 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:49.649641    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:50.145842 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:50.145810    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:50.390864 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:50.390826    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:22:53.330424 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:53.330384    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5857f69948-4rpbc" podUID="f5ec2a65-1853-4cee-a9f8-415e3cd29618" containerName="registry" containerID="cri-o://1dfa1aaa16a8046bf348599a66f7d5248790f8c49961f25ad752ec92798b61c9" gracePeriod=30
Jul 13 17:22:54.565435 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.565410    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:22:54.648209 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.648112    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5ec2a65-1853-4cee-a9f8-415e3cd29618-image-registry-private-configuration\") pod \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") "
Jul 13 17:22:54.648209 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.648192    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-certificates\") pod \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") "
Jul 13 17:22:54.648464 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.648225    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5ec2a65-1853-4cee-a9f8-415e3cd29618-trusted-ca\") pod \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") "
Jul 13 17:22:54.648464 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.648247    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmvfw\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-kube-api-access-tmvfw\") pod \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") "
Jul 13 17:22:54.648464 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.648271    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5ec2a65-1853-4cee-a9f8-415e3cd29618-ca-trust-extracted\") pod \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") "
Jul 13 17:22:54.648464 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.648423    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-bound-sa-token\") pod \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") "
Jul 13 17:22:54.648668 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.648477    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls\") pod \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") "
Jul 13 17:22:54.648668 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.648511    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5ec2a65-1853-4cee-a9f8-415e3cd29618-installation-pull-secrets\") pod \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\" (UID: \"f5ec2a65-1853-4cee-a9f8-415e3cd29618\") "
Jul 13 17:22:54.648771 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.648700    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f5ec2a65-1853-4cee-a9f8-415e3cd29618" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:22:54.648771 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.648713    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5ec2a65-1853-4cee-a9f8-415e3cd29618-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f5ec2a65-1853-4cee-a9f8-415e3cd29618" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:22:54.650953 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.650911    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-kube-api-access-tmvfw" (OuterVolumeSpecName: "kube-api-access-tmvfw") pod "f5ec2a65-1853-4cee-a9f8-415e3cd29618" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618"). InnerVolumeSpecName "kube-api-access-tmvfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:22:54.651083 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.650925    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f5ec2a65-1853-4cee-a9f8-415e3cd29618" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:22:54.651083 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.650990    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5ec2a65-1853-4cee-a9f8-415e3cd29618-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f5ec2a65-1853-4cee-a9f8-415e3cd29618" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:22:54.651083 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.651053    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f5ec2a65-1853-4cee-a9f8-415e3cd29618" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:22:54.651228 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.651142    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5ec2a65-1853-4cee-a9f8-415e3cd29618-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f5ec2a65-1853-4cee-a9f8-415e3cd29618" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:22:54.657450 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.657426    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5ec2a65-1853-4cee-a9f8-415e3cd29618-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f5ec2a65-1853-4cee-a9f8-415e3cd29618" (UID: "f5ec2a65-1853-4cee-a9f8-415e3cd29618"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:22:54.749740 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.749711    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-certificates\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:22:54.749740 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.749736    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f5ec2a65-1853-4cee-a9f8-415e3cd29618-trusted-ca\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:22:54.749740 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.749745    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmvfw\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-kube-api-access-tmvfw\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:22:54.749933 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.749754    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f5ec2a65-1853-4cee-a9f8-415e3cd29618-ca-trust-extracted\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:22:54.749933 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.749763    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-bound-sa-token\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:22:54.749933 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.749771    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f5ec2a65-1853-4cee-a9f8-415e3cd29618-registry-tls\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:22:54.749933 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.749778    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f5ec2a65-1853-4cee-a9f8-415e3cd29618-installation-pull-secrets\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:22:54.749933 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:54.749787    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f5ec2a65-1853-4cee-a9f8-415e3cd29618-image-registry-private-configuration\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:22:55.216199 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:55.216167    2579 generic.go:356] "Generic (PLEG): container finished" podID="f5ec2a65-1853-4cee-a9f8-415e3cd29618" containerID="1dfa1aaa16a8046bf348599a66f7d5248790f8c49961f25ad752ec92798b61c9" exitCode=0
Jul 13 17:22:55.216375 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:55.216206    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5857f69948-4rpbc"
Jul 13 17:22:55.216375 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:55.216236    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5857f69948-4rpbc" event={"ID":"f5ec2a65-1853-4cee-a9f8-415e3cd29618","Type":"ContainerDied","Data":"1dfa1aaa16a8046bf348599a66f7d5248790f8c49961f25ad752ec92798b61c9"}
Jul 13 17:22:55.216375 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:55.216281    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5857f69948-4rpbc" event={"ID":"f5ec2a65-1853-4cee-a9f8-415e3cd29618","Type":"ContainerDied","Data":"5a851fa1c41c7ae232ccac883321109e3aad1eecdd21f5cc84ae8101c389ca50"}
Jul 13 17:22:55.216375 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:55.216300    2579 scope.go:117] "RemoveContainer" containerID="1dfa1aaa16a8046bf348599a66f7d5248790f8c49961f25ad752ec92798b61c9"
Jul 13 17:22:55.224293 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:55.224272    2579 scope.go:117] "RemoveContainer" containerID="1dfa1aaa16a8046bf348599a66f7d5248790f8c49961f25ad752ec92798b61c9"
Jul 13 17:22:55.224567 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:22:55.224542    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dfa1aaa16a8046bf348599a66f7d5248790f8c49961f25ad752ec92798b61c9\": container with ID starting with 1dfa1aaa16a8046bf348599a66f7d5248790f8c49961f25ad752ec92798b61c9 not found: ID does not exist" containerID="1dfa1aaa16a8046bf348599a66f7d5248790f8c49961f25ad752ec92798b61c9"
Jul 13 17:22:55.224631 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:55.224573    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dfa1aaa16a8046bf348599a66f7d5248790f8c49961f25ad752ec92798b61c9"} err="failed to get container status \"1dfa1aaa16a8046bf348599a66f7d5248790f8c49961f25ad752ec92798b61c9\": rpc error: code = NotFound desc = could not find container \"1dfa1aaa16a8046bf348599a66f7d5248790f8c49961f25ad752ec92798b61c9\": container with ID starting with 1dfa1aaa16a8046bf348599a66f7d5248790f8c49961f25ad752ec92798b61c9 not found: ID does not exist"
Jul 13 17:22:55.237214 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:55.237185    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5857f69948-4rpbc"]
Jul 13 17:22:55.241119 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:55.241098    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5857f69948-4rpbc"]
Jul 13 17:22:56.069274 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:22:56.069243    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5ec2a65-1853-4cee-a9f8-415e3cd29618" path="/var/lib/kubelet/pods/f5ec2a65-1853-4cee-a9f8-415e3cd29618/volumes"
Jul 13 17:23:26.328949 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:26.328913    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:26.607654 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:26.607569    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:35.150370 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:35.150290    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:23:35.152664 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:35.152641    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cf84bf3-8941-43b9-b255-3b74ceb51b71-metrics-certs\") pod \"network-metrics-daemon-h26bb\" (UID: \"5cf84bf3-8941-43b9-b255-3b74ceb51b71\") " pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:23:35.373007 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:35.369505    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gkqtt\""
Jul 13 17:23:35.376906 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:35.376890    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h26bb"
Jul 13 17:23:35.522767 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:35.522743    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h26bb"]
Jul 13 17:23:35.524594 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:23:35.524569    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf84bf3_8941_43b9_b255_3b74ceb51b71.slice/crio-5b93a9eb76ecd049f2b435aefa7c2fa2761f0bace3db3bc1c99d9382ec87568f WatchSource:0}: Error finding container 5b93a9eb76ecd049f2b435aefa7c2fa2761f0bace3db3bc1c99d9382ec87568f: Status 404 returned error can't find the container with id 5b93a9eb76ecd049f2b435aefa7c2fa2761f0bace3db3bc1c99d9382ec87568f
Jul 13 17:23:35.526468 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:35.526453    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:23:35.719214 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:35.719110    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:35.820270 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:35.820186    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:36.354383 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:36.354331    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h26bb" event={"ID":"5cf84bf3-8941-43b9-b255-3b74ceb51b71","Type":"ContainerStarted","Data":"5b93a9eb76ecd049f2b435aefa7c2fa2761f0bace3db3bc1c99d9382ec87568f"}
Jul 13 17:23:37.361453 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:37.361419    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h26bb" event={"ID":"5cf84bf3-8941-43b9-b255-3b74ceb51b71","Type":"ContainerStarted","Data":"3742cd58eb37e6e60f84e168094a0aed85351d1d90110b7427cd34ac5dcc8221"}
Jul 13 17:23:37.361833 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:37.361485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h26bb" event={"ID":"5cf84bf3-8941-43b9-b255-3b74ceb51b71","Type":"ContainerStarted","Data":"f23f856f93d43f8b5a75f7eb30fae0763ad54635fe336e1f47ea22ad34fb0df1"}
Jul 13 17:23:37.382678 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:37.382624    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h26bb" podStartSLOduration=376.444782953 podStartE2EDuration="6m17.382608366s" totalImagesPullingTime="937.825413ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:23:37.381913073 +0000 UTC m=+378.034035697" watchObservedRunningTime="2026-07-13 17:23:37.382608366 +0000 UTC m=+378.034730991"
Jul 13 17:23:37.484274 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:37.484217    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:37.555627 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:37.555595    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:41.594279 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:41.594236    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:41.674678 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:41.674641    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:47.405114 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:47.405085    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:47.477539 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:47.477503    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:48.012423 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:48.012385    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:48.074632 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:48.074600    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:53.534482 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:53.534449    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:53.607908 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:53.607875    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:58.104088 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:58.104046    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:58.210295 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:58.210261    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:23:58.276854 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:23:58.276823    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:24:05.265212 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:24:05.265166    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:24:05.386134 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:24:05.386099    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:24:19.967660 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:24:19.967599    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:24:20.027680 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:24:20.027637    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:04.385611 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:04.385561    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:04.618249 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:04.618220    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:09.761181 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:09.761147    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:23.934635 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:23.934600    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:24.039526 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:24.039494    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:26.975428 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:26.975390    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:27.409035 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:27.409005    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:31.636842 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:31.636806    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:31.737975 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:31.737936    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:32.784869 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:32.784828    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:32.881282 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:32.881249    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:33.755996 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:33.755964    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:33.940741 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:33.940710    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:36.072397 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:36.072360    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:36.328180 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:36.328093    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:37.008071 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:37.008034    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:37.118252 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:37.118222    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:43.711699 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:43.711654    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:44.494387 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.494335    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j4lp2"]
Jul 13 17:25:44.494654 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.494637    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5ec2a65-1853-4cee-a9f8-415e3cd29618" containerName="registry"
Jul 13 17:25:44.494726 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.494657    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5ec2a65-1853-4cee-a9f8-415e3cd29618" containerName="registry"
Jul 13 17:25:44.494777 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.494747    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5ec2a65-1853-4cee-a9f8-415e3cd29618" containerName="registry"
Jul 13 17:25:44.496902 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.496875    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-j4lp2"
Jul 13 17:25:44.500063 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.500041    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 13 17:25:44.500202 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.500152    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-6r5bp\""
Jul 13 17:25:44.500830 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.500815    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 13 17:25:44.524806 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.524770    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j4lp2"]
Jul 13 17:25:44.631253 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.631213    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/268e716f-ed8f-40d7-8061-c0217c19aa58-bound-sa-token\") pod \"cert-manager-55b4d954d5-j4lp2\" (UID: \"268e716f-ed8f-40d7-8061-c0217c19aa58\") " pod="cert-manager/cert-manager-55b4d954d5-j4lp2"
Jul 13 17:25:44.631456 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.631266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8l58\" (UniqueName: \"kubernetes.io/projected/268e716f-ed8f-40d7-8061-c0217c19aa58-kube-api-access-z8l58\") pod \"cert-manager-55b4d954d5-j4lp2\" (UID: \"268e716f-ed8f-40d7-8061-c0217c19aa58\") " pod="cert-manager/cert-manager-55b4d954d5-j4lp2"
Jul 13 17:25:44.731733 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.731690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/268e716f-ed8f-40d7-8061-c0217c19aa58-bound-sa-token\") pod \"cert-manager-55b4d954d5-j4lp2\" (UID: \"268e716f-ed8f-40d7-8061-c0217c19aa58\") " pod="cert-manager/cert-manager-55b4d954d5-j4lp2"
Jul 13 17:25:44.732096 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.731750    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8l58\" (UniqueName: \"kubernetes.io/projected/268e716f-ed8f-40d7-8061-c0217c19aa58-kube-api-access-z8l58\") pod \"cert-manager-55b4d954d5-j4lp2\" (UID: \"268e716f-ed8f-40d7-8061-c0217c19aa58\") " pod="cert-manager/cert-manager-55b4d954d5-j4lp2"
Jul 13 17:25:44.745185 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.745120    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/268e716f-ed8f-40d7-8061-c0217c19aa58-bound-sa-token\") pod \"cert-manager-55b4d954d5-j4lp2\" (UID: \"268e716f-ed8f-40d7-8061-c0217c19aa58\") " pod="cert-manager/cert-manager-55b4d954d5-j4lp2"
Jul 13 17:25:44.748330 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.748313    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8l58\" (UniqueName: \"kubernetes.io/projected/268e716f-ed8f-40d7-8061-c0217c19aa58-kube-api-access-z8l58\") pod \"cert-manager-55b4d954d5-j4lp2\" (UID: \"268e716f-ed8f-40d7-8061-c0217c19aa58\") " pod="cert-manager/cert-manager-55b4d954d5-j4lp2"
Jul 13 17:25:44.805655 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.805624    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-j4lp2"
Jul 13 17:25:44.849441 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.849406    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:44.937317 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.937287    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j4lp2"]
Jul 13 17:25:44.941026 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:25:44.941005    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod268e716f_ed8f_40d7_8061_c0217c19aa58.slice/crio-1cbf34937a22621548099da0e089d142bad6228ce71948638dfd7fc223f220b6 WatchSource:0}: Error finding container 1cbf34937a22621548099da0e089d142bad6228ce71948638dfd7fc223f220b6: Status 404 returned error can't find the container with id 1cbf34937a22621548099da0e089d142bad6228ce71948638dfd7fc223f220b6
Jul 13 17:25:44.969442 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:44.969411    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:45.774696 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:45.774655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-j4lp2" event={"ID":"268e716f-ed8f-40d7-8061-c0217c19aa58","Type":"ContainerStarted","Data":"1cbf34937a22621548099da0e089d142bad6228ce71948638dfd7fc223f220b6"}
Jul 13 17:25:48.792195 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:48.792156    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-j4lp2" event={"ID":"268e716f-ed8f-40d7-8061-c0217c19aa58","Type":"ContainerStarted","Data":"08fec70271d9d0287245c31ffbd999cf18d6f0baee699f54112a8cc65acc306c"}
Jul 13 17:25:48.818061 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:48.818010    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-j4lp2" podStartSLOduration=1.818575965 podStartE2EDuration="4.817993931s" totalImagesPullingTime="2.999417966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:25:48.817210137 +0000 UTC m=+509.469332762" watchObservedRunningTime="2026-07-13 17:25:48.817993931 +0000 UTC m=+509.470116555"
Jul 13 17:25:51.202423 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:51.202383    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:51.306257 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:51.306223    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:25:52.859593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:25:52.859540    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:09.307390 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:09.307337    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:09.594069 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:09.593973    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:10.047916 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.047877    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:10.374610 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.374562    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:10.466407 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.466372    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"]
Jul 13 17:26:10.473701 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.473672    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.478147 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.478127    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 17:26:10.478265 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.478220    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 17:26:10.478312 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.478286    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 17:26:10.478723 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.478704    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2kjrn\""
Jul 13 17:26:10.479077 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.479057    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 17:26:10.489436 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.489414    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"]
Jul 13 17:26:10.513325 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.513299    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkd7j\" (UniqueName: \"kubernetes.io/projected/0c7c33de-6523-4cb1-8d36-57519999d8c7-kube-api-access-rkd7j\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v\" (UID: \"0c7c33de-6523-4cb1-8d36-57519999d8c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.513476 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.513330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c7c33de-6523-4cb1-8d36-57519999d8c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v\" (UID: \"0c7c33de-6523-4cb1-8d36-57519999d8c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.513476 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.513381    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c7c33de-6523-4cb1-8d36-57519999d8c7-tmp\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v\" (UID: \"0c7c33de-6523-4cb1-8d36-57519999d8c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.513476 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.513435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c7c33de-6523-4cb1-8d36-57519999d8c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v\" (UID: \"0c7c33de-6523-4cb1-8d36-57519999d8c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.513589 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.513488    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c7c33de-6523-4cb1-8d36-57519999d8c7-manifests\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v\" (UID: \"0c7c33de-6523-4cb1-8d36-57519999d8c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.551135 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.551081    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:10.614360 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.614320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkd7j\" (UniqueName: \"kubernetes.io/projected/0c7c33de-6523-4cb1-8d36-57519999d8c7-kube-api-access-rkd7j\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v\" (UID: \"0c7c33de-6523-4cb1-8d36-57519999d8c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.614534 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.614396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c7c33de-6523-4cb1-8d36-57519999d8c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v\" (UID: \"0c7c33de-6523-4cb1-8d36-57519999d8c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.614534 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.614453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c7c33de-6523-4cb1-8d36-57519999d8c7-tmp\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v\" (UID: \"0c7c33de-6523-4cb1-8d36-57519999d8c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.614534 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.614496    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c7c33de-6523-4cb1-8d36-57519999d8c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v\" (UID: \"0c7c33de-6523-4cb1-8d36-57519999d8c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.614657 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.614533    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c7c33de-6523-4cb1-8d36-57519999d8c7-manifests\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v\" (UID: \"0c7c33de-6523-4cb1-8d36-57519999d8c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.614952 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.614924    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c7c33de-6523-4cb1-8d36-57519999d8c7-manifests\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v\" (UID: \"0c7c33de-6523-4cb1-8d36-57519999d8c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.616842 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.616811    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c7c33de-6523-4cb1-8d36-57519999d8c7-tmp\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v\" (UID: \"0c7c33de-6523-4cb1-8d36-57519999d8c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.616962 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.616859    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c7c33de-6523-4cb1-8d36-57519999d8c7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v\" (UID: \"0c7c33de-6523-4cb1-8d36-57519999d8c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.617099 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.617079    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c7c33de-6523-4cb1-8d36-57519999d8c7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v\" (UID: \"0c7c33de-6523-4cb1-8d36-57519999d8c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.624507 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.624483    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkd7j\" (UniqueName: \"kubernetes.io/projected/0c7c33de-6523-4cb1-8d36-57519999d8c7-kube-api-access-rkd7j\") pod \"opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v\" (UID: \"0c7c33de-6523-4cb1-8d36-57519999d8c7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.669239 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.669149    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:10.783523 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.783486    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:10.819073 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.819036    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:10.951882 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:10.951807    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"]
Jul 13 17:26:10.954926 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:26:10.954902    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7c33de_6523_4cb1_8d36_57519999d8c7.slice/crio-246ccbf406670dbd1f936ca72ea95e71e47c341d9f73ff5e52b2ee8ef1213533 WatchSource:0}: Error finding container 246ccbf406670dbd1f936ca72ea95e71e47c341d9f73ff5e52b2ee8ef1213533: Status 404 returned error can't find the container with id 246ccbf406670dbd1f936ca72ea95e71e47c341d9f73ff5e52b2ee8ef1213533
Jul 13 17:26:11.016644 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:11.016608    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:11.135675 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:11.135638    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:11.338780 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:11.338692    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:11.541484 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:11.541451    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:11.871013 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:11.870968    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v" event={"ID":"0c7c33de-6523-4cb1-8d36-57519999d8c7","Type":"ContainerStarted","Data":"246ccbf406670dbd1f936ca72ea95e71e47c341d9f73ff5e52b2ee8ef1213533"}
Jul 13 17:26:12.843782 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:12.843747    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:13.035834 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:13.035804    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:14.883319 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:14.883288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v" event={"ID":"0c7c33de-6523-4cb1-8d36-57519999d8c7","Type":"ContainerStarted","Data":"b37aa7cebeb10728b4ad4112e40780f1c380eb0fc0f760b4366187b91a926fbd"}
Jul 13 17:26:15.888683 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:15.888648    2579 generic.go:356] "Generic (PLEG): container finished" podID="0c7c33de-6523-4cb1-8d36-57519999d8c7" containerID="b37aa7cebeb10728b4ad4112e40780f1c380eb0fc0f760b4366187b91a926fbd" exitCode=0
Jul 13 17:26:15.889052 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:15.888726    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v" event={"ID":"0c7c33de-6523-4cb1-8d36-57519999d8c7","Type":"ContainerDied","Data":"b37aa7cebeb10728b4ad4112e40780f1c380eb0fc0f760b4366187b91a926fbd"}
Jul 13 17:26:16.897867 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:16.897836    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v" event={"ID":"0c7c33de-6523-4cb1-8d36-57519999d8c7","Type":"ContainerStarted","Data":"4e6da5534c3ebbfe50bec3344f7f0f6d0c2696cf8c15529c24650994f8b59725"}
Jul 13 17:26:16.898327 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:16.897924    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:16.935477 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:16.935406    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v" podStartSLOduration=2.392866897 podStartE2EDuration="6.935383279s" totalImagesPullingTime="3.537285806s" totalInitContainerRuntime="1.005230576s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:26:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:26:16.935030131 +0000 UTC m=+537.587152758" watchObservedRunningTime="2026-07-13 17:26:16.935383279 +0000 UTC m=+537.587505909"
Jul 13 17:26:19.073706 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:19.073672    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:19.174393 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:19.174343    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:22.097846 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:22.097806    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:22.224225 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:22.224177    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:27.182186 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:27.182149    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:27.283583 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:27.283541    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:27.904317 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:27.904290    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v"
Jul 13 17:26:29.586280 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:29.586239    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:29.778461 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:29.778418    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:30.313655 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:30.313625    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sbgsv"]
Jul 13 17:26:30.322069 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:30.322047    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sbgsv"
Jul 13 17:26:30.327056 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:30.327042    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vnkln\""
Jul 13 17:26:30.328587 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:30.328570    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 13 17:26:30.350942 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:30.350910    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sbgsv"]
Jul 13 17:26:30.357943 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:30.357922    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ffb7\" (UniqueName: \"kubernetes.io/projected/87b9d2b2-7dce-4b69-bac3-86fa7f311981-kube-api-access-8ffb7\") pod \"odh-model-controller-7998c67dc4-sbgsv\" (UID: \"87b9d2b2-7dce-4b69-bac3-86fa7f311981\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbgsv"
Jul 13 17:26:30.358045 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:30.357976    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87b9d2b2-7dce-4b69-bac3-86fa7f311981-cert\") pod \"odh-model-controller-7998c67dc4-sbgsv\" (UID: \"87b9d2b2-7dce-4b69-bac3-86fa7f311981\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbgsv"
Jul 13 17:26:30.406308 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:30.406273    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:30.458515 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:30.458480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87b9d2b2-7dce-4b69-bac3-86fa7f311981-cert\") pod \"odh-model-controller-7998c67dc4-sbgsv\" (UID: \"87b9d2b2-7dce-4b69-bac3-86fa7f311981\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbgsv"
Jul 13 17:26:30.458671 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:30.458533    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ffb7\" (UniqueName: \"kubernetes.io/projected/87b9d2b2-7dce-4b69-bac3-86fa7f311981-kube-api-access-8ffb7\") pod \"odh-model-controller-7998c67dc4-sbgsv\" (UID: \"87b9d2b2-7dce-4b69-bac3-86fa7f311981\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbgsv"
Jul 13 17:26:30.458671 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:26:30.458636    2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 13 17:26:30.458740 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:26:30.458715    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87b9d2b2-7dce-4b69-bac3-86fa7f311981-cert podName:87b9d2b2-7dce-4b69-bac3-86fa7f311981 nodeName:}" failed. No retries permitted until 2026-07-13 17:26:30.958698334 +0000 UTC m=+551.610820937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/87b9d2b2-7dce-4b69-bac3-86fa7f311981-cert") pod "odh-model-controller-7998c67dc4-sbgsv" (UID: "87b9d2b2-7dce-4b69-bac3-86fa7f311981") : secret "odh-model-controller-webhook-cert" not found
Jul 13 17:26:30.486703 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:30.486673    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ffb7\" (UniqueName: \"kubernetes.io/projected/87b9d2b2-7dce-4b69-bac3-86fa7f311981-kube-api-access-8ffb7\") pod \"odh-model-controller-7998c67dc4-sbgsv\" (UID: \"87b9d2b2-7dce-4b69-bac3-86fa7f311981\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbgsv"
Jul 13 17:26:30.562264 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:30.562219    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:30.685143 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:30.685109    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:30.962058 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:30.961966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87b9d2b2-7dce-4b69-bac3-86fa7f311981-cert\") pod \"odh-model-controller-7998c67dc4-sbgsv\" (UID: \"87b9d2b2-7dce-4b69-bac3-86fa7f311981\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbgsv"
Jul 13 17:26:30.964425 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:30.964394    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87b9d2b2-7dce-4b69-bac3-86fa7f311981-cert\") pod \"odh-model-controller-7998c67dc4-sbgsv\" (UID: \"87b9d2b2-7dce-4b69-bac3-86fa7f311981\") " pod="opendatahub/odh-model-controller-7998c67dc4-sbgsv"
Jul 13 17:26:31.231831 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.231750    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sbgsv"
Jul 13 17:26:31.267680 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.267641    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:31.371090 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.371059    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sbgsv"]
Jul 13 17:26:31.374692 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:26:31.374666    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87b9d2b2_7dce_4b69_bac3_86fa7f311981.slice/crio-068c22dcd76cf458dad92b339cf5043a98f5b2ecffd2226f9206d2c0a367df0a WatchSource:0}: Error finding container 068c22dcd76cf458dad92b339cf5043a98f5b2ecffd2226f9206d2c0a367df0a: Status 404 returned error can't find the container with id 068c22dcd76cf458dad92b339cf5043a98f5b2ecffd2226f9206d2c0a367df0a
Jul 13 17:26:31.603832 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.603740    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:31.731880 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.731842    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:31.876633 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.876603    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v"]
Jul 13 17:26:31.880951 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.880932    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v"
Jul 13 17:26:31.900202 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.900181    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 13 17:26:31.900376 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.900360    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 17:26:31.900783 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.900759    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 13 17:26:31.914697 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.914675    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ckm7x\""
Jul 13 17:26:31.915210 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.915196    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 17:26:31.921213 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.921194    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v"]
Jul 13 17:26:31.952872 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.952843    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sbgsv" event={"ID":"87b9d2b2-7dce-4b69-bac3-86fa7f311981","Type":"ContainerStarted","Data":"068c22dcd76cf458dad92b339cf5043a98f5b2ecffd2226f9206d2c0a367df0a"}
Jul 13 17:26:31.970549 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.970524    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd8eb3a5-d860-4ffd-b82d-8327055b3c97-tls-certs\") pod \"kube-auth-proxy-65c65495b5-dkb6v\" (UID: \"fd8eb3a5-d860-4ffd-b82d-8327055b3c97\") " pod="openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v"
Jul 13 17:26:31.970664 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.970569    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzptc\" (UniqueName: \"kubernetes.io/projected/fd8eb3a5-d860-4ffd-b82d-8327055b3c97-kube-api-access-vzptc\") pod \"kube-auth-proxy-65c65495b5-dkb6v\" (UID: \"fd8eb3a5-d860-4ffd-b82d-8327055b3c97\") " pod="openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v"
Jul 13 17:26:31.970664 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:31.970599    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd8eb3a5-d860-4ffd-b82d-8327055b3c97-tmp\") pod \"kube-auth-proxy-65c65495b5-dkb6v\" (UID: \"fd8eb3a5-d860-4ffd-b82d-8327055b3c97\") " pod="openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v"
Jul 13 17:26:32.071749 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:32.071719    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd8eb3a5-d860-4ffd-b82d-8327055b3c97-tls-certs\") pod \"kube-auth-proxy-65c65495b5-dkb6v\" (UID: \"fd8eb3a5-d860-4ffd-b82d-8327055b3c97\") " pod="openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v"
Jul 13 17:26:32.071927 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:32.071766    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzptc\" (UniqueName: \"kubernetes.io/projected/fd8eb3a5-d860-4ffd-b82d-8327055b3c97-kube-api-access-vzptc\") pod \"kube-auth-proxy-65c65495b5-dkb6v\" (UID: \"fd8eb3a5-d860-4ffd-b82d-8327055b3c97\") " pod="openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v"
Jul 13 17:26:32.071927 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:32.071799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd8eb3a5-d860-4ffd-b82d-8327055b3c97-tmp\") pod \"kube-auth-proxy-65c65495b5-dkb6v\" (UID: \"fd8eb3a5-d860-4ffd-b82d-8327055b3c97\") " pod="openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v"
Jul 13 17:26:32.073985 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:32.073951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd8eb3a5-d860-4ffd-b82d-8327055b3c97-tmp\") pod \"kube-auth-proxy-65c65495b5-dkb6v\" (UID: \"fd8eb3a5-d860-4ffd-b82d-8327055b3c97\") " pod="openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v"
Jul 13 17:26:32.074310 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:32.074289    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd8eb3a5-d860-4ffd-b82d-8327055b3c97-tls-certs\") pod \"kube-auth-proxy-65c65495b5-dkb6v\" (UID: \"fd8eb3a5-d860-4ffd-b82d-8327055b3c97\") " pod="openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v"
Jul 13 17:26:32.084723 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:32.084695    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzptc\" (UniqueName: \"kubernetes.io/projected/fd8eb3a5-d860-4ffd-b82d-8327055b3c97-kube-api-access-vzptc\") pod \"kube-auth-proxy-65c65495b5-dkb6v\" (UID: \"fd8eb3a5-d860-4ffd-b82d-8327055b3c97\") " pod="openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v"
Jul 13 17:26:32.190050 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:32.189961    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v"
Jul 13 17:26:32.300265 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:32.300230    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:32.345676 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:32.345642    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v"]
Jul 13 17:26:32.349925 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:26:32.349900    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8eb3a5_d860_4ffd_b82d_8327055b3c97.slice/crio-bc5545f8ab3510ce8f5ce52016475893ff098d0ccb0b9842f36bf8ffb97ab4c7 WatchSource:0}: Error finding container bc5545f8ab3510ce8f5ce52016475893ff098d0ccb0b9842f36bf8ffb97ab4c7: Status 404 returned error can't find the container with id bc5545f8ab3510ce8f5ce52016475893ff098d0ccb0b9842f36bf8ffb97ab4c7
Jul 13 17:26:32.959331 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:32.959292    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v" event={"ID":"fd8eb3a5-d860-4ffd-b82d-8327055b3c97","Type":"ContainerStarted","Data":"bc5545f8ab3510ce8f5ce52016475893ff098d0ccb0b9842f36bf8ffb97ab4c7"}
Jul 13 17:26:33.468248 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:33.468195    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:33.564530 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:33.564488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:34.834480 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:34.834418    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:34.969407 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:34.969299    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sbgsv" event={"ID":"87b9d2b2-7dce-4b69-bac3-86fa7f311981","Type":"ContainerStarted","Data":"f9ea3a206b85d1f4ae06635390a1154c71153501f6e1bbf136f54c8527ad2c0c"}
Jul 13 17:26:34.969572 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:34.969494    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-sbgsv"
Jul 13 17:26:34.989734 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:34.989676    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-sbgsv" podStartSLOduration=1.689368848 podStartE2EDuration="4.989655245s" totalImagesPullingTime="3.300286397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:26:34.988669593 +0000 UTC m=+555.640792218" watchObservedRunningTime="2026-07-13 17:26:34.989655245 +0000 UTC m=+555.641777871"
Jul 13 17:26:35.472258 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:35.472229    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:35.572286 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:35.572255    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:35.974211 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:35.974177    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v" event={"ID":"fd8eb3a5-d860-4ffd-b82d-8327055b3c97","Type":"ContainerStarted","Data":"04709f81a151c09eeb9f15f62e8f0bd5ed1845fdc338573a7d173a175b05a33f"}
Jul 13 17:26:36.017022 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:36.016970    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65c65495b5-dkb6v" podStartSLOduration=1.8965400209999999 podStartE2EDuration="5.016952673s" totalImagesPullingTime="3.120412652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:26:36.012653757 +0000 UTC m=+556.664776382" watchObservedRunningTime="2026-07-13 17:26:36.016952673 +0000 UTC m=+556.669075297"
Jul 13 17:26:37.799827 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:37.799795    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:38.580944 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.580869    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"]
Jul 13 17:26:38.584091 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.584068    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:38.588169 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.588149    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 13 17:26:38.589005 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.588989    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 17:26:38.589924 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.589904    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 13 17:26:38.589991 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.589908    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:26:38.589991 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.589908    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 13 17:26:38.610513 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.610493    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r4m7d\""
Jul 13 17:26:38.616334 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.616313    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"]
Jul 13 17:26:38.622330 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.622309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f44635a6-1d4d-4261-beef-d057708d010d-manager-config\") pod \"lws-controller-manager-5df8bf697-7r8nw\" (UID: \"f44635a6-1d4d-4261-beef-d057708d010d\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:38.622436 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.622338    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f44635a6-1d4d-4261-beef-d057708d010d-metrics-cert\") pod \"lws-controller-manager-5df8bf697-7r8nw\" (UID: \"f44635a6-1d4d-4261-beef-d057708d010d\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:38.622436 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.622398    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl5wz\" (UniqueName: \"kubernetes.io/projected/f44635a6-1d4d-4261-beef-d057708d010d-kube-api-access-zl5wz\") pod \"lws-controller-manager-5df8bf697-7r8nw\" (UID: \"f44635a6-1d4d-4261-beef-d057708d010d\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:38.622510 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.622442    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f44635a6-1d4d-4261-beef-d057708d010d-cert\") pod \"lws-controller-manager-5df8bf697-7r8nw\" (UID: \"f44635a6-1d4d-4261-beef-d057708d010d\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:38.723689 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.723653    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f44635a6-1d4d-4261-beef-d057708d010d-manager-config\") pod \"lws-controller-manager-5df8bf697-7r8nw\" (UID: \"f44635a6-1d4d-4261-beef-d057708d010d\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:38.723689 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.723687    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f44635a6-1d4d-4261-beef-d057708d010d-metrics-cert\") pod \"lws-controller-manager-5df8bf697-7r8nw\" (UID: \"f44635a6-1d4d-4261-beef-d057708d010d\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:38.723868 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.723719    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl5wz\" (UniqueName: \"kubernetes.io/projected/f44635a6-1d4d-4261-beef-d057708d010d-kube-api-access-zl5wz\") pod \"lws-controller-manager-5df8bf697-7r8nw\" (UID: \"f44635a6-1d4d-4261-beef-d057708d010d\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:38.723868 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.723755    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f44635a6-1d4d-4261-beef-d057708d010d-cert\") pod \"lws-controller-manager-5df8bf697-7r8nw\" (UID: \"f44635a6-1d4d-4261-beef-d057708d010d\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:38.724447 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.724422    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f44635a6-1d4d-4261-beef-d057708d010d-manager-config\") pod \"lws-controller-manager-5df8bf697-7r8nw\" (UID: \"f44635a6-1d4d-4261-beef-d057708d010d\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:38.726294 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.726273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f44635a6-1d4d-4261-beef-d057708d010d-cert\") pod \"lws-controller-manager-5df8bf697-7r8nw\" (UID: \"f44635a6-1d4d-4261-beef-d057708d010d\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:38.726402 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.726332    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f44635a6-1d4d-4261-beef-d057708d010d-metrics-cert\") pod \"lws-controller-manager-5df8bf697-7r8nw\" (UID: \"f44635a6-1d4d-4261-beef-d057708d010d\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:38.736693 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.736664    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl5wz\" (UniqueName: \"kubernetes.io/projected/f44635a6-1d4d-4261-beef-d057708d010d-kube-api-access-zl5wz\") pod \"lws-controller-manager-5df8bf697-7r8nw\" (UID: \"f44635a6-1d4d-4261-beef-d057708d010d\") " pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:38.893438 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:38.893407    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:39.021150 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:39.021095    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"]
Jul 13 17:26:39.023951 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:26:39.023926    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf44635a6_1d4d_4261_beef_d057708d010d.slice/crio-35855405ee33586c1df04273a231503111cb3abd35a8e87a07ede67925086afe WatchSource:0}: Error finding container 35855405ee33586c1df04273a231503111cb3abd35a8e87a07ede67925086afe: Status 404 returned error can't find the container with id 35855405ee33586c1df04273a231503111cb3abd35a8e87a07ede67925086afe
Jul 13 17:26:39.992016 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:39.991977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw" event={"ID":"f44635a6-1d4d-4261-beef-d057708d010d","Type":"ContainerStarted","Data":"35855405ee33586c1df04273a231503111cb3abd35a8e87a07ede67925086afe"}
Jul 13 17:26:40.036957 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:40.036898    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:42.000956 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:42.000913    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw" event={"ID":"f44635a6-1d4d-4261-beef-d057708d010d","Type":"ContainerStarted","Data":"4ca2bcc39d60dc75904c4c2d9ff96f74c58366f8853762cec360c3caf6972035"}
Jul 13 17:26:42.001379 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:42.001053    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:42.056823 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:42.056768    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw" podStartSLOduration=1.813294773 podStartE2EDuration="4.056751358s" totalImagesPullingTime="2.243456585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:26:42.048321551 +0000 UTC m=+562.700444177" watchObservedRunningTime="2026-07-13 17:26:42.056751358 +0000 UTC m=+562.708873980"
Jul 13 17:26:43.331029 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:43.330995    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:43.473175 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:43.473140    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:43.758900 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:43.758862    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:43.997225 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:43.997179    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:44.122730 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:44.122698    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:26:45.976624 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:45.976594    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-sbgsv"
Jul 13 17:26:53.006850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:53.006819    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5df8bf697-7r8nw"
Jul 13 17:26:56.938293 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:26:56.938253    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:27:19.805727 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:27:19.805699    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:27:19.806242 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:27:19.805699    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:27:31.045550 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:27:31.045510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:27:31.116600 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:27:31.116569    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:27:31.232855 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:27:31.232821    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:27:54.969859 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:27:54.969822    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:27:58.405769 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:27:58.405730    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:27:58.967404 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:27:58.967361    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:00.030899 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:00.030863    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:01.804385 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:01.804338    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:03.161939 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:03.161899    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:04.605640 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:04.605609    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:05.763266 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:05.763228    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:07.661445 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:07.661414    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:10.787626 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:10.787592    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:10.882527 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:10.882491    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:15.966333 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:15.966297    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:16.064491 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:16.064449    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:16.169918 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:16.169876    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:16.270744 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:16.270652    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:18.580897 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:18.580861    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:18.682595 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:18.682563    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:19.653422 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:19.653382    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:19.981909 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:19.981816    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:22.118215 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:22.118172    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:22.218309 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:22.218277    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:28.873235 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:28.873194    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:29.054872 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:29.054834    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:30.130710 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:30.130665    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"]
Jul 13 17:28:30.132808 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:30.132792    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"
Jul 13 17:28:30.135134 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:30.135108    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 17:28:30.135937 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:30.135919    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 17:28:30.136030 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:30.135966    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t6clk\""
Jul 13 17:28:30.150402 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:30.150375    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"]
Jul 13 17:28:30.243120 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:30.243081    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d0287f1-25a5-4ad0-a62e-c238f498312e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-nw8bs\" (UID: \"5d0287f1-25a5-4ad0-a62e-c238f498312e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"
Jul 13 17:28:30.243281 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:30.243194    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77tm7\" (UniqueName: \"kubernetes.io/projected/5d0287f1-25a5-4ad0-a62e-c238f498312e-kube-api-access-77tm7\") pod \"kuadrant-operator-controller-manager-55467d9f7-nw8bs\" (UID: \"5d0287f1-25a5-4ad0-a62e-c238f498312e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"
Jul 13 17:28:30.344420 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:30.344375    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77tm7\" (UniqueName: \"kubernetes.io/projected/5d0287f1-25a5-4ad0-a62e-c238f498312e-kube-api-access-77tm7\") pod \"kuadrant-operator-controller-manager-55467d9f7-nw8bs\" (UID: \"5d0287f1-25a5-4ad0-a62e-c238f498312e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"
Jul 13 17:28:30.344614 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:30.344461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d0287f1-25a5-4ad0-a62e-c238f498312e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-nw8bs\" (UID: \"5d0287f1-25a5-4ad0-a62e-c238f498312e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"
Jul 13 17:28:30.344844 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:30.344824    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d0287f1-25a5-4ad0-a62e-c238f498312e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-nw8bs\" (UID: \"5d0287f1-25a5-4ad0-a62e-c238f498312e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"
Jul 13 17:28:30.356130 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:30.356106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77tm7\" (UniqueName: \"kubernetes.io/projected/5d0287f1-25a5-4ad0-a62e-c238f498312e-kube-api-access-77tm7\") pod \"kuadrant-operator-controller-manager-55467d9f7-nw8bs\" (UID: \"5d0287f1-25a5-4ad0-a62e-c238f498312e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"
Jul 13 17:28:30.443010 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:30.442920    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"
Jul 13 17:28:30.575825 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:30.575798    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"]
Jul 13 17:28:30.578231 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:28:30.578208    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d0287f1_25a5_4ad0_a62e_c238f498312e.slice/crio-800c47f5e50a59e18109c7c7eef4c107e3d059f06068a822ff04fbcf3801e81b WatchSource:0}: Error finding container 800c47f5e50a59e18109c7c7eef4c107e3d059f06068a822ff04fbcf3801e81b: Status 404 returned error can't find the container with id 800c47f5e50a59e18109c7c7eef4c107e3d059f06068a822ff04fbcf3801e81b
Jul 13 17:28:31.393859 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:31.393815    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs" event={"ID":"5d0287f1-25a5-4ad0-a62e-c238f498312e","Type":"ContainerStarted","Data":"800c47f5e50a59e18109c7c7eef4c107e3d059f06068a822ff04fbcf3801e81b"}
Jul 13 17:28:34.156802 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:34.156770    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:34.368901 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:34.368864    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:34.571870 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:34.571769    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:34.638660 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:34.638619    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:36.414581 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:36.414550    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs" event={"ID":"5d0287f1-25a5-4ad0-a62e-c238f498312e","Type":"ContainerStarted","Data":"a024990de85dfb01bf49d99e3c5b4e9925df0259a56d4554fb8458d7b5a04a63"}
Jul 13 17:28:36.414959 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:36.414688    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"
Jul 13 17:28:36.435945 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:36.435884    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs" podStartSLOduration=1.087841232 podStartE2EDuration="6.4358655s" totalImagesPullingTime="5.348024268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:28:36.434661157 +0000 UTC m=+677.086783782" watchObservedRunningTime="2026-07-13 17:28:36.4358655 +0000 UTC m=+677.087988118"
Jul 13 17:28:37.961977 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:37.961927    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:38.077769 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:38.077735    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:40.568861 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:40.568820    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:40.705543 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:40.705503    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:47.357570 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:47.357533    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:47.421365 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:47.421327    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"
Jul 13 17:28:47.438272 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:47.438244    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:58.337715 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:58.337676    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:58.436458 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:58.436425    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:58.505593 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:58.505563    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:28:59.449936 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:59.449900    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"]
Jul 13 17:28:59.450318 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:59.450093    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs" podUID="5d0287f1-25a5-4ad0-a62e-c238f498312e" containerName="manager" containerID="cri-o://a024990de85dfb01bf49d99e3c5b4e9925df0259a56d4554fb8458d7b5a04a63" gracePeriod=10
Jul 13 17:28:59.686567 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:59.686546    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"
Jul 13 17:28:59.778868 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:59.778773    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d0287f1-25a5-4ad0-a62e-c238f498312e-extensions-socket-volume\") pod \"5d0287f1-25a5-4ad0-a62e-c238f498312e\" (UID: \"5d0287f1-25a5-4ad0-a62e-c238f498312e\") "
Jul 13 17:28:59.778868 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:59.778840    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77tm7\" (UniqueName: \"kubernetes.io/projected/5d0287f1-25a5-4ad0-a62e-c238f498312e-kube-api-access-77tm7\") pod \"5d0287f1-25a5-4ad0-a62e-c238f498312e\" (UID: \"5d0287f1-25a5-4ad0-a62e-c238f498312e\") "
Jul 13 17:28:59.779326 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:59.779292    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d0287f1-25a5-4ad0-a62e-c238f498312e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5d0287f1-25a5-4ad0-a62e-c238f498312e" (UID: "5d0287f1-25a5-4ad0-a62e-c238f498312e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:28:59.780939 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:59.780916    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d0287f1-25a5-4ad0-a62e-c238f498312e-kube-api-access-77tm7" (OuterVolumeSpecName: "kube-api-access-77tm7") pod "5d0287f1-25a5-4ad0-a62e-c238f498312e" (UID: "5d0287f1-25a5-4ad0-a62e-c238f498312e"). InnerVolumeSpecName "kube-api-access-77tm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:28:59.880294 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:59.880248    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d0287f1-25a5-4ad0-a62e-c238f498312e-extensions-socket-volume\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:28:59.880294 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:28:59.880284    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77tm7\" (UniqueName: \"kubernetes.io/projected/5d0287f1-25a5-4ad0-a62e-c238f498312e-kube-api-access-77tm7\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:29:00.505992 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:00.505961    2579 generic.go:356] "Generic (PLEG): container finished" podID="5d0287f1-25a5-4ad0-a62e-c238f498312e" containerID="a024990de85dfb01bf49d99e3c5b4e9925df0259a56d4554fb8458d7b5a04a63" exitCode=0
Jul 13 17:29:00.506437 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:00.506005    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"
Jul 13 17:29:00.506437 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:00.506028    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs" event={"ID":"5d0287f1-25a5-4ad0-a62e-c238f498312e","Type":"ContainerDied","Data":"a024990de85dfb01bf49d99e3c5b4e9925df0259a56d4554fb8458d7b5a04a63"}
Jul 13 17:29:00.506437 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:00.506069    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs" event={"ID":"5d0287f1-25a5-4ad0-a62e-c238f498312e","Type":"ContainerDied","Data":"800c47f5e50a59e18109c7c7eef4c107e3d059f06068a822ff04fbcf3801e81b"}
Jul 13 17:29:00.506437 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:00.506091    2579 scope.go:117] "RemoveContainer" containerID="a024990de85dfb01bf49d99e3c5b4e9925df0259a56d4554fb8458d7b5a04a63"
Jul 13 17:29:00.514163 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:00.514143    2579 scope.go:117] "RemoveContainer" containerID="a024990de85dfb01bf49d99e3c5b4e9925df0259a56d4554fb8458d7b5a04a63"
Jul 13 17:29:00.514464 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:29:00.514443    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a024990de85dfb01bf49d99e3c5b4e9925df0259a56d4554fb8458d7b5a04a63\": container with ID starting with a024990de85dfb01bf49d99e3c5b4e9925df0259a56d4554fb8458d7b5a04a63 not found: ID does not exist" containerID="a024990de85dfb01bf49d99e3c5b4e9925df0259a56d4554fb8458d7b5a04a63"
Jul 13 17:29:00.514544 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:00.514477    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a024990de85dfb01bf49d99e3c5b4e9925df0259a56d4554fb8458d7b5a04a63"} err="failed to get container status \"a024990de85dfb01bf49d99e3c5b4e9925df0259a56d4554fb8458d7b5a04a63\": rpc error: code = NotFound desc = could not find container \"a024990de85dfb01bf49d99e3c5b4e9925df0259a56d4554fb8458d7b5a04a63\": container with ID starting with a024990de85dfb01bf49d99e3c5b4e9925df0259a56d4554fb8458d7b5a04a63 not found: ID does not exist"
Jul 13 17:29:00.531262 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:00.531234    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"]
Jul 13 17:29:00.535196 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:00.535174    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-nw8bs"]
Jul 13 17:29:02.074165 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:02.074131    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d0287f1-25a5-4ad0-a62e-c238f498312e" path="/var/lib/kubelet/pods/5d0287f1-25a5-4ad0-a62e-c238f498312e/volumes"
Jul 13 17:29:03.939998 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:03.939954    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:04.544041 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:04.544001    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:08.100861 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.100814    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:08.199175 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.199141    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:08.266243 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.266202    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:08.515493 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.515450    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:29:08.516024 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.516001    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d0287f1-25a5-4ad0-a62e-c238f498312e" containerName="manager"
Jul 13 17:29:08.516118 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.516029    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d0287f1-25a5-4ad0-a62e-c238f498312e" containerName="manager"
Jul 13 17:29:08.516184 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.516172    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d0287f1-25a5-4ad0-a62e-c238f498312e" containerName="manager"
Jul 13 17:29:08.527169 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.527143    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:29:08.527317 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.527241    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ftw68"
Jul 13 17:29:08.529783 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.529760    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 17:29:08.529906 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.529765    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 13 17:29:08.530605 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.530588    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4rw67\""
Jul 13 17:29:08.530707 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.530590    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 17:29:08.545020 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.544993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7-config-file\") pod \"limitador-limitador-54d6d988d5-ftw68\" (UID: \"c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ftw68"
Jul 13 17:29:08.545116 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.545035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhv54\" (UniqueName: \"kubernetes.io/projected/c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7-kube-api-access-zhv54\") pod \"limitador-limitador-54d6d988d5-ftw68\" (UID: \"c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ftw68"
Jul 13 17:29:08.565458 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.565432    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:29:08.646220 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.646190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhv54\" (UniqueName: \"kubernetes.io/projected/c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7-kube-api-access-zhv54\") pod \"limitador-limitador-54d6d988d5-ftw68\" (UID: \"c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ftw68"
Jul 13 17:29:08.646395 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.646242    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7-config-file\") pod \"limitador-limitador-54d6d988d5-ftw68\" (UID: \"c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ftw68"
Jul 13 17:29:08.646827 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.646808    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7-config-file\") pod \"limitador-limitador-54d6d988d5-ftw68\" (UID: \"c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ftw68"
Jul 13 17:29:08.654532 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.654514    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhv54\" (UniqueName: \"kubernetes.io/projected/c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7-kube-api-access-zhv54\") pod \"limitador-limitador-54d6d988d5-ftw68\" (UID: \"c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-ftw68"
Jul 13 17:29:08.838848 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.838756    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-ftw68"
Jul 13 17:29:08.920850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.920821    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-xjthn"]
Jul 13 17:29:08.923600 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.923577    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xjthn"
Jul 13 17:29:08.925900 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.925874    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lbvw7\""
Jul 13 17:29:08.929676 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.929651    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xjthn"]
Jul 13 17:29:08.947327 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.947300    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cxks\" (UniqueName: \"kubernetes.io/projected/cfb8232b-3de7-4051-9244-5e5c7942be97-kube-api-access-7cxks\") pod \"authorino-58cd955675-xjthn\" (UID: \"cfb8232b-3de7-4051-9244-5e5c7942be97\") " pod="kuadrant-system/authorino-58cd955675-xjthn"
Jul 13 17:29:08.958898 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.958865    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:08.967990 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.967963    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:29:08.970371 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:29:08.970335    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f22c1d_28d2_48b5_91c4_8a4f1c9e13e7.slice/crio-67a4c2274ad70396d936d0f956d9b9244e6c58e2b9346757c0cb188c89b2942a WatchSource:0}: Error finding container 67a4c2274ad70396d936d0f956d9b9244e6c58e2b9346757c0cb188c89b2942a: Status 404 returned error can't find the container with id 67a4c2274ad70396d936d0f956d9b9244e6c58e2b9346757c0cb188c89b2942a
Jul 13 17:29:08.972187 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:08.972166    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:29:09.048088 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:09.048058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cxks\" (UniqueName: \"kubernetes.io/projected/cfb8232b-3de7-4051-9244-5e5c7942be97-kube-api-access-7cxks\") pod \"authorino-58cd955675-xjthn\" (UID: \"cfb8232b-3de7-4051-9244-5e5c7942be97\") " pod="kuadrant-system/authorino-58cd955675-xjthn"
Jul 13 17:29:09.063063 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:09.063034    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:09.065546 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:09.065518    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cxks\" (UniqueName: \"kubernetes.io/projected/cfb8232b-3de7-4051-9244-5e5c7942be97-kube-api-access-7cxks\") pod \"authorino-58cd955675-xjthn\" (UID: \"cfb8232b-3de7-4051-9244-5e5c7942be97\") " pod="kuadrant-system/authorino-58cd955675-xjthn"
Jul 13 17:29:09.234451 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:09.234417    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xjthn"
Jul 13 17:29:09.358225 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:09.358192    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xjthn"]
Jul 13 17:29:09.361023 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:29:09.360995    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfb8232b_3de7_4051_9244_5e5c7942be97.slice/crio-73df746216edd0e83a6fc7c125e93ac8a08d2fadddf0b9e5c76fdc6e6f9fb17c WatchSource:0}: Error finding container 73df746216edd0e83a6fc7c125e93ac8a08d2fadddf0b9e5c76fdc6e6f9fb17c: Status 404 returned error can't find the container with id 73df746216edd0e83a6fc7c125e93ac8a08d2fadddf0b9e5c76fdc6e6f9fb17c
Jul 13 17:29:09.544983 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:09.544871    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xjthn" event={"ID":"cfb8232b-3de7-4051-9244-5e5c7942be97","Type":"ContainerStarted","Data":"73df746216edd0e83a6fc7c125e93ac8a08d2fadddf0b9e5c76fdc6e6f9fb17c"}
Jul 13 17:29:09.546559 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:09.546522    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ftw68" event={"ID":"c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7","Type":"ContainerStarted","Data":"67a4c2274ad70396d936d0f956d9b9244e6c58e2b9346757c0cb188c89b2942a"}
Jul 13 17:29:13.566413 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:13.566298    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-ftw68" event={"ID":"c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7","Type":"ContainerStarted","Data":"8d2000fdfbede7c940d557e4243f51b872ceb705659fc234a33c9c0e4147f125"}
Jul 13 17:29:13.566413 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:13.566386    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ftw68"
Jul 13 17:29:13.567747 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:13.567726    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xjthn" event={"ID":"cfb8232b-3de7-4051-9244-5e5c7942be97","Type":"ContainerStarted","Data":"64a97ca816725b585097943361e014943b5efc8bd0f81e54a868076a450cee56"}
Jul 13 17:29:13.594333 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:13.594283    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-ftw68" podStartSLOduration=1.295558045 podStartE2EDuration="5.594271358s" totalImagesPullingTime="4.298713313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:29:13.5937075 +0000 UTC m=+714.245830125" watchObservedRunningTime="2026-07-13 17:29:13.594271358 +0000 UTC m=+714.246393984"
Jul 13 17:29:13.615138 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:13.615094    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-xjthn" podStartSLOduration=1.70416341 podStartE2EDuration="5.615082225s" totalImagesPullingTime="3.910918815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:29:13.613476654 +0000 UTC m=+714.265599277" watchObservedRunningTime="2026-07-13 17:29:13.615082225 +0000 UTC m=+714.267204850"
Jul 13 17:29:14.667692 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:14.667656    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:15.271009 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:15.270975    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xjthn"]
Jul 13 17:29:15.575417 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:15.575313    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-xjthn" podUID="cfb8232b-3de7-4051-9244-5e5c7942be97" containerName="authorino" containerID="cri-o://64a97ca816725b585097943361e014943b5efc8bd0f81e54a868076a450cee56" gracePeriod=30
Jul 13 17:29:15.827386 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:15.827325    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xjthn"
Jul 13 17:29:15.904090 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:15.904053    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cxks\" (UniqueName: \"kubernetes.io/projected/cfb8232b-3de7-4051-9244-5e5c7942be97-kube-api-access-7cxks\") pod \"cfb8232b-3de7-4051-9244-5e5c7942be97\" (UID: \"cfb8232b-3de7-4051-9244-5e5c7942be97\") "
Jul 13 17:29:15.906109 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:15.906085    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfb8232b-3de7-4051-9244-5e5c7942be97-kube-api-access-7cxks" (OuterVolumeSpecName: "kube-api-access-7cxks") pod "cfb8232b-3de7-4051-9244-5e5c7942be97" (UID: "cfb8232b-3de7-4051-9244-5e5c7942be97"). InnerVolumeSpecName "kube-api-access-7cxks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:29:16.004897 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:16.004856    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cxks\" (UniqueName: \"kubernetes.io/projected/cfb8232b-3de7-4051-9244-5e5c7942be97-kube-api-access-7cxks\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:29:16.579808 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:16.579775    2579 generic.go:356] "Generic (PLEG): container finished" podID="cfb8232b-3de7-4051-9244-5e5c7942be97" containerID="64a97ca816725b585097943361e014943b5efc8bd0f81e54a868076a450cee56" exitCode=0
Jul 13 17:29:16.579976 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:16.579825    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xjthn"
Jul 13 17:29:16.579976 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:16.579860    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xjthn" event={"ID":"cfb8232b-3de7-4051-9244-5e5c7942be97","Type":"ContainerDied","Data":"64a97ca816725b585097943361e014943b5efc8bd0f81e54a868076a450cee56"}
Jul 13 17:29:16.579976 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:16.579904    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xjthn" event={"ID":"cfb8232b-3de7-4051-9244-5e5c7942be97","Type":"ContainerDied","Data":"73df746216edd0e83a6fc7c125e93ac8a08d2fadddf0b9e5c76fdc6e6f9fb17c"}
Jul 13 17:29:16.579976 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:16.579921    2579 scope.go:117] "RemoveContainer" containerID="64a97ca816725b585097943361e014943b5efc8bd0f81e54a868076a450cee56"
Jul 13 17:29:16.587574 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:16.587559    2579 scope.go:117] "RemoveContainer" containerID="64a97ca816725b585097943361e014943b5efc8bd0f81e54a868076a450cee56"
Jul 13 17:29:16.587816 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:29:16.587796    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64a97ca816725b585097943361e014943b5efc8bd0f81e54a868076a450cee56\": container with ID starting with 64a97ca816725b585097943361e014943b5efc8bd0f81e54a868076a450cee56 not found: ID does not exist" containerID="64a97ca816725b585097943361e014943b5efc8bd0f81e54a868076a450cee56"
Jul 13 17:29:16.587861 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:16.587825    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a97ca816725b585097943361e014943b5efc8bd0f81e54a868076a450cee56"} err="failed to get container status \"64a97ca816725b585097943361e014943b5efc8bd0f81e54a868076a450cee56\": rpc error: code = NotFound desc = could not find container \"64a97ca816725b585097943361e014943b5efc8bd0f81e54a868076a450cee56\": container with ID starting with 64a97ca816725b585097943361e014943b5efc8bd0f81e54a868076a450cee56 not found: ID does not exist"
Jul 13 17:29:16.595341 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:16.595299    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xjthn"]
Jul 13 17:29:16.598808 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:16.598788    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-xjthn"]
Jul 13 17:29:18.070322 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:18.070284    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfb8232b-3de7-4051-9244-5e5c7942be97" path="/var/lib/kubelet/pods/cfb8232b-3de7-4051-9244-5e5c7942be97/volumes"
Jul 13 17:29:24.572235 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:24.572202    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-ftw68"
Jul 13 17:29:26.994364 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:26.994328    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:27.093701 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:27.093666    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:27.555933 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:27.555899    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:39.706053 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:39.706016    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:39.987806 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:39.987732    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qlbnk"]
Jul 13 17:29:39.988003 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:39.987991    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfb8232b-3de7-4051-9244-5e5c7942be97" containerName="authorino"
Jul 13 17:29:39.988044 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:39.988004    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfb8232b-3de7-4051-9244-5e5c7942be97" containerName="authorino"
Jul 13 17:29:39.988084 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:39.988062    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfb8232b-3de7-4051-9244-5e5c7942be97" containerName="authorino"
Jul 13 17:29:39.990845 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:39.990829    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qlbnk"
Jul 13 17:29:39.993337 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:39.993322    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lbvw7\""
Jul 13 17:29:39.998228 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:39.998203    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qlbnk"]
Jul 13 17:29:40.080105 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.080067    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zpdh\" (UniqueName: \"kubernetes.io/projected/2f5b983b-68cc-42fd-b639-a4ae21bfbc28-kube-api-access-2zpdh\") pod \"authorino-5d4b67c446-qlbnk\" (UID: \"2f5b983b-68cc-42fd-b639-a4ae21bfbc28\") " pod="kuadrant-system/authorino-5d4b67c446-qlbnk"
Jul 13 17:29:40.180916 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.180876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zpdh\" (UniqueName: \"kubernetes.io/projected/2f5b983b-68cc-42fd-b639-a4ae21bfbc28-kube-api-access-2zpdh\") pod \"authorino-5d4b67c446-qlbnk\" (UID: \"2f5b983b-68cc-42fd-b639-a4ae21bfbc28\") " pod="kuadrant-system/authorino-5d4b67c446-qlbnk"
Jul 13 17:29:40.189476 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.189445    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zpdh\" (UniqueName: \"kubernetes.io/projected/2f5b983b-68cc-42fd-b639-a4ae21bfbc28-kube-api-access-2zpdh\") pod \"authorino-5d4b67c446-qlbnk\" (UID: \"2f5b983b-68cc-42fd-b639-a4ae21bfbc28\") " pod="kuadrant-system/authorino-5d4b67c446-qlbnk"
Jul 13 17:29:40.299266 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.299188    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qlbnk"
Jul 13 17:29:40.304498 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.304416    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:40.430935 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.430900    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qlbnk"]
Jul 13 17:29:40.460169 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.460137    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6657c86579-zpnq7"]
Jul 13 17:29:40.462457 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.462431    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6657c86579-zpnq7"
Jul 13 17:29:40.463103 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.463080    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qlbnk"]
Jul 13 17:29:40.464792 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.464772    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 13 17:29:40.466132 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:29:40.466111    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f5b983b_68cc_42fd_b639_a4ae21bfbc28.slice/crio-d01e90bca17bcb3db3a8ff59030eb143389dd8ab20ca4a89d46bf000857da977 WatchSource:0}: Error finding container d01e90bca17bcb3db3a8ff59030eb143389dd8ab20ca4a89d46bf000857da977: Status 404 returned error can't find the container with id d01e90bca17bcb3db3a8ff59030eb143389dd8ab20ca4a89d46bf000857da977
Jul 13 17:29:40.471040 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.471016    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6657c86579-zpnq7"]
Jul 13 17:29:40.583068 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.582967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65hvr\" (UniqueName: \"kubernetes.io/projected/158de252-4406-450d-b9d6-5f550bef986c-kube-api-access-65hvr\") pod \"authorino-6657c86579-zpnq7\" (UID: \"158de252-4406-450d-b9d6-5f550bef986c\") " pod="kuadrant-system/authorino-6657c86579-zpnq7"
Jul 13 17:29:40.583222 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.583096    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/158de252-4406-450d-b9d6-5f550bef986c-tls-cert\") pod \"authorino-6657c86579-zpnq7\" (UID: \"158de252-4406-450d-b9d6-5f550bef986c\") " pod="kuadrant-system/authorino-6657c86579-zpnq7"
Jul 13 17:29:40.673189 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.673157    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qlbnk" event={"ID":"2f5b983b-68cc-42fd-b639-a4ae21bfbc28","Type":"ContainerStarted","Data":"d01e90bca17bcb3db3a8ff59030eb143389dd8ab20ca4a89d46bf000857da977"}
Jul 13 17:29:40.683477 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.683453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/158de252-4406-450d-b9d6-5f550bef986c-tls-cert\") pod \"authorino-6657c86579-zpnq7\" (UID: \"158de252-4406-450d-b9d6-5f550bef986c\") " pod="kuadrant-system/authorino-6657c86579-zpnq7"
Jul 13 17:29:40.683558 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.683499    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65hvr\" (UniqueName: \"kubernetes.io/projected/158de252-4406-450d-b9d6-5f550bef986c-kube-api-access-65hvr\") pod \"authorino-6657c86579-zpnq7\" (UID: \"158de252-4406-450d-b9d6-5f550bef986c\") " pod="kuadrant-system/authorino-6657c86579-zpnq7"
Jul 13 17:29:40.685955 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.685924    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/158de252-4406-450d-b9d6-5f550bef986c-tls-cert\") pod \"authorino-6657c86579-zpnq7\" (UID: \"158de252-4406-450d-b9d6-5f550bef986c\") " pod="kuadrant-system/authorino-6657c86579-zpnq7"
Jul 13 17:29:40.691827 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.691808    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65hvr\" (UniqueName: \"kubernetes.io/projected/158de252-4406-450d-b9d6-5f550bef986c-kube-api-access-65hvr\") pod \"authorino-6657c86579-zpnq7\" (UID: \"158de252-4406-450d-b9d6-5f550bef986c\") " pod="kuadrant-system/authorino-6657c86579-zpnq7"
Jul 13 17:29:40.778938 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.778904    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6657c86579-zpnq7"
Jul 13 17:29:40.902141 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:40.902111    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6657c86579-zpnq7"]
Jul 13 17:29:40.904537 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:29:40.904503    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod158de252_4406_450d_b9d6_5f550bef986c.slice/crio-a508a6d7c10c4fa4530d8186c8307ea11f028f3aecae6f571f6677e4822b709a WatchSource:0}: Error finding container a508a6d7c10c4fa4530d8186c8307ea11f028f3aecae6f571f6677e4822b709a: Status 404 returned error can't find the container with id a508a6d7c10c4fa4530d8186c8307ea11f028f3aecae6f571f6677e4822b709a
Jul 13 17:29:41.678849 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:41.678811    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qlbnk" event={"ID":"2f5b983b-68cc-42fd-b639-a4ae21bfbc28","Type":"ContainerStarted","Data":"ccde41c95891f386a6c304e0253aebf5b6e2db8e56c8695c323ae61e96b82857"}
Jul 13 17:29:41.679057 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:41.678886    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-qlbnk" podUID="2f5b983b-68cc-42fd-b639-a4ae21bfbc28" containerName="authorino" containerID="cri-o://ccde41c95891f386a6c304e0253aebf5b6e2db8e56c8695c323ae61e96b82857" gracePeriod=30
Jul 13 17:29:41.680071 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:41.680046    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6657c86579-zpnq7" event={"ID":"158de252-4406-450d-b9d6-5f550bef986c","Type":"ContainerStarted","Data":"a508a6d7c10c4fa4530d8186c8307ea11f028f3aecae6f571f6677e4822b709a"}
Jul 13 17:29:41.693802 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:41.693760    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-qlbnk" podStartSLOduration=2.233718358 podStartE2EDuration="2.693747247s" totalImagesPullingTime="460.028889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:29:41.693446186 +0000 UTC m=+742.345568803" watchObservedRunningTime="2026-07-13 17:29:41.693747247 +0000 UTC m=+742.345869849"
Jul 13 17:29:41.920251 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:41.920225    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qlbnk"
Jul 13 17:29:41.993871 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:41.993794    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zpdh\" (UniqueName: \"kubernetes.io/projected/2f5b983b-68cc-42fd-b639-a4ae21bfbc28-kube-api-access-2zpdh\") pod \"2f5b983b-68cc-42fd-b639-a4ae21bfbc28\" (UID: \"2f5b983b-68cc-42fd-b639-a4ae21bfbc28\") "
Jul 13 17:29:41.995827 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:41.995800    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f5b983b-68cc-42fd-b639-a4ae21bfbc28-kube-api-access-2zpdh" (OuterVolumeSpecName: "kube-api-access-2zpdh") pod "2f5b983b-68cc-42fd-b639-a4ae21bfbc28" (UID: "2f5b983b-68cc-42fd-b639-a4ae21bfbc28"). InnerVolumeSpecName "kube-api-access-2zpdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:29:42.094265 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:42.094240    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zpdh\" (UniqueName: \"kubernetes.io/projected/2f5b983b-68cc-42fd-b639-a4ae21bfbc28-kube-api-access-2zpdh\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:29:42.685213 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:42.685177    2579 generic.go:356] "Generic (PLEG): container finished" podID="2f5b983b-68cc-42fd-b639-a4ae21bfbc28" containerID="ccde41c95891f386a6c304e0253aebf5b6e2db8e56c8695c323ae61e96b82857" exitCode=0
Jul 13 17:29:42.685433 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:42.685219    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qlbnk"
Jul 13 17:29:42.685433 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:42.685253    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qlbnk" event={"ID":"2f5b983b-68cc-42fd-b639-a4ae21bfbc28","Type":"ContainerDied","Data":"ccde41c95891f386a6c304e0253aebf5b6e2db8e56c8695c323ae61e96b82857"}
Jul 13 17:29:42.685433 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:42.685289    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qlbnk" event={"ID":"2f5b983b-68cc-42fd-b639-a4ae21bfbc28","Type":"ContainerDied","Data":"d01e90bca17bcb3db3a8ff59030eb143389dd8ab20ca4a89d46bf000857da977"}
Jul 13 17:29:42.685433 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:42.685307    2579 scope.go:117] "RemoveContainer" containerID="ccde41c95891f386a6c304e0253aebf5b6e2db8e56c8695c323ae61e96b82857"
Jul 13 17:29:42.686915 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:42.686890    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6657c86579-zpnq7" event={"ID":"158de252-4406-450d-b9d6-5f550bef986c","Type":"ContainerStarted","Data":"0474f8145742223a7afcf628f0a27a5682d6183a2a9d22fba311be112e4f1943"}
Jul 13 17:29:42.693047 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:42.693028    2579 scope.go:117] "RemoveContainer" containerID="ccde41c95891f386a6c304e0253aebf5b6e2db8e56c8695c323ae61e96b82857"
Jul 13 17:29:42.693287 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:29:42.693268    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccde41c95891f386a6c304e0253aebf5b6e2db8e56c8695c323ae61e96b82857\": container with ID starting with ccde41c95891f386a6c304e0253aebf5b6e2db8e56c8695c323ae61e96b82857 not found: ID does not exist" containerID="ccde41c95891f386a6c304e0253aebf5b6e2db8e56c8695c323ae61e96b82857"
Jul 13 17:29:42.693341 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:42.693295    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccde41c95891f386a6c304e0253aebf5b6e2db8e56c8695c323ae61e96b82857"} err="failed to get container status \"ccde41c95891f386a6c304e0253aebf5b6e2db8e56c8695c323ae61e96b82857\": rpc error: code = NotFound desc = could not find container \"ccde41c95891f386a6c304e0253aebf5b6e2db8e56c8695c323ae61e96b82857\": container with ID starting with ccde41c95891f386a6c304e0253aebf5b6e2db8e56c8695c323ae61e96b82857 not found: ID does not exist"
Jul 13 17:29:42.702502 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:42.702479    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qlbnk"]
Jul 13 17:29:42.706190 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:42.706167    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qlbnk"]
Jul 13 17:29:42.720067 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:42.720028    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6657c86579-zpnq7" podStartSLOduration=1.9089764740000001 podStartE2EDuration="2.720015459s" totalImagesPullingTime="811.038985ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:29:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:29:42.719166871 +0000 UTC m=+743.371289498" watchObservedRunningTime="2026-07-13 17:29:42.720015459 +0000 UTC m=+743.372138084"
Jul 13 17:29:43.521675 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:43.521645    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:44.070843 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:44.070812    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f5b983b-68cc-42fd-b639-a4ae21bfbc28" path="/var/lib/kubelet/pods/2f5b983b-68cc-42fd-b639-a4ae21bfbc28/volumes"
Jul 13 17:29:49.329118 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:49.329081    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:49.436718 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:49.436682    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:49.506836 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:49.506797    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:52.312986 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:52.312955    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:29:52.400127 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:29:52.400089    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:30:24.533010 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:30:24.532975    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:30:24.628653 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:30:24.628610    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:30:25.142170 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:30:25.142129    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:30:25.375529 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:30:25.375497    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:30:25.559784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:30:25.559699    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:30:25.774709 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:30:25.774678    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:30:26.090737 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:30:26.090705    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:30:26.188982 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:30:26.188946    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:30:36.112213 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:30:36.112165    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:30:36.211789 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:30:36.211749    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:30:44.435233 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:30:44.435200    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:30:44.983005 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:30:44.982971    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:30:48.912185 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:30:48.912143    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:30:49.875303 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:30:49.875268    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:31:03.239621 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:03.239580    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:31:04.490846 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:04.490808    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:31:14.224638 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:14.224602    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:31:15.921626 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:15.921592    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:31:19.897418 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.897387    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"]
Jul 13 17:31:19.897780 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.897654    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f5b983b-68cc-42fd-b639-a4ae21bfbc28" containerName="authorino"
Jul 13 17:31:19.897780 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.897665    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f5b983b-68cc-42fd-b639-a4ae21bfbc28" containerName="authorino"
Jul 13 17:31:19.897780 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.897720    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f5b983b-68cc-42fd-b639-a4ae21bfbc28" containerName="authorino"
Jul 13 17:31:19.900470 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.900449    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:19.903313 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.903296    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 17:31:19.903451 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.903431    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-srn9x\""
Jul 13 17:31:19.904524 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.904506    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 13 17:31:19.904524 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.904519    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 17:31:19.913059 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.913038    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"]
Jul 13 17:31:19.916387 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.916341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e74f467c-efda-438e-88a1-accd2016c715-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:19.916478 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.916403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw78r\" (UniqueName: \"kubernetes.io/projected/e74f467c-efda-438e-88a1-accd2016c715-kube-api-access-mw78r\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:19.916478 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.916428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e74f467c-efda-438e-88a1-accd2016c715-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:19.916478 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.916447    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e74f467c-efda-438e-88a1-accd2016c715-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:19.916617 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.916526    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e74f467c-efda-438e-88a1-accd2016c715-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:19.916617 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.916545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e74f467c-efda-438e-88a1-accd2016c715-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:19.933539 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:19.933508    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:31:20.016898 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:20.016864    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e74f467c-efda-438e-88a1-accd2016c715-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:20.016898 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:20.016897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e74f467c-efda-438e-88a1-accd2016c715-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:20.017137 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:20.016928    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e74f467c-efda-438e-88a1-accd2016c715-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:20.017137 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:20.017056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw78r\" (UniqueName: \"kubernetes.io/projected/e74f467c-efda-438e-88a1-accd2016c715-kube-api-access-mw78r\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:20.017137 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:20.017094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e74f467c-efda-438e-88a1-accd2016c715-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:20.017137 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:20.017127    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e74f467c-efda-438e-88a1-accd2016c715-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:20.017337 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:20.017309    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e74f467c-efda-438e-88a1-accd2016c715-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:20.017429 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:20.017381    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e74f467c-efda-438e-88a1-accd2016c715-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:20.017503 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:20.017481    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e74f467c-efda-438e-88a1-accd2016c715-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:20.019257 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:20.019236    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e74f467c-efda-438e-88a1-accd2016c715-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:20.019512 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:20.019495    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e74f467c-efda-438e-88a1-accd2016c715-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:20.026183 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:20.026159    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw78r\" (UniqueName: \"kubernetes.io/projected/e74f467c-efda-438e-88a1-accd2016c715-kube-api-access-mw78r\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-kw7ff\" (UID: \"e74f467c-efda-438e-88a1-accd2016c715\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:20.212827 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:20.212739    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:20.344111 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:20.344081    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"]
Jul 13 17:31:20.347269 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:31:20.347242    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode74f467c_efda_438e_88a1_accd2016c715.slice/crio-ba320ac7a30ae90d0a7267fbb3bd92d6aedb11d361c3eadda8a76a77f36824d9 WatchSource:0}: Error finding container ba320ac7a30ae90d0a7267fbb3bd92d6aedb11d361c3eadda8a76a77f36824d9: Status 404 returned error can't find the container with id ba320ac7a30ae90d0a7267fbb3bd92d6aedb11d361c3eadda8a76a77f36824d9
Jul 13 17:31:21.066795 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:21.066750    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff" event={"ID":"e74f467c-efda-438e-88a1-accd2016c715","Type":"ContainerStarted","Data":"ba320ac7a30ae90d0a7267fbb3bd92d6aedb11d361c3eadda8a76a77f36824d9"}
Jul 13 17:31:21.397374 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:21.397331    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:31:22.072639 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:22.072601    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff" event={"ID":"e74f467c-efda-438e-88a1-accd2016c715","Type":"ContainerStarted","Data":"017c0a0f989391e88ea53e6ba3343b694091ac50affb13e1c82f1009c35d3cb5"}
Jul 13 17:31:22.097240 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:22.097188    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff" podStartSLOduration=2.063165272 podStartE2EDuration="3.097171792s" totalImagesPullingTime="1.03400652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:31:22.094729939 +0000 UTC m=+842.746852564" watchObservedRunningTime="2026-07-13 17:31:22.097171792 +0000 UTC m=+842.749294416"
Jul 13 17:31:30.213442 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:30.213402    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:30.213915 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:30.213485    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:30.226098 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:30.226069    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:31.118816 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:31.118787    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-kw7ff"
Jul 13 17:31:36.093248 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.093218    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"]
Jul 13 17:31:36.097895 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.097876    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.104060 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.104039    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 13 17:31:36.112422 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.112400    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"]
Jul 13 17:31:36.142835 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.142800    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:31:36.143817 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.143799    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.143881 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.143828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.143881 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.143849    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bw2j\" (UniqueName: \"kubernetes.io/projected/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-kube-api-access-4bw2j\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.143947 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.143901    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.143947 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.143930    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.144011 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.143985    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.244317 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.244277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.244485 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.244340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.244485 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.244391    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.244485 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.244412    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bw2j\" (UniqueName: \"kubernetes.io/projected/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-kube-api-access-4bw2j\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.244485 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.244437    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.244485 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.244454    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.244782 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.244752    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.244841 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.244791    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.244892 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.244876    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.246702 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.246676    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.246956 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.246938    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.253782 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.253756    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bw2j\" (UniqueName: \"kubernetes.io/projected/fbbbdc5b-841a-4fdb-9d70-c531b515ca72-kube-api-access-4bw2j\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2\" (UID: \"fbbbdc5b-841a-4fdb-9d70-c531b515ca72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.406771 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.406731    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:36.544341 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:36.544165    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"]
Jul 13 17:31:36.546969 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:31:36.546936    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbbbdc5b_841a_4fdb_9d70_c531b515ca72.slice/crio-fad66931766b788af56dd0cced0fd0dbe9703d219cf9d9fd630b9a64993fc77d WatchSource:0}: Error finding container fad66931766b788af56dd0cced0fd0dbe9703d219cf9d9fd630b9a64993fc77d: Status 404 returned error can't find the container with id fad66931766b788af56dd0cced0fd0dbe9703d219cf9d9fd630b9a64993fc77d
Jul 13 17:31:37.131875 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:37.131840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2" event={"ID":"fbbbdc5b-841a-4fdb-9d70-c531b515ca72","Type":"ContainerStarted","Data":"0f918b971a02cbd25b828a1268a710e248d260b1841610353949cb3e8f05d73a"}
Jul 13 17:31:37.132415 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:37.131881    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2" event={"ID":"fbbbdc5b-841a-4fdb-9d70-c531b515ca72","Type":"ContainerStarted","Data":"fad66931766b788af56dd0cced0fd0dbe9703d219cf9d9fd630b9a64993fc77d"}
Jul 13 17:31:37.153138 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:37.153094    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2" podStartSLOduration=0.995528229 podStartE2EDuration="1.153077134s" totalImagesPullingTime="157.548905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:31:37.15187334 +0000 UTC m=+857.803995966" watchObservedRunningTime="2026-07-13 17:31:37.153077134 +0000 UTC m=+857.805199758"
Jul 13 17:31:38.699901 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:38.699865    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:31:46.407585 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:46.407529    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:46.407988 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:46.407603    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:46.420082 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:46.420055    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:31:47.179714 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:31:47.179684    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2"
Jul 13 17:32:19.830458 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:19.830371    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:32:19.831884 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:19.831860    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:32:24.568829 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:24.568799    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-dbd7f785d-9cmpx"]
Jul 13 17:32:24.571957 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:24.571936    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dbd7f785d-9cmpx"
Jul 13 17:32:24.581292 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:24.581266    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dbd7f785d-9cmpx"]
Jul 13 17:32:24.632257 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:24.632178    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c8521e9-b662-47d6-9382-470ddaff2ebe-tls-cert\") pod \"authorino-dbd7f785d-9cmpx\" (UID: \"0c8521e9-b662-47d6-9382-470ddaff2ebe\") " pod="kuadrant-system/authorino-dbd7f785d-9cmpx"
Jul 13 17:32:24.632449 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:24.632288    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9h5q\" (UniqueName: \"kubernetes.io/projected/0c8521e9-b662-47d6-9382-470ddaff2ebe-kube-api-access-g9h5q\") pod \"authorino-dbd7f785d-9cmpx\" (UID: \"0c8521e9-b662-47d6-9382-470ddaff2ebe\") " pod="kuadrant-system/authorino-dbd7f785d-9cmpx"
Jul 13 17:32:24.733512 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:24.733472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9h5q\" (UniqueName: \"kubernetes.io/projected/0c8521e9-b662-47d6-9382-470ddaff2ebe-kube-api-access-g9h5q\") pod \"authorino-dbd7f785d-9cmpx\" (UID: \"0c8521e9-b662-47d6-9382-470ddaff2ebe\") " pod="kuadrant-system/authorino-dbd7f785d-9cmpx"
Jul 13 17:32:24.733703 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:24.733529    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c8521e9-b662-47d6-9382-470ddaff2ebe-tls-cert\") pod \"authorino-dbd7f785d-9cmpx\" (UID: \"0c8521e9-b662-47d6-9382-470ddaff2ebe\") " pod="kuadrant-system/authorino-dbd7f785d-9cmpx"
Jul 13 17:32:24.735944 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:24.735920    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c8521e9-b662-47d6-9382-470ddaff2ebe-tls-cert\") pod \"authorino-dbd7f785d-9cmpx\" (UID: \"0c8521e9-b662-47d6-9382-470ddaff2ebe\") " pod="kuadrant-system/authorino-dbd7f785d-9cmpx"
Jul 13 17:32:24.743291 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:24.743266    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9h5q\" (UniqueName: \"kubernetes.io/projected/0c8521e9-b662-47d6-9382-470ddaff2ebe-kube-api-access-g9h5q\") pod \"authorino-dbd7f785d-9cmpx\" (UID: \"0c8521e9-b662-47d6-9382-470ddaff2ebe\") " pod="kuadrant-system/authorino-dbd7f785d-9cmpx"
Jul 13 17:32:24.881173 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:24.881143    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dbd7f785d-9cmpx"
Jul 13 17:32:25.006102 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:25.006074    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dbd7f785d-9cmpx"]
Jul 13 17:32:25.009747 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:32:25.009721    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c8521e9_b662_47d6_9382_470ddaff2ebe.slice/crio-558efa1b486fa98d009f94f14c8aaa25c7bf2e6e267db5f77990c5fd86edd78d WatchSource:0}: Error finding container 558efa1b486fa98d009f94f14c8aaa25c7bf2e6e267db5f77990c5fd86edd78d: Status 404 returned error can't find the container with id 558efa1b486fa98d009f94f14c8aaa25c7bf2e6e267db5f77990c5fd86edd78d
Jul 13 17:32:25.316651 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:25.316565    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dbd7f785d-9cmpx" event={"ID":"0c8521e9-b662-47d6-9382-470ddaff2ebe","Type":"ContainerStarted","Data":"558efa1b486fa98d009f94f14c8aaa25c7bf2e6e267db5f77990c5fd86edd78d"}
Jul 13 17:32:26.322339 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:26.322300    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dbd7f785d-9cmpx" event={"ID":"0c8521e9-b662-47d6-9382-470ddaff2ebe","Type":"ContainerStarted","Data":"bfb2dad1d4b595db6bb15241004e0f53cb7111219aabfea4d5c421f762a11bad"}
Jul 13 17:32:26.348935 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:26.348884    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-dbd7f785d-9cmpx" podStartSLOduration=1.925791885 podStartE2EDuration="2.348867587s" totalImagesPullingTime="423.075702ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:26.347864672 +0000 UTC m=+906.999987296" watchObservedRunningTime="2026-07-13 17:32:26.348867587 +0000 UTC m=+907.000990209"
Jul 13 17:32:26.389142 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:26.389103    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6657c86579-zpnq7"]
Jul 13 17:32:26.389394 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:26.389344    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6657c86579-zpnq7" podUID="158de252-4406-450d-b9d6-5f550bef986c" containerName="authorino" containerID="cri-o://0474f8145742223a7afcf628f0a27a5682d6183a2a9d22fba311be112e4f1943" gracePeriod=30
Jul 13 17:32:26.638882 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:26.638846    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6657c86579-zpnq7"
Jul 13 17:32:26.648386 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:26.648344    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65hvr\" (UniqueName: \"kubernetes.io/projected/158de252-4406-450d-b9d6-5f550bef986c-kube-api-access-65hvr\") pod \"158de252-4406-450d-b9d6-5f550bef986c\" (UID: \"158de252-4406-450d-b9d6-5f550bef986c\") "
Jul 13 17:32:26.648533 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:26.648405    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/158de252-4406-450d-b9d6-5f550bef986c-tls-cert\") pod \"158de252-4406-450d-b9d6-5f550bef986c\" (UID: \"158de252-4406-450d-b9d6-5f550bef986c\") "
Jul 13 17:32:26.650738 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:26.650672    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/158de252-4406-450d-b9d6-5f550bef986c-kube-api-access-65hvr" (OuterVolumeSpecName: "kube-api-access-65hvr") pod "158de252-4406-450d-b9d6-5f550bef986c" (UID: "158de252-4406-450d-b9d6-5f550bef986c"). InnerVolumeSpecName "kube-api-access-65hvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:32:26.659975 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:26.659944    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/158de252-4406-450d-b9d6-5f550bef986c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "158de252-4406-450d-b9d6-5f550bef986c" (UID: "158de252-4406-450d-b9d6-5f550bef986c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:32:26.749363 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:26.749317    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65hvr\" (UniqueName: \"kubernetes.io/projected/158de252-4406-450d-b9d6-5f550bef986c-kube-api-access-65hvr\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:32:26.749363 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:26.749360    2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/158de252-4406-450d-b9d6-5f550bef986c-tls-cert\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:32:26.925900 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:26.925802    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:32:27.327522 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:27.327435    2579 generic.go:356] "Generic (PLEG): container finished" podID="158de252-4406-450d-b9d6-5f550bef986c" containerID="0474f8145742223a7afcf628f0a27a5682d6183a2a9d22fba311be112e4f1943" exitCode=0
Jul 13 17:32:27.327522 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:27.327485    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6657c86579-zpnq7"
Jul 13 17:32:27.327963 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:27.327525    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6657c86579-zpnq7" event={"ID":"158de252-4406-450d-b9d6-5f550bef986c","Type":"ContainerDied","Data":"0474f8145742223a7afcf628f0a27a5682d6183a2a9d22fba311be112e4f1943"}
Jul 13 17:32:27.327963 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:27.327567    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6657c86579-zpnq7" event={"ID":"158de252-4406-450d-b9d6-5f550bef986c","Type":"ContainerDied","Data":"a508a6d7c10c4fa4530d8186c8307ea11f028f3aecae6f571f6677e4822b709a"}
Jul 13 17:32:27.327963 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:27.327585    2579 scope.go:117] "RemoveContainer" containerID="0474f8145742223a7afcf628f0a27a5682d6183a2a9d22fba311be112e4f1943"
Jul 13 17:32:27.337598 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:27.337580    2579 scope.go:117] "RemoveContainer" containerID="0474f8145742223a7afcf628f0a27a5682d6183a2a9d22fba311be112e4f1943"
Jul 13 17:32:27.337942 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:32:27.337909    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0474f8145742223a7afcf628f0a27a5682d6183a2a9d22fba311be112e4f1943\": container with ID starting with 0474f8145742223a7afcf628f0a27a5682d6183a2a9d22fba311be112e4f1943 not found: ID does not exist" containerID="0474f8145742223a7afcf628f0a27a5682d6183a2a9d22fba311be112e4f1943"
Jul 13 17:32:27.338007 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:27.337944    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0474f8145742223a7afcf628f0a27a5682d6183a2a9d22fba311be112e4f1943"} err="failed to get container status \"0474f8145742223a7afcf628f0a27a5682d6183a2a9d22fba311be112e4f1943\": rpc error: code = NotFound desc = could not find container \"0474f8145742223a7afcf628f0a27a5682d6183a2a9d22fba311be112e4f1943\": container with ID starting with 0474f8145742223a7afcf628f0a27a5682d6183a2a9d22fba311be112e4f1943 not found: ID does not exist"
Jul 13 17:32:27.361449 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:27.361417    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6657c86579-zpnq7"]
Jul 13 17:32:27.363041 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:27.363015    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6657c86579-zpnq7"]
Jul 13 17:32:28.070362 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:28.070319    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="158de252-4406-450d-b9d6-5f550bef986c" path="/var/lib/kubelet/pods/158de252-4406-450d-b9d6-5f550bef986c/volumes"
Jul 13 17:32:28.128327 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:28.128294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:32:28.257010 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:28.256966    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:32:56.022988 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:56.022949    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:32:59.263494 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:59.263458    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:32:59.322989 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:32:59.322949    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:33:05.893266 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:33:05.893230    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:33:17.215431 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:33:17.215392    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:33:26.494778 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:33:26.494746    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:33:33.121578 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:33:33.121539    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:33:37.093587 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:33:37.093553    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:33:39.630750 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:33:39.630713    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:33:41.429297 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:33:41.429258    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:33:51.192695 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:33:51.192652    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:33:51.293474 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:33:51.293435    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:34:05.584477 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:34:05.584443    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:34:16.880543 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:34:16.880497    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:34:20.095524 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:34:20.095493    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:34:24.772216 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:34:24.772183    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:34:24.867471 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:34:24.867436    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:34:25.014513 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:34:25.014476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:34:26.130398 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:34:26.130336    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:34:26.244327 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:34:26.244294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:34:31.087140 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:34:31.087102    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:34:31.158987 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:34:31.158940    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:34:31.271452 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:34:31.271414    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:34:31.439051 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:34:31.439014    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:34:37.393575 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:34:37.393525    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:34:37.494720 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:34:37.494676    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:34:54.875067 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:34:54.875030    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:35:04.786073 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:35:04.786038    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:35:15.502050 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:35:15.501961    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:35:23.085383 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:35:23.085333    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:35:24.473444 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:35:24.473411    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:35:24.573331 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:35:24.573296    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:35:34.084364 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:35:34.084316    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:35:43.391779 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:35:43.391748    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:35:55.283015 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:35:55.282982    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:36:05.177744 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:36:05.177704    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:36:18.634132 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:36:18.634097    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:36:27.882990 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:36:27.882946    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:36:36.484775 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:36:36.484737    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:37:01.197533 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:37:01.197498    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:37:13.124115 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:37:13.124086    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:37:19.852912 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:37:19.852881    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:37:19.854604 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:37:19.854582    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:37:28.504420 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:37:28.504382    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:37:37.579111 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:37:37.579079    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:37:47.195672 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:37:47.195636    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:37:56.476746 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:37:56.476698    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:38:06.192076 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:38:06.192042    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:39:26.621162 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:39:26.621126    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:39:54.996241 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:39:54.996203    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:39:55.937363 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:39:55.937317    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:40:04.451786 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:40:04.451755    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:40:17.893177 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:40:17.893140    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:40:28.785675 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:40:28.785638    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:40:38.792530 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:40:38.792493    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:40:49.487228 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:40:49.487188    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:40:59.891004 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:40:59.890965    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:41:09.580288 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:41:09.580254    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:41:20.193484 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:41:20.193409    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:41:30.103443 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:41:30.103404    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:41:40.592691 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:41:40.592653    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:42:03.891141 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:42:03.891095    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:42:12.795431 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:42:12.795320    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:42:19.875923 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:42:19.875887    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:42:19.877086 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:42:19.877061    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:42:22.491231 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:42:22.491193    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:42:41.884265 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:42:41.884223    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:42:53.792045 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:42:53.792010    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:43:02.998278 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:43:02.998242    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:43:12.083468 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:43:12.083435    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:43:18.037075 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:43:18.037042    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:43:22.981226 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:43:22.981186    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:43:32.186468 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:43:32.186436    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:43:41.401808 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:43:41.401770    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:43:41.502456 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:43:41.502416    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:43:41.983945 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:43:41.983909    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:43:54.908879 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:43:54.908847    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:44:04.893837 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:44:04.893799    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:44:19.586686 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:44:19.586597    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:44:28.791146 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:44:28.791114    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:44:40.584423 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:44:40.584377    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:44:52.588201 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:44:52.588165    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:44:55.189082 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:44:55.189040    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:45:07.108306 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:07.108276    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:45:18.866525 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:18.866493    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:45:21.664105 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:21.664066    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:27.953295 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:27.953249    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:45:33.519861 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:33.519824    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:38.518385 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:38.518341    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:45:41.791253 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:41.791211    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:46.897219 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:46.897186    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:50.049439 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:50.049400    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:50.134925 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:50.134888    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:50.487290 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:50.487249    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:51.199452 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:51.199419    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:45:56.968105 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:56.968069    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:57.090163 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:57.090130    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:57.258765 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:57.258677    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:57.378835 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:57.378797    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:58.416659 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:58.416615    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:58.576567 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:58.576520    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:58.805678 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:58.805591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:59.178134 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:59.178099    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:59.666285 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:59.666255    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:45:59.775974 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:45:59.775943    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:46:01.208745 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:46:01.208702    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:46:01.709826 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:46:01.709792    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:47:00.171026 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:00.170987    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:14.161452 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:14.161366    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:17.236689 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:17.236655    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:47:18.668799 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:18.668768    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:19.897714 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:19.897689    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:47:19.899919 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:19.899900    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:47:25.241303 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:25.241252    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:25.344993 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:25.344958    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:28.876540 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:28.876502    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:29.255719 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:29.255633    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:29.355622 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:29.355561    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:29.463891 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:29.463831    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:30.757473 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:30.757435    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:30.885865 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:30.885828    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:31.329814 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:31.329778    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:31.458371 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:31.458314    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:31.560229 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:31.560193    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:38.997179 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:38.997147    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:47:41.934883 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:41.934833    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:42.001467 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:42.001438    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:47:46.232568 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:47:46.232540    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:35.388747 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:35.388714    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:35.501659 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:35.501616    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:38.705850 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:38.705817    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:48:41.143202 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:41.143171    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:41.939246 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:41.939205    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:42.069676 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:42.069641    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:48.106946 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:48.106914    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:48.205954 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:48.205922    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:48.396898 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:48.396867    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:48.518545 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:48.518513    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:49.562247 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:49.562212    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:49.651839 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:49.651802    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:49.738622 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:49.738589    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:49.934207 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:49.934178    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:50.246615 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:50.246522    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:50.344124 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:50.344089    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:51.478904 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:51.478867    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:48:52.192088 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:48:52.192055    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:49:04.915750 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:49:04.915718    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:49:05.015513 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:49:05.015472    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:49:11.104424 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:49:11.104365    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:49:11.204970 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:49:11.204935    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:50:05.148480 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:05.148446    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:50:08.108064 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:08.108029    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:50:09.742182 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:09.742137    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:50:15.782517 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:15.782476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:50:15.885233 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:15.885186    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:50:21.537608 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:21.537570    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:50:21.934472 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:21.934438    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:50:23.369499 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:23.369451    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:50:23.458954 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:23.458923    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:50:23.662153 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:23.662027    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:50:23.829001 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:23.828956    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:50:24.196077 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:24.196031    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:50:24.299929 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:24.299898    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:50:28.785388 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:28.785340    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:50:28.885108 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:28.885063    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:50:31.987168 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:31.987136    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:50:32.759335 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:50:32.759301    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:51:22.439393 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:51:22.439330    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:51:38.968946 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:51:38.968904    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:51:40.789273 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:51:40.789234    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:51:43.583798 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:51:43.583765    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:51:50.042482 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:51:50.042452    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:51:50.143626 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:51:50.143590    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:51:53.788624 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:51:53.788587    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:51:54.404575 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:51:54.404531    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:51:54.506093 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:51:54.506059    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:51:54.615935 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:51:54.615906    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:51:56.069742 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:51:56.069709    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:52:02.856121 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:02.856086    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:52:03.067923 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:03.067882    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:52:03.229013 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:03.228975    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:52:03.635139 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:03.635110    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:52:06.267077 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:06.267043    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:52:13.365766 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:13.365735    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:52:19.920603 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:19.920576    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:52:19.922553 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:19.922532    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:52:29.635112 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:29.635083    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:52:35.721015 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:35.720977    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:52:35.839272 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:35.839239    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:52:35.943827 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:35.943790    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:52:51.871620 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:51.871584    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:52:54.200154 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:54.200118    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:52:57.938825 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:57.938787    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:52:58.041561 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:52:58.041525    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:04.681491 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:04.681454    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:08.542495 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:08.542459    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:09.355504 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:09.355471    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:15.839212 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:15.839133    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:15.948469 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:15.948441    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:16.103003 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:16.102916    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:16.218562 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:16.218531    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:17.038060 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:17.038025    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:17.177008 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:17.176963    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:18.831123 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:18.831077    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:19.584002 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:19.583968    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:53:25.096934 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:25.096900    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:25.203095 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:25.203062    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:25.764948 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:25.764909    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:27.687086 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:27.687055    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:53:31.984003 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:31.983966    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:32.073230 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:32.073200    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:32.240589 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:32.240505    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:32.552417 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:32.552305    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:32.941268 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:32.941235    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:35.747332 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:35.747291    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:35.841650 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:35.841616    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:36.015779 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:36.015690    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:36.148032 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:36.147996    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:36.563733 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:36.563698    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:36.665421 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:36.665384    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:40.253551 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:40.253506    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:40.926174 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:40.926141    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:41.009273 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:41.009235    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:41.368056 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:41.368034    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:42.685510 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:42.685477    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:53:48.468501 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:48.468465    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:48.637993 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:48.637956    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:53:59.044256 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:53:59.044225    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:02.286321 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:02.286286    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:54:03.623604 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:03.623570    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:05.858445 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:05.858407    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:05.957558 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:05.957521    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:09.569263 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:09.569229    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:09.696934 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:09.696896    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:14.309518 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:14.309460    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:14.549839 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:14.549802    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:14.688510 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:14.688468    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:14.789573 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:14.789532    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:14.926732 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:14.926697    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:20.756834 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:20.756799    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:20.867095 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:20.867060    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:20.959697 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:20.959661    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:21.122746 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:21.122715    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:27.317919 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:27.317884    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:27.419814 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:27.419784    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:34.244337 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:34.244300    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:34.580452 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:34.580368    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:34.837307 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:34.837223    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:37.085796 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:37.085757    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:37.254613 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:37.254580    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:37.362154 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:37.362060    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:37.674113 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:37.674074    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:37.985870 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:37.985781    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:38.094012 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:38.093975    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:41.556686 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:41.556622    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:42.185230 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:42.185150    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:54:56.175986 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.175954    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"]
Jul 13 17:54:56.176404 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.176244    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="158de252-4406-450d-b9d6-5f550bef986c" containerName="authorino"
Jul 13 17:54:56.176404 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.176258    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="158de252-4406-450d-b9d6-5f550bef986c" containerName="authorino"
Jul 13 17:54:56.176404 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.176320    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="158de252-4406-450d-b9d6-5f550bef986c" containerName="authorino"
Jul 13 17:54:56.179166 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.179143    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.182344 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.182324    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-db8658d2\"/\"kube-root-ca.crt\""
Jul 13 17:54:56.182473 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.182456    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-db8658d2\"/\"default-dockercfg-lfhps\""
Jul 13 17:54:56.182547 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.182455    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-db8658d2\"/\"e2e-lifecycle-model-db8658d2-kserve-self-signed-certs\""
Jul 13 17:54:56.182547 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.182456    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-db8658d2\"/\"openshift-service-ca.crt\""
Jul 13 17:54:56.189609 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.189586    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"]
Jul 13 17:54:56.219167 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.219126    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:54:56.301400 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.301343    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-tmp-dir\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.301400 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.301400    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-tls-certs\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.301598 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.301454    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw9pq\" (UniqueName: \"kubernetes.io/projected/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-kube-api-access-bw9pq\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.301598 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.301532    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-dshm\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.301598 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.301551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-model-cache\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.301598 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.301573    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-home\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.402044 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.402004    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-tmp-dir\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.402044 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.402045    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-tls-certs\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.402294 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.402064    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw9pq\" (UniqueName: \"kubernetes.io/projected/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-kube-api-access-bw9pq\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.402294 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.402100    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-dshm\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.402294 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.402115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-model-cache\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.402294 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.402134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-home\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.402552 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.402524    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-tmp-dir\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.402630 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.402607    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-model-cache\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.402666 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.402649    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-home\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.404453 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.404430    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-dshm\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.404655 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.404637    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-tls-certs\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.411230 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.411202    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw9pq\" (UniqueName: \"kubernetes.io/projected/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-kube-api-access-bw9pq\") pod \"e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") " pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.488490 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.488410    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:54:56.616339 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.616308    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"]
Jul 13 17:54:56.619837 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:54:56.619810    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffffbb6c_cbfe_4743_82d6_f01c2a3b4aa8.slice/crio-429ffdf276359a3777b50659722978239c088117479c0f2b27ea09968ceeb152 WatchSource:0}: Error finding container 429ffdf276359a3777b50659722978239c088117479c0f2b27ea09968ceeb152: Status 404 returned error can't find the container with id 429ffdf276359a3777b50659722978239c088117479c0f2b27ea09968ceeb152
Jul 13 17:54:56.721743 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.721709    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9" event={"ID":"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8","Type":"ContainerStarted","Data":"67822807b8117046fe4bda7827a1c795c844c0252fde0e959a365029e9b6c20f"}
Jul 13 17:54:56.721904 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.721752    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9" event={"ID":"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8","Type":"ContainerStarted","Data":"429ffdf276359a3777b50659722978239c088117479c0f2b27ea09968ceeb152"}
Jul 13 17:54:56.738676 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:56.738580    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9" podStartSLOduration=0.738564283 podStartE2EDuration="738.564283ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:54:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:54:56.738138383 +0000 UTC m=+2257.390261041" watchObservedRunningTime="2026-07-13 17:54:56.738564283 +0000 UTC m=+2257.390686907"
Jul 13 17:54:59.589216 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:54:59.589177    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:55:06.489139 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:55:06.489096    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:55:06.489556 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:55:06.489159    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:55:06.501739 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:55:06.501714    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:55:06.772100 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:55:06.772022    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:55:21.781948 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:55:21.781917    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:55:35.549080 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:55:35.549048    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:55:39.491709 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:55:39.491673    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:55:40.100754 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:55:40.100717    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:55:45.087019 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:55:45.086984    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"]
Jul 13 17:55:45.184267 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:55:45.184221    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:00.106968 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.106909    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9" podUID="ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8" containerName="main" containerID="cri-o://67822807b8117046fe4bda7827a1c795c844c0252fde0e959a365029e9b6c20f" gracePeriod=45
Jul 13 17:56:00.352154 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.352128    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:56:00.405071 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.405042    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-home\") pod \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") "
Jul 13 17:56:00.405273 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.405093    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-dshm\") pod \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") "
Jul 13 17:56:00.405273 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.405123    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-tmp-dir\") pod \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") "
Jul 13 17:56:00.405273 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.405153    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-tls-certs\") pod \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") "
Jul 13 17:56:00.405273 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.405196    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw9pq\" (UniqueName: \"kubernetes.io/projected/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-kube-api-access-bw9pq\") pod \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") "
Jul 13 17:56:00.405273 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.405223    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-model-cache\") pod \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\" (UID: \"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8\") "
Jul 13 17:56:00.405557 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.405363    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-home" (OuterVolumeSpecName: "home") pod "ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8" (UID: "ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:56:00.405557 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.405410    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8" (UID: "ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:56:00.405557 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.405484    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-tmp-dir\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:56:00.405557 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.405521    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-home\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:56:00.405755 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.405584    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-model-cache" (OuterVolumeSpecName: "model-cache") pod "ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8" (UID: "ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:56:00.407647 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.407619    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-dshm" (OuterVolumeSpecName: "dshm") pod "ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8" (UID: "ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:56:00.407849 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.407824    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8" (UID: "ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:56:00.407913 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.407840    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-kube-api-access-bw9pq" (OuterVolumeSpecName: "kube-api-access-bw9pq") pod "ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8" (UID: "ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8"). InnerVolumeSpecName "kube-api-access-bw9pq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:56:00.506716 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.506681    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-dshm\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:56:00.506716 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.506707    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-tls-certs\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:56:00.506716 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.506718    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw9pq\" (UniqueName: \"kubernetes.io/projected/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-kube-api-access-bw9pq\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:56:00.506950 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.506727    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8-model-cache\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:56:00.977833 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.977800    2579 generic.go:356] "Generic (PLEG): container finished" podID="ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8" containerID="67822807b8117046fe4bda7827a1c795c844c0252fde0e959a365029e9b6c20f" exitCode=0
Jul 13 17:56:00.977998 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.977843    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"
Jul 13 17:56:00.977998 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.977847    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9" event={"ID":"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8","Type":"ContainerDied","Data":"67822807b8117046fe4bda7827a1c795c844c0252fde0e959a365029e9b6c20f"}
Jul 13 17:56:00.977998 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.977957    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9" event={"ID":"ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8","Type":"ContainerDied","Data":"429ffdf276359a3777b50659722978239c088117479c0f2b27ea09968ceeb152"}
Jul 13 17:56:00.977998 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.977982    2579 scope.go:117] "RemoveContainer" containerID="67822807b8117046fe4bda7827a1c795c844c0252fde0e959a365029e9b6c20f"
Jul 13 17:56:00.986409 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.986340    2579 scope.go:117] "RemoveContainer" containerID="67822807b8117046fe4bda7827a1c795c844c0252fde0e959a365029e9b6c20f"
Jul 13 17:56:00.986684 ip-10-0-141-144 kubenswrapper[2579]: E0713 17:56:00.986664    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67822807b8117046fe4bda7827a1c795c844c0252fde0e959a365029e9b6c20f\": container with ID starting with 67822807b8117046fe4bda7827a1c795c844c0252fde0e959a365029e9b6c20f not found: ID does not exist" containerID="67822807b8117046fe4bda7827a1c795c844c0252fde0e959a365029e9b6c20f"
Jul 13 17:56:00.986777 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.986690    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67822807b8117046fe4bda7827a1c795c844c0252fde0e959a365029e9b6c20f"} err="failed to get container status \"67822807b8117046fe4bda7827a1c795c844c0252fde0e959a365029e9b6c20f\": rpc error: code = NotFound desc = could not find container \"67822807b8117046fe4bda7827a1c795c844c0252fde0e959a365029e9b6c20f\": container with ID starting with 67822807b8117046fe4bda7827a1c795c844c0252fde0e959a365029e9b6c20f not found: ID does not exist"
Jul 13 17:56:00.998456 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:00.998420    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"]
Jul 13 17:56:01.004495 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:01.004474    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-db8658d2/e2e-lifecycle-model-db8658d2-kserve-555dd8f899-r5hb9"]
Jul 13 17:56:02.069991 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:02.069957    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8" path="/var/lib/kubelet/pods/ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8/volumes"
Jul 13 17:56:21.573556 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:21.573515    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:22.476444 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:22.476342    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:28.685743 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:28.685704    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:28.778454 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:28.778418    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:32.564760 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:32.564726    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:32.667764 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:32.667729    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:33.827190 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:33.827161    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:33.955407 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:33.955373    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:34.423171 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:34.423136    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:34.528082 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:34.528049    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:34.788937 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:34.788834    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:34.886786 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:34.886752    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:35.004093 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:35.004059    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:35.689212 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:35.689176    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:56:36.390702 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:36.390659    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:42.796568 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:42.796486    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:42.871908 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:42.871872    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:43.468289 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:43.468227    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:47.289204 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:47.289171    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:56:49.605374 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:49.605325    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:49.716260 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:49.716222    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:56:49.806084 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:56:49.806054    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:00.383594 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:00.383557    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:00.693299 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:00.693211    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:19.945074 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:19.945044    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:57:19.953129 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:19.953104    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 17:57:21.724923 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:21.724887    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:28.752182 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:28.752132    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:28.848842 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:28.848810    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:29.100080 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:29.100002    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:29.485430 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:29.485395    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:30.523101 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:30.523066    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:32.171902 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:32.171865    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:32.267371 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:32.267308    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:32.433483 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:32.433400    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:32.556969 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:32.556934    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:32.990939 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:32.990907    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:33.087858 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:33.087831    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:34.920018 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:34.919981    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:36.677307 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:36.677272    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:37.013730 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:37.013645    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:37.349973 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:37.349888    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:37.462877 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:37.462845    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:40.209017 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:40.208986    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:40.383623 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:40.383590    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:40.559706 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:40.559623    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:40.630473 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:40.630442    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:57:40.696600 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:40.696568    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:41.191285 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:41.191255    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:41.324311 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:41.324277    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:44.691716 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:44.691671    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:53.911999 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:53.911967    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:54.084778 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:54.084747    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:57:55.003386 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:55.003334    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:57:55.739672 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:57:55.739636    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:58:02.098262 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.098229    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"]
Jul 13 17:58:02.098675 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.098659    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8" containerName="main"
Jul 13 17:58:02.098719 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.098678    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8" containerName="main"
Jul 13 17:58:02.098783 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.098773    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffffbb6c-cbfe-4743-82d6-f01c2a3b4aa8" containerName="main"
Jul 13 17:58:02.101704 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.101684    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.103970 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.103950    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2ffc29\"/\"kube-root-ca.crt\""
Jul 13 17:58:02.104764 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.104744    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2ffc29\"/\"default-dockercfg-xsjrm\""
Jul 13 17:58:02.104878 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.104793    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2ffc29\"/\"test-model-2ffc29-kserve-self-signed-certs\""
Jul 13 17:58:02.104878 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.104792    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2ffc29\"/\"openshift-service-ca.crt\""
Jul 13 17:58:02.108935 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.108900    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"]
Jul 13 17:58:02.128425 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.128394    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:58:02.263761 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.263726    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-tls-certs\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.263935 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.263769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-tmp-dir\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.263935 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.263909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpjxf\" (UniqueName: \"kubernetes.io/projected/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-kube-api-access-xpjxf\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.264015 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.263947    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-home\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.264015 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.263964    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-dshm\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.264015 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.263981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-model-cache\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.365010 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.364976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-tmp-dir\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.365129 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.365039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpjxf\" (UniqueName: \"kubernetes.io/projected/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-kube-api-access-xpjxf\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.365129 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.365062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-home\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.365129 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.365078    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-dshm\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.365129 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.365093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-model-cache\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.365322 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.365204    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-tls-certs\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.365472 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.365449    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-tmp-dir\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.365597 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.365505    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-home\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.365646 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.365591    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-model-cache\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.367395 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.367378    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-dshm\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.367656 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.367640    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-tls-certs\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.372775 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.372743    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpjxf\" (UniqueName: \"kubernetes.io/projected/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-kube-api-access-xpjxf\") pod \"test-model-2ffc29-kserve-754869c545-hhzh2\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") " pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.411370 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.411308    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:02.543751 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:02.543727    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"]
Jul 13 17:58:02.546568 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:58:02.546540    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf86aebcc_e521_48b4_9a5b_ce29a49a8e38.slice/crio-da39429e47e25b39f0dc17e5c75b630ebd72a85794a4a612137ab7438a3fb0ad WatchSource:0}: Error finding container da39429e47e25b39f0dc17e5c75b630ebd72a85794a4a612137ab7438a3fb0ad: Status 404 returned error can't find the container with id da39429e47e25b39f0dc17e5c75b630ebd72a85794a4a612137ab7438a3fb0ad
Jul 13 17:58:03.349100 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:03.349064    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:58:03.447999 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:03.447961    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:58:03.469150 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:03.469121    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2" event={"ID":"f86aebcc-e521-48b4-9a5b-ce29a49a8e38","Type":"ContainerStarted","Data":"b35c167779f48bd1138878f0300767b6b9e5e7e730651f5f0dec9f694db4a911"}
Jul 13 17:58:03.469291 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:03.469161    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2" event={"ID":"f86aebcc-e521-48b4-9a5b-ce29a49a8e38","Type":"ContainerStarted","Data":"da39429e47e25b39f0dc17e5c75b630ebd72a85794a4a612137ab7438a3fb0ad"}
Jul 13 17:58:03.489217 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:03.489170    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2" podStartSLOduration=1.489153486 podStartE2EDuration="1.489153486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:58:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:58:03.488171945 +0000 UTC m=+2444.140294570" watchObservedRunningTime="2026-07-13 17:58:03.489153486 +0000 UTC m=+2444.141276090"
Jul 13 17:58:04.387855 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:04.387820    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:58:12.411840 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:12.411794    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:12.414271 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:12.411862    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:12.424511 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:12.424486    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:12.518856 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:12.518827    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:58:16.158560 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:16.158519    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:58:18.700695 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:18.700665    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:58:28.396139 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.396101    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"]
Jul 13 17:58:28.399294 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.399276    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.401648 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.401630    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cb4ffa\"/\"openshift-service-ca.crt\""
Jul 13 17:58:28.402514 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.402496    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cb4ffa\"/\"kube-root-ca.crt\""
Jul 13 17:58:28.402588 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.402497    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cb4ffa\"/\"test-model-cb4ffa-kserve-self-signed-certs\""
Jul 13 17:58:28.402588 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.402537    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cb4ffa\"/\"default-dockercfg-rlq5b\""
Jul 13 17:58:28.409532 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.409507    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"]
Jul 13 17:58:28.449662 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.449630    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:58:28.476911 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.476876    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-tmp-dir\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.477081 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.476923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-home\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.477081 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.476947    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-model-cache\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.477081 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.477021    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqzm5\" (UniqueName: \"kubernetes.io/projected/7e197e21-e7a3-4362-a279-466726c679e4-kube-api-access-xqzm5\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.477248 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.477094    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e197e21-e7a3-4362-a279-466726c679e4-tls-certs\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.477248 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.477136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-dshm\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.577699 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.577665    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-tmp-dir\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.577877 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.577710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-home\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.577877 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.577734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-model-cache\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.577877 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.577767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqzm5\" (UniqueName: \"kubernetes.io/projected/7e197e21-e7a3-4362-a279-466726c679e4-kube-api-access-xqzm5\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.577877 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.577810    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e197e21-e7a3-4362-a279-466726c679e4-tls-certs\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.577877 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.577844    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-dshm\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.578174 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.578144    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-home\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.578297 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.578203    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-tmp-dir\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.578393 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.578373    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-model-cache\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.580188 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.580167    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-dshm\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.580423 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.580406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e197e21-e7a3-4362-a279-466726c679e4-tls-certs\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.586722 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.586703    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqzm5\" (UniqueName: \"kubernetes.io/projected/7e197e21-e7a3-4362-a279-466726c679e4-kube-api-access-xqzm5\") pod \"test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") " pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.708719 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.708619    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:28.850560 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:28.850522    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"]
Jul 13 17:58:28.854797 ip-10-0-141-144 kubenswrapper[2579]: W0713 17:58:28.854770    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e197e21_e7a3_4362_a279_466726c679e4.slice/crio-0ebcaacfbda5928bf946fc1dab72590ce49bd86acd0fdfd076f76fe3d4510122 WatchSource:0}: Error finding container 0ebcaacfbda5928bf946fc1dab72590ce49bd86acd0fdfd076f76fe3d4510122: Status 404 returned error can't find the container with id 0ebcaacfbda5928bf946fc1dab72590ce49bd86acd0fdfd076f76fe3d4510122
Jul 13 17:58:29.581539 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:29.581502    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj" event={"ID":"7e197e21-e7a3-4362-a279-466726c679e4","Type":"ContainerStarted","Data":"5ebd050725ec27d76ffb00636f7dac308cb3e9956e26b20cea21cb718b1454ed"}
Jul 13 17:58:29.581933 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:29.581554    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj" event={"ID":"7e197e21-e7a3-4362-a279-466726c679e4","Type":"ContainerStarted","Data":"0ebcaacfbda5928bf946fc1dab72590ce49bd86acd0fdfd076f76fe3d4510122"}
Jul 13 17:58:29.599988 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:29.599943    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj" podStartSLOduration=1.5999286000000001 podStartE2EDuration="1.5999286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:58:29.59839876 +0000 UTC m=+2470.250521382" watchObservedRunningTime="2026-07-13 17:58:29.5999286 +0000 UTC m=+2470.252051226"
Jul 13 17:58:32.997492 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:32.997453    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:58:38.709829 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:38.709785    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:38.710241 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:38.709871    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:38.722495 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:38.722471    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:39.633643 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:39.633614    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:58:47.088312 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:47.088273    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:58:48.583232 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:48.583200    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"]
Jul 13 17:58:48.599579 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:48.599541    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:58:49.504128 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:49.504088    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"]
Jul 13 17:58:49.529982 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:49.529950    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:58:50.241682 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:50.241645    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:58:50.342870 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:50.342832    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:58:59.390622 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:58:59.390588    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:59:00.138201 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:00.138167    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:03.603374 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.603298    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2" podUID="f86aebcc-e521-48b4-9a5b-ce29a49a8e38" containerName="main" containerID="cri-o://b35c167779f48bd1138878f0300767b6b9e5e7e730651f5f0dec9f694db4a911" gracePeriod=45
Jul 13 17:59:03.729717 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.729684    2579 generic.go:356] "Generic (PLEG): container finished" podID="f86aebcc-e521-48b4-9a5b-ce29a49a8e38" containerID="b35c167779f48bd1138878f0300767b6b9e5e7e730651f5f0dec9f694db4a911" exitCode=0
Jul 13 17:59:03.729876 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.729761    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2" event={"ID":"f86aebcc-e521-48b4-9a5b-ce29a49a8e38","Type":"ContainerDied","Data":"b35c167779f48bd1138878f0300767b6b9e5e7e730651f5f0dec9f694db4a911"}
Jul 13 17:59:03.851310 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.851281    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:59:03.980199 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.980162    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-model-cache\") pod \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") "
Jul 13 17:59:03.980431 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.980236    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-tmp-dir\") pod \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") "
Jul 13 17:59:03.980431 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.980260    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-home\") pod \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") "
Jul 13 17:59:03.980431 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.980298    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpjxf\" (UniqueName: \"kubernetes.io/projected/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-kube-api-access-xpjxf\") pod \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") "
Jul 13 17:59:03.980431 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.980322    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-tls-certs\") pod \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") "
Jul 13 17:59:03.980431 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.980344    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-dshm\") pod \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\" (UID: \"f86aebcc-e521-48b4-9a5b-ce29a49a8e38\") "
Jul 13 17:59:03.980679 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.980569    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-model-cache" (OuterVolumeSpecName: "model-cache") pod "f86aebcc-e521-48b4-9a5b-ce29a49a8e38" (UID: "f86aebcc-e521-48b4-9a5b-ce29a49a8e38"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:59:03.980679 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.980599    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f86aebcc-e521-48b4-9a5b-ce29a49a8e38" (UID: "f86aebcc-e521-48b4-9a5b-ce29a49a8e38"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:59:03.980679 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.980645    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-home" (OuterVolumeSpecName: "home") pod "f86aebcc-e521-48b4-9a5b-ce29a49a8e38" (UID: "f86aebcc-e521-48b4-9a5b-ce29a49a8e38"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:59:03.982754 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.982731    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-dshm" (OuterVolumeSpecName: "dshm") pod "f86aebcc-e521-48b4-9a5b-ce29a49a8e38" (UID: "f86aebcc-e521-48b4-9a5b-ce29a49a8e38"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:59:03.982836 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.982731    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-kube-api-access-xpjxf" (OuterVolumeSpecName: "kube-api-access-xpjxf") pod "f86aebcc-e521-48b4-9a5b-ce29a49a8e38" (UID: "f86aebcc-e521-48b4-9a5b-ce29a49a8e38"). InnerVolumeSpecName "kube-api-access-xpjxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:59:03.982836 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:03.982781    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f86aebcc-e521-48b4-9a5b-ce29a49a8e38" (UID: "f86aebcc-e521-48b4-9a5b-ce29a49a8e38"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:59:04.080860 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.080835    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-tmp-dir\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:59:04.080860 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.080859    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-home\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:59:04.081004 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.080868    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpjxf\" (UniqueName: \"kubernetes.io/projected/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-kube-api-access-xpjxf\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:59:04.081004 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.080876    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-tls-certs\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:59:04.081004 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.080885    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-dshm\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:59:04.081004 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.080892    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f86aebcc-e521-48b4-9a5b-ce29a49a8e38-model-cache\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:59:04.523647 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.523606    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj" podUID="7e197e21-e7a3-4362-a279-466726c679e4" containerName="main" containerID="cri-o://5ebd050725ec27d76ffb00636f7dac308cb3e9956e26b20cea21cb718b1454ed" gracePeriod=45
Jul 13 17:59:04.718685 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.718643    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:04.736024 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.735998    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"
Jul 13 17:59:04.736024 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.736016    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2" event={"ID":"f86aebcc-e521-48b4-9a5b-ce29a49a8e38","Type":"ContainerDied","Data":"da39429e47e25b39f0dc17e5c75b630ebd72a85794a4a612137ab7438a3fb0ad"}
Jul 13 17:59:04.736303 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.736067    2579 scope.go:117] "RemoveContainer" containerID="b35c167779f48bd1138878f0300767b6b9e5e7e730651f5f0dec9f694db4a911"
Jul 13 17:59:04.737864 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.737838    2579 generic.go:356] "Generic (PLEG): container finished" podID="7e197e21-e7a3-4362-a279-466726c679e4" containerID="5ebd050725ec27d76ffb00636f7dac308cb3e9956e26b20cea21cb718b1454ed" exitCode=0
Jul 13 17:59:04.737965 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.737876    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj" event={"ID":"7e197e21-e7a3-4362-a279-466726c679e4","Type":"ContainerDied","Data":"5ebd050725ec27d76ffb00636f7dac308cb3e9956e26b20cea21cb718b1454ed"}
Jul 13 17:59:04.752181 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.752156    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"]
Jul 13 17:59:04.758052 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.758031    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2ffc29/test-model-2ffc29-kserve-754869c545-hhzh2"]
Jul 13 17:59:04.774100 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.774048    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:59:04.886839 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.886802    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-tmp-dir\") pod \"7e197e21-e7a3-4362-a279-466726c679e4\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") "
Jul 13 17:59:04.887012 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.886855    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-dshm\") pod \"7e197e21-e7a3-4362-a279-466726c679e4\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") "
Jul 13 17:59:04.887012 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.886881    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-home\") pod \"7e197e21-e7a3-4362-a279-466726c679e4\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") "
Jul 13 17:59:04.887012 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.886938    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-model-cache\") pod \"7e197e21-e7a3-4362-a279-466726c679e4\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") "
Jul 13 17:59:04.887012 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.886991    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e197e21-e7a3-4362-a279-466726c679e4-tls-certs\") pod \"7e197e21-e7a3-4362-a279-466726c679e4\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") "
Jul 13 17:59:04.887215 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.887024    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqzm5\" (UniqueName: \"kubernetes.io/projected/7e197e21-e7a3-4362-a279-466726c679e4-kube-api-access-xqzm5\") pod \"7e197e21-e7a3-4362-a279-466726c679e4\" (UID: \"7e197e21-e7a3-4362-a279-466726c679e4\") "
Jul 13 17:59:04.887215 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.887157    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7e197e21-e7a3-4362-a279-466726c679e4" (UID: "7e197e21-e7a3-4362-a279-466726c679e4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:59:04.887215 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.887191    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-home" (OuterVolumeSpecName: "home") pod "7e197e21-e7a3-4362-a279-466726c679e4" (UID: "7e197e21-e7a3-4362-a279-466726c679e4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:59:04.887401 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.887262    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-tmp-dir\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:59:04.887401 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.887285    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-home\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:59:04.887401 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.887310    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-model-cache" (OuterVolumeSpecName: "model-cache") pod "7e197e21-e7a3-4362-a279-466726c679e4" (UID: "7e197e21-e7a3-4362-a279-466726c679e4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:59:04.889144 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.889121    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-dshm" (OuterVolumeSpecName: "dshm") pod "7e197e21-e7a3-4362-a279-466726c679e4" (UID: "7e197e21-e7a3-4362-a279-466726c679e4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:59:04.889226 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.889173    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e197e21-e7a3-4362-a279-466726c679e4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7e197e21-e7a3-4362-a279-466726c679e4" (UID: "7e197e21-e7a3-4362-a279-466726c679e4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:59:04.889262 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.889228    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e197e21-e7a3-4362-a279-466726c679e4-kube-api-access-xqzm5" (OuterVolumeSpecName: "kube-api-access-xqzm5") pod "7e197e21-e7a3-4362-a279-466726c679e4" (UID: "7e197e21-e7a3-4362-a279-466726c679e4"). InnerVolumeSpecName "kube-api-access-xqzm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:59:04.988215 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.988182    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-dshm\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:59:04.988215 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.988210    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e197e21-e7a3-4362-a279-466726c679e4-model-cache\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:59:04.988215 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.988220    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e197e21-e7a3-4362-a279-466726c679e4-tls-certs\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:59:04.988520 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:04.988229    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqzm5\" (UniqueName: \"kubernetes.io/projected/7e197e21-e7a3-4362-a279-466726c679e4-kube-api-access-xqzm5\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 17:59:05.743585 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:05.743553    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"
Jul 13 17:59:05.744063 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:05.743590    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj" event={"ID":"7e197e21-e7a3-4362-a279-466726c679e4","Type":"ContainerDied","Data":"0ebcaacfbda5928bf946fc1dab72590ce49bd86acd0fdfd076f76fe3d4510122"}
Jul 13 17:59:05.744063 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:05.743641    2579 scope.go:117] "RemoveContainer" containerID="5ebd050725ec27d76ffb00636f7dac308cb3e9956e26b20cea21cb718b1454ed"
Jul 13 17:59:05.764094 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:05.764066    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"]
Jul 13 17:59:05.767965 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:05.767946    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-cb4ffa/test-model-cb4ffa-kserve-6ccfd6b89c-8wmlj"]
Jul 13 17:59:06.070956 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:06.070880    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e197e21-e7a3-4362-a279-466726c679e4" path="/var/lib/kubelet/pods/7e197e21-e7a3-4362-a279-466726c679e4/volumes"
Jul 13 17:59:06.071259 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:06.071247    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f86aebcc-e521-48b4-9a5b-ce29a49a8e38" path="/var/lib/kubelet/pods/f86aebcc-e521-48b4-9a5b-ce29a49a8e38/volumes"
Jul 13 17:59:06.690979 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:06.690948    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:06.793030 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:06.792999    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:09.683743 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:09.683713    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:59:10.945519 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:10.945481    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:11.048003 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:11.047957    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:15.451231 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:15.451146    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:15.670433 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:15.670395    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:16.439256 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:16.439218    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:16.540786 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:16.540744    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:26.210036 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:26.209997    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:29.292002 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:29.291968    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:59:30.878184 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:30.878152    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:36.749671 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:36.749629    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:36.817130 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:36.817093    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:41.576961 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:41.576909    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:41.809613 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:41.809581    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:42.202343 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:42.202311    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:42.488272 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:42.488182    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:42.670080 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:42.670027    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:45.905344 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:45.905293    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:46.095838 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:46.095792    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:46.196474 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:46.196375    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:46.297053 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:46.297026    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:46.706762 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:46.706732    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:46.803784 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:46.803747    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:50.422312 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:50.422265    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:50.905126 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:50.905087    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:51.088175 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:51.088141    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 17:59:51.215892 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:51.215805    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:52.120096 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:52.120059    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:54.011577 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:54.011528    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:54.093207 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:54.093175    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:54.185717 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:54.185680    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:54.287386 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:54.287274    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:54.658501 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:54.658466    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:54.759337 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:54.759293    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 17:59:58.545227 ip-10-0-141-144 kubenswrapper[2579]: I0713 17:59:58.545188    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:07.108707 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:07.108670    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:07.208741 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:07.208711    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:08.787711 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:08.787672    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:00:15.438204 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:15.438174    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:15.550442 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:15.550400    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:15.654448 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:15.654409    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:17.356529 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:17.356492    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:17.472961 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:17.472927    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:18.167185 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:18.167150    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:21.197811 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:21.197779    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:00:21.684339 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:21.684277    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:27.932177 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:27.932134    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:28.035087 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:28.035055    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:32.520880 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:32.520838    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:32.695711 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:32.695675    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:33.474840 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:33.474808    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:33.564623 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:33.564588    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:39.611547 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:39.611512    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:43.371258 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:43.371209    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:46.786273 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:46.786240    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:00:47.951838 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:47.951807    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:54.870920 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:54.870885    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:54.935821 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:54.935790    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:58.697724 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:58.697686    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:58.927345 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:58.927312    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:59.320245 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:59.320206    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:59.633020 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:59.632985    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:00:59.979187 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:00:59.979098    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:03.430633 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:03.430604    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:03.529501 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:03.529468    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:06.966515 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:06.966472    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:07.308998 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:07.308919    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:07.661764 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:07.661727    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:07.787902 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:07.787856    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:08.382675 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:08.382640    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:01:10.599304 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:10.599274    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:10.747667 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:10.747631    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:10.867717 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:10.867681    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:11.130094 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:11.130007    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:11.657250 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:11.657217    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:11.769230 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:11.769196    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:15.057220 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:15.057189    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:24.394488 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.394451    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:24.536450 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.536423    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:24.617426 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.617392    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:01:24.810539 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.810463    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"]
Jul 13 18:01:24.810764 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.810752    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e197e21-e7a3-4362-a279-466726c679e4" containerName="main"
Jul 13 18:01:24.810806 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.810766    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e197e21-e7a3-4362-a279-466726c679e4" containerName="main"
Jul 13 18:01:24.810806 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.810789    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f86aebcc-e521-48b4-9a5b-ce29a49a8e38" containerName="main"
Jul 13 18:01:24.810806 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.810794    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f86aebcc-e521-48b4-9a5b-ce29a49a8e38" containerName="main"
Jul 13 18:01:24.810919 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.810846    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e197e21-e7a3-4362-a279-466726c679e4" containerName="main"
Jul 13 18:01:24.810919 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.810855    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f86aebcc-e521-48b4-9a5b-ce29a49a8e38" containerName="main"
Jul 13 18:01:24.813680 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.813664    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.817253 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.817230    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f54db3\"/\"default-dockercfg-9h85h\""
Jul 13 18:01:24.817390 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.817279    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f54db3\"/\"openshift-service-ca.crt\""
Jul 13 18:01:24.817390 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.817233    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f54db3\"/\"kube-root-ca.crt\""
Jul 13 18:01:24.817390 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.817230    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f54db3\"/\"auth-test-model-f54db3-kserve-self-signed-certs\""
Jul 13 18:01:24.839462 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.839435    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"]
Jul 13 18:01:24.853127 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.853100    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt7dr\" (UniqueName: \"kubernetes.io/projected/c6c19243-971f-4630-b41e-e98b074f3592-kube-api-access-xt7dr\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.853243 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.853154    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-home\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.853243 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.853200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-dshm\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.853331 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.853290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6c19243-971f-4630-b41e-e98b074f3592-tls-certs\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.853331 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.853317    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-model-cache\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.853431 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.853336    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-tmp-dir\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.922475 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.922425    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:24.954576 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.954542    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-model-cache\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.954735 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.954578    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-tmp-dir\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.954735 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.954609    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt7dr\" (UniqueName: \"kubernetes.io/projected/c6c19243-971f-4630-b41e-e98b074f3592-kube-api-access-xt7dr\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.954735 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.954658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-home\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.954735 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.954673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-dshm\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.954735 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.954705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6c19243-971f-4630-b41e-e98b074f3592-tls-certs\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.955001 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.954981    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-tmp-dir\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.955063 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.955021    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-model-cache\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.955117 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.955079    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-home\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.957031 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.957011    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-dshm\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.957203 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.957188    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6c19243-971f-4630-b41e-e98b074f3592-tls-certs\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:24.977016 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:24.976993    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt7dr\" (UniqueName: \"kubernetes.io/projected/c6c19243-971f-4630-b41e-e98b074f3592-kube-api-access-xt7dr\") pod \"auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") " pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:25.121922 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:25.121894    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:25.277139 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:25.277100    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"]
Jul 13 18:01:25.281250 ip-10-0-141-144 kubenswrapper[2579]: W0713 18:01:25.281227    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6c19243_971f_4630_b41e_e98b074f3592.slice/crio-f2b3eb3ebe405451196676bbef349d658127959f6450048b321a57ff3925b223 WatchSource:0}: Error finding container f2b3eb3ebe405451196676bbef349d658127959f6450048b321a57ff3925b223: Status 404 returned error can't find the container with id f2b3eb3ebe405451196676bbef349d658127959f6450048b321a57ff3925b223
Jul 13 18:01:25.310525 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:25.310500    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm" event={"ID":"c6c19243-971f-4630-b41e-e98b074f3592","Type":"ContainerStarted","Data":"f2b3eb3ebe405451196676bbef349d658127959f6450048b321a57ff3925b223"}
Jul 13 18:01:26.316060 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:26.316026    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm" event={"ID":"c6c19243-971f-4630-b41e-e98b074f3592","Type":"ContainerStarted","Data":"e54232aebc3259d445473b6a4fdfcff8fd28cc210b9a1a6cfd05f877430c95de"}
Jul 13 18:01:26.336973 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:26.336924    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm" podStartSLOduration=2.336910273 podStartE2EDuration="2.336910273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:01:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:26.334847403 +0000 UTC m=+2646.986970025" watchObservedRunningTime="2026-07-13 18:01:26.336910273 +0000 UTC m=+2646.989032899"
Jul 13 18:01:33.551617 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:33.551580    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:33.650862 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:33.650824    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:35.122986 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:35.122953    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:35.122986 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:35.122998    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:35.136018 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:35.135993    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:35.363832 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:35.363800    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:01:36.830568 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:36.830535    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:01:45.795420 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:45.795380    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"]
Jul 13 18:01:45.798718 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:45.798696    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:45.801864 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:45.801845    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b57346\"/\"kube-root-ca.crt\""
Jul 13 18:01:45.801954 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:45.801924    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b57346\"/\"openshift-service-ca.crt\""
Jul 13 18:01:45.801954 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:45.801925    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b57346\"/\"auth-test-model-b57346-kserve-self-signed-certs\""
Jul 13 18:01:45.802074 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:45.801949    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b57346\"/\"default-dockercfg-hxt9s\""
Jul 13 18:01:45.807087 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:45.807064    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"]
Jul 13 18:01:45.902262 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:45.902227    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:01:45.931162 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:45.931131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-dshm\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:45.931303 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:45.931185    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-home\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:45.931303 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:45.931211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-model-cache\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:45.931303 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:45.931239    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbzqn\" (UniqueName: \"kubernetes.io/projected/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-kube-api-access-mbzqn\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:45.931303 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:45.931294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-tls-certs\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:45.931461 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:45.931326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-tmp-dir\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:46.031865 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.031832    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-dshm\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:46.032070 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.031896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-home\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:46.032070 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.031923    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-model-cache\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:46.032070 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.031961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbzqn\" (UniqueName: \"kubernetes.io/projected/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-kube-api-access-mbzqn\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:46.032070 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.032007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-tls-certs\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:46.032070 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.032033    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-tmp-dir\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:46.032439 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.032399    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-home\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:46.032439 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.032414    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-model-cache\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:46.032517 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.032449    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-tmp-dir\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:46.034176 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.034159    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-dshm\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:46.034477 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.034455    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-tls-certs\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:46.039614 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.039584    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbzqn\" (UniqueName: \"kubernetes.io/projected/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-kube-api-access-mbzqn\") pod \"auth-test-model-b57346-kserve-7bc6df75c5-fsvkw\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") " pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:46.108773 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.108690    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:46.245082 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.245047    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"]
Jul 13 18:01:46.248844 ip-10-0-141-144 kubenswrapper[2579]: W0713 18:01:46.248818    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c8dd180_6bc4_4d8b_88b5_cfb1aaf1ef11.slice/crio-f308f4b90dd1b40716e5bcf47edd23048d8115cb4b8fbf95a09366fd4d56a2d6 WatchSource:0}: Error finding container f308f4b90dd1b40716e5bcf47edd23048d8115cb4b8fbf95a09366fd4d56a2d6: Status 404 returned error can't find the container with id f308f4b90dd1b40716e5bcf47edd23048d8115cb4b8fbf95a09366fd4d56a2d6
Jul 13 18:01:46.395220 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.395182    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw" event={"ID":"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11","Type":"ContainerStarted","Data":"1db57a5322769e1d072aa8953346d9fc9018d6bb6783a039e7e806e3acabcb8a"}
Jul 13 18:01:46.395412 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.395234    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw" event={"ID":"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11","Type":"ContainerStarted","Data":"f308f4b90dd1b40716e5bcf47edd23048d8115cb4b8fbf95a09366fd4d56a2d6"}
Jul 13 18:01:46.413732 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:46.413683    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw" podStartSLOduration=1.4136665179999999 podStartE2EDuration="1.413666518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:01:46.412630959 +0000 UTC m=+2667.064753586" watchObservedRunningTime="2026-07-13 18:01:46.413666518 +0000 UTC m=+2667.065789140"
Jul 13 18:01:49.199136 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:49.199100    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:01:56.109361 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:56.109323    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:56.109828 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:56.109402    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:56.121910 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:56.121879    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:01:56.446820 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:01:56.446790    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:02:12.284804 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:02:12.284715    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:02:19.976853 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:02:19.976824    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 18:02:19.980457 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:02:19.980437    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 18:02:31.604190 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:02:31.604155    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:02:48.200978 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:02:48.200942    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:03:05.780646 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:03:05.780613    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:03:19.437279 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:03:19.437244    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:03:34.789831 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:03:34.789800    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:03:49.628022 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:03:49.627979    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"]
Jul 13 18:03:49.660055 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:03:49.660024    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:03:49.722095 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:03:49.722058    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:03:50.489220 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:03:50.489189    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"]
Jul 13 18:03:50.511243 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:03:50.511210    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:03:52.478877 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:03:52.478847    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:04:04.647849 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:04.647799    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm" podUID="c6c19243-971f-4630-b41e-e98b074f3592" containerName="main" containerID="cri-o://e54232aebc3259d445473b6a4fdfcff8fd28cc210b9a1a6cfd05f877430c95de" gracePeriod=45
Jul 13 18:04:04.889857 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:04.889832    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:04:04.966488 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:04.966394    2579 generic.go:356] "Generic (PLEG): container finished" podID="c6c19243-971f-4630-b41e-e98b074f3592" containerID="e54232aebc3259d445473b6a4fdfcff8fd28cc210b9a1a6cfd05f877430c95de" exitCode=0
Jul 13 18:04:04.966488 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:04.966435    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"
Jul 13 18:04:04.966686 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:04.966487    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm" event={"ID":"c6c19243-971f-4630-b41e-e98b074f3592","Type":"ContainerDied","Data":"e54232aebc3259d445473b6a4fdfcff8fd28cc210b9a1a6cfd05f877430c95de"}
Jul 13 18:04:04.966686 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:04.966538    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm" event={"ID":"c6c19243-971f-4630-b41e-e98b074f3592","Type":"ContainerDied","Data":"f2b3eb3ebe405451196676bbef349d658127959f6450048b321a57ff3925b223"}
Jul 13 18:04:04.966686 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:04.966556    2579 scope.go:117] "RemoveContainer" containerID="e54232aebc3259d445473b6a4fdfcff8fd28cc210b9a1a6cfd05f877430c95de"
Jul 13 18:04:04.974439 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:04.974421    2579 scope.go:117] "RemoveContainer" containerID="e54232aebc3259d445473b6a4fdfcff8fd28cc210b9a1a6cfd05f877430c95de"
Jul 13 18:04:04.974732 ip-10-0-141-144 kubenswrapper[2579]: E0713 18:04:04.974706    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e54232aebc3259d445473b6a4fdfcff8fd28cc210b9a1a6cfd05f877430c95de\": container with ID starting with e54232aebc3259d445473b6a4fdfcff8fd28cc210b9a1a6cfd05f877430c95de not found: ID does not exist" containerID="e54232aebc3259d445473b6a4fdfcff8fd28cc210b9a1a6cfd05f877430c95de"
Jul 13 18:04:04.974803 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:04.974737    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e54232aebc3259d445473b6a4fdfcff8fd28cc210b9a1a6cfd05f877430c95de"} err="failed to get container status \"e54232aebc3259d445473b6a4fdfcff8fd28cc210b9a1a6cfd05f877430c95de\": rpc error: code = NotFound desc = could not find container \"e54232aebc3259d445473b6a4fdfcff8fd28cc210b9a1a6cfd05f877430c95de\": container with ID starting with e54232aebc3259d445473b6a4fdfcff8fd28cc210b9a1a6cfd05f877430c95de not found: ID does not exist"
Jul 13 18:04:05.001043 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.001016    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-tmp-dir\") pod \"c6c19243-971f-4630-b41e-e98b074f3592\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") "
Jul 13 18:04:05.001129 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.001055    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-dshm\") pod \"c6c19243-971f-4630-b41e-e98b074f3592\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") "
Jul 13 18:04:05.001129 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.001078    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6c19243-971f-4630-b41e-e98b074f3592-tls-certs\") pod \"c6c19243-971f-4630-b41e-e98b074f3592\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") "
Jul 13 18:04:05.001194 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.001125    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xt7dr\" (UniqueName: \"kubernetes.io/projected/c6c19243-971f-4630-b41e-e98b074f3592-kube-api-access-xt7dr\") pod \"c6c19243-971f-4630-b41e-e98b074f3592\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") "
Jul 13 18:04:05.001194 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.001154    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-home\") pod \"c6c19243-971f-4630-b41e-e98b074f3592\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") "
Jul 13 18:04:05.001273 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.001205    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-model-cache\") pod \"c6c19243-971f-4630-b41e-e98b074f3592\" (UID: \"c6c19243-971f-4630-b41e-e98b074f3592\") "
Jul 13 18:04:05.001410 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.001327    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c6c19243-971f-4630-b41e-e98b074f3592" (UID: "c6c19243-971f-4630-b41e-e98b074f3592"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:04:05.001528 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.001452    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-home" (OuterVolumeSpecName: "home") pod "c6c19243-971f-4630-b41e-e98b074f3592" (UID: "c6c19243-971f-4630-b41e-e98b074f3592"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:04:05.001599 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.001522    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-tmp-dir\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:04:05.001599 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.001513    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-model-cache" (OuterVolumeSpecName: "model-cache") pod "c6c19243-971f-4630-b41e-e98b074f3592" (UID: "c6c19243-971f-4630-b41e-e98b074f3592"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:04:05.003368 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.003313    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6c19243-971f-4630-b41e-e98b074f3592-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c6c19243-971f-4630-b41e-e98b074f3592" (UID: "c6c19243-971f-4630-b41e-e98b074f3592"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:04:05.003368 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.003326    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-dshm" (OuterVolumeSpecName: "dshm") pod "c6c19243-971f-4630-b41e-e98b074f3592" (UID: "c6c19243-971f-4630-b41e-e98b074f3592"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:04:05.003515 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.003437    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6c19243-971f-4630-b41e-e98b074f3592-kube-api-access-xt7dr" (OuterVolumeSpecName: "kube-api-access-xt7dr") pod "c6c19243-971f-4630-b41e-e98b074f3592" (UID: "c6c19243-971f-4630-b41e-e98b074f3592"). InnerVolumeSpecName "kube-api-access-xt7dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:04:05.102068 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.102028    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-dshm\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:04:05.102068 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.102058    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c6c19243-971f-4630-b41e-e98b074f3592-tls-certs\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:04:05.102068 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.102068    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xt7dr\" (UniqueName: \"kubernetes.io/projected/c6c19243-971f-4630-b41e-e98b074f3592-kube-api-access-xt7dr\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:04:05.102068 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.102077    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-home\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:04:05.102340 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.102086    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c6c19243-971f-4630-b41e-e98b074f3592-model-cache\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:04:05.287995 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.287966    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"]
Jul 13 18:04:05.292099 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.292077    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/auth-test-model-f54db3-kserve-b4d6b9dc5-v4qbm"]
Jul 13 18:04:05.511362 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.511301    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw" podUID="7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11" containerName="main" containerID="cri-o://1db57a5322769e1d072aa8953346d9fc9018d6bb6783a039e7e806e3acabcb8a" gracePeriod=45
Jul 13 18:04:05.752961 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.752939    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:04:05.907057 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.906960    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-tmp-dir\") pod \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") "
Jul 13 18:04:05.907057 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.907016    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-dshm\") pod \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") "
Jul 13 18:04:05.907057 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.907039    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-home\") pod \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") "
Jul 13 18:04:05.907290 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.907064    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-model-cache\") pod \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") "
Jul 13 18:04:05.907290 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.907102    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-tls-certs\") pod \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") "
Jul 13 18:04:05.907290 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.907167    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbzqn\" (UniqueName: \"kubernetes.io/projected/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-kube-api-access-mbzqn\") pod \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\" (UID: \"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11\") "
Jul 13 18:04:05.907477 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.907304    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11" (UID: "7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:04:05.907477 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.907317    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-home" (OuterVolumeSpecName: "home") pod "7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11" (UID: "7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:04:05.907477 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.907372    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-model-cache" (OuterVolumeSpecName: "model-cache") pod "7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11" (UID: "7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:04:05.907477 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.907435    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-home\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:04:05.907477 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.907455    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-tmp-dir\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:04:05.909313 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.909291    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-dshm" (OuterVolumeSpecName: "dshm") pod "7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11" (UID: "7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:04:05.909402 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.909294    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-kube-api-access-mbzqn" (OuterVolumeSpecName: "kube-api-access-mbzqn") pod "7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11" (UID: "7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11"). InnerVolumeSpecName "kube-api-access-mbzqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:04:05.909402 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.909341    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11" (UID: "7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:04:05.972118 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.972087    2579 generic.go:356] "Generic (PLEG): container finished" podID="7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11" containerID="1db57a5322769e1d072aa8953346d9fc9018d6bb6783a039e7e806e3acabcb8a" exitCode=0
Jul 13 18:04:05.972301 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.972131    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"
Jul 13 18:04:05.972301 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.972176    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw" event={"ID":"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11","Type":"ContainerDied","Data":"1db57a5322769e1d072aa8953346d9fc9018d6bb6783a039e7e806e3acabcb8a"}
Jul 13 18:04:05.972301 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.972218    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw" event={"ID":"7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11","Type":"ContainerDied","Data":"f308f4b90dd1b40716e5bcf47edd23048d8115cb4b8fbf95a09366fd4d56a2d6"}
Jul 13 18:04:05.972301 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.972237    2579 scope.go:117] "RemoveContainer" containerID="1db57a5322769e1d072aa8953346d9fc9018d6bb6783a039e7e806e3acabcb8a"
Jul 13 18:04:05.984728 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.984707    2579 scope.go:117] "RemoveContainer" containerID="1db57a5322769e1d072aa8953346d9fc9018d6bb6783a039e7e806e3acabcb8a"
Jul 13 18:04:05.985005 ip-10-0-141-144 kubenswrapper[2579]: E0713 18:04:05.984983    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1db57a5322769e1d072aa8953346d9fc9018d6bb6783a039e7e806e3acabcb8a\": container with ID starting with 1db57a5322769e1d072aa8953346d9fc9018d6bb6783a039e7e806e3acabcb8a not found: ID does not exist" containerID="1db57a5322769e1d072aa8953346d9fc9018d6bb6783a039e7e806e3acabcb8a"
Jul 13 18:04:05.985064 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.985013    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1db57a5322769e1d072aa8953346d9fc9018d6bb6783a039e7e806e3acabcb8a"} err="failed to get container status \"1db57a5322769e1d072aa8953346d9fc9018d6bb6783a039e7e806e3acabcb8a\": rpc error: code = NotFound desc = could not find container \"1db57a5322769e1d072aa8953346d9fc9018d6bb6783a039e7e806e3acabcb8a\": container with ID starting with 1db57a5322769e1d072aa8953346d9fc9018d6bb6783a039e7e806e3acabcb8a not found: ID does not exist"
Jul 13 18:04:05.998888 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:05.998849    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"]
Jul 13 18:04:06.000294 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:06.000272    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b57346/auth-test-model-b57346-kserve-7bc6df75c5-fsvkw"]
Jul 13 18:04:06.008326 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:06.008303    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbzqn\" (UniqueName: \"kubernetes.io/projected/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-kube-api-access-mbzqn\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:04:06.008326 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:06.008326    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-dshm\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:04:06.008448 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:06.008336    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-model-cache\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:04:06.008448 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:06.008363    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11-tls-certs\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:04:06.070445 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:06.070410    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11" path="/var/lib/kubelet/pods/7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11/volumes"
Jul 13 18:04:06.070820 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:06.070806    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6c19243-971f-4630-b41e-e98b074f3592" path="/var/lib/kubelet/pods/c6c19243-971f-4630-b41e-e98b074f3592/volumes"
Jul 13 18:04:07.283993 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:07.283960    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:04:07.499942 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:07.499911    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:04:07.596879 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:07.596797    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:04:09.594849 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.594815    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"]
Jul 13 18:04:09.595201 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.595082    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11" containerName="main"
Jul 13 18:04:09.595201 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.595093    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11" containerName="main"
Jul 13 18:04:09.595201 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.595116    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6c19243-971f-4630-b41e-e98b074f3592" containerName="main"
Jul 13 18:04:09.595201 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.595121    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6c19243-971f-4630-b41e-e98b074f3592" containerName="main"
Jul 13 18:04:09.595201 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.595165    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c8dd180-6bc4-4d8b-88b5-cfb1aaf1ef11" containerName="main"
Jul 13 18:04:09.595201 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.595175    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6c19243-971f-4630-b41e-e98b074f3592" containerName="main"
Jul 13 18:04:09.599282 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.599263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.601668 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.601648    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f54db3\"/\"kube-root-ca.crt\""
Jul 13 18:04:09.602660 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.602642    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f54db3\"/\"default-dockercfg-9h85h\""
Jul 13 18:04:09.602764 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.602676    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f54db3\"/\"openshift-service-ca.crt\""
Jul 13 18:04:09.602764 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.602681    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f54db3\"/\"sub-test-model-f54db3-kserve-self-signed-certs\""
Jul 13 18:04:09.607726 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.607708    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"]
Jul 13 18:04:09.685932 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.685900    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:04:09.742105 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.742067    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84548429-bcda-4ae6-a7e2-22d6cce88e21-tls-certs\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.742281 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.742109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-model-cache\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.742281 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.742137    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-dshm\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.742281 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.742227    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxpc5\" (UniqueName: \"kubernetes.io/projected/84548429-bcda-4ae6-a7e2-22d6cce88e21-kube-api-access-sxpc5\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.742281 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.742255    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-tmp-dir\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.742281 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.742278    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-home\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.843694 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.843657    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-tmp-dir\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.843694 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.843697    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-home\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.843945 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.843759    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84548429-bcda-4ae6-a7e2-22d6cce88e21-tls-certs\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.843945 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.843777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-model-cache\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.843945 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.843797    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-dshm\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.843945 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.843844    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxpc5\" (UniqueName: \"kubernetes.io/projected/84548429-bcda-4ae6-a7e2-22d6cce88e21-kube-api-access-sxpc5\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.844173 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.844146    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-tmp-dir\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.844224 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.844187    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-home\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.844224 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.844213    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-model-cache\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.846050 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.845996    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-dshm\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.846392 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.846377    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84548429-bcda-4ae6-a7e2-22d6cce88e21-tls-certs\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.852212 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.852189    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxpc5\" (UniqueName: \"kubernetes.io/projected/84548429-bcda-4ae6-a7e2-22d6cce88e21-kube-api-access-sxpc5\") pod \"sub-test-model-f54db3-kserve-5cf49cf699-pbvcv\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") " pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:09.909135 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:09.909078    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:10.041067 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:10.041029    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"]
Jul 13 18:04:10.045424 ip-10-0-141-144 kubenswrapper[2579]: W0713 18:04:10.045397    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84548429_bcda_4ae6_a7e2_22d6cce88e21.slice/crio-82a3a3dc1623e4b6bda99491ce4b5ba8a6bb8f9ff2d2f4b7b54a83e2b074aec1 WatchSource:0}: Error finding container 82a3a3dc1623e4b6bda99491ce4b5ba8a6bb8f9ff2d2f4b7b54a83e2b074aec1: Status 404 returned error can't find the container with id 82a3a3dc1623e4b6bda99491ce4b5ba8a6bb8f9ff2d2f4b7b54a83e2b074aec1
Jul 13 18:04:10.996023 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:10.995986    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv" event={"ID":"84548429-bcda-4ae6-a7e2-22d6cce88e21","Type":"ContainerStarted","Data":"567f8914ec5530ae6043d2d5a4db51c82671febedbdc482d806c0df4798a0a43"}
Jul 13 18:04:10.996414 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:10.996034    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv" event={"ID":"84548429-bcda-4ae6-a7e2-22d6cce88e21","Type":"ContainerStarted","Data":"82a3a3dc1623e4b6bda99491ce4b5ba8a6bb8f9ff2d2f4b7b54a83e2b074aec1"}
Jul 13 18:04:11.013086 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:11.013034    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv" podStartSLOduration=2.013017963 podStartE2EDuration="2.013017963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:04:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:04:11.012062521 +0000 UTC m=+2811.664185147" watchObservedRunningTime="2026-07-13 18:04:11.013017963 +0000 UTC m=+2811.665140590"
Jul 13 18:04:19.909785 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:19.909754    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:19.910245 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:19.909803    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:19.922042 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:19.922015    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:20.043336 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:20.043309    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:04:22.474159 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:22.474125    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:04:31.525752 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:31.525717    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:04:31.585795 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:31.585764    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:04:56.606476 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.606434    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"]
Jul 13 18:04:56.609650 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.609632    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.615948 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.615658    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b57346\"/\"kube-root-ca.crt\""
Jul 13 18:04:56.616266 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.616246    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b57346\"/\"default-dockercfg-hxt9s\""
Jul 13 18:04:56.616266 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.616260    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b57346\"/\"openshift-service-ca.crt\""
Jul 13 18:04:56.616582 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.616568    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b57346\"/\"sub-test-model-b57346-kserve-self-signed-certs\""
Jul 13 18:04:56.620991 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.620965    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"]
Jul 13 18:04:56.639527 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.639488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:04:56.731838 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.731800    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4110f2e2-6e5c-4eab-b116-3bb1abde336b-tls-certs\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.732019 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.731852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-home\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.732019 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.731893    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-dshm\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.732019 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.731911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fwpx\" (UniqueName: \"kubernetes.io/projected/4110f2e2-6e5c-4eab-b116-3bb1abde336b-kube-api-access-9fwpx\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.732172 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.732021    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-model-cache\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.732172 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.732061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-tmp-dir\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.832942 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.832900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-dshm\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.832942 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.832945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fwpx\" (UniqueName: \"kubernetes.io/projected/4110f2e2-6e5c-4eab-b116-3bb1abde336b-kube-api-access-9fwpx\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.833209 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.832988    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-model-cache\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.833209 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.833031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-tmp-dir\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.833209 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.833106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4110f2e2-6e5c-4eab-b116-3bb1abde336b-tls-certs\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.833416 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.833322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-home\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.833487 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.833438    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-model-cache\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.833552 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.833529    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-tmp-dir\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.833639 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.833621    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-home\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.835471 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.835448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-dshm\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.835632 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.835615    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4110f2e2-6e5c-4eab-b116-3bb1abde336b-tls-certs\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.842531 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.842511    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fwpx\" (UniqueName: \"kubernetes.io/projected/4110f2e2-6e5c-4eab-b116-3bb1abde336b-kube-api-access-9fwpx\") pod \"sub-test-model-b57346-kserve-66c4f578d5-b5h9h\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") " pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:56.918082 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:56.918044    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:04:57.047607 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:57.047564    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"]
Jul 13 18:04:57.050023 ip-10-0-141-144 kubenswrapper[2579]: W0713 18:04:57.049993    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4110f2e2_6e5c_4eab_b116_3bb1abde336b.slice/crio-ba554c035ddbcf15c5af166b97bcc52f99ca8e23d5fe6188003bf55e920725fe WatchSource:0}: Error finding container ba554c035ddbcf15c5af166b97bcc52f99ca8e23d5fe6188003bf55e920725fe: Status 404 returned error can't find the container with id ba554c035ddbcf15c5af166b97bcc52f99ca8e23d5fe6188003bf55e920725fe
Jul 13 18:04:57.182661 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:57.182579    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h" event={"ID":"4110f2e2-6e5c-4eab-b116-3bb1abde336b","Type":"ContainerStarted","Data":"3ee9038a2f4fded997505a9ee3016978eace4090292498a6d6451d4a5013e314"}
Jul 13 18:04:57.182661 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:57.182617    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h" event={"ID":"4110f2e2-6e5c-4eab-b116-3bb1abde336b","Type":"ContainerStarted","Data":"ba554c035ddbcf15c5af166b97bcc52f99ca8e23d5fe6188003bf55e920725fe"}
Jul 13 18:04:57.213679 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:04:57.213630    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h" podStartSLOduration=1.213613579 podStartE2EDuration="1.213613579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:04:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:04:57.210056808 +0000 UTC m=+2857.862179432" watchObservedRunningTime="2026-07-13 18:04:57.213613579 +0000 UTC m=+2857.865736204"
Jul 13 18:05:01.329335 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:01.329299    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:05:06.918487 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:06.918435    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:05:06.918487 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:06.918492    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:05:06.931039 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:06.931011    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:05:07.234720 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:07.234632    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:05:15.987264 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:15.987183    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:05:32.774666 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:32.774632    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"]
Jul 13 18:05:32.793238 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:32.793204    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:05:33.594312 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:33.594282    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"]
Jul 13 18:05:33.614289 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:33.614260    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:05:38.195443 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:38.195398    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:05:45.687098 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.687064    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"]
Jul 13 18:05:45.690286 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.690268    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.692664 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.692640    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f54db3\"/\"rate-test-model-f54db3-kserve-self-signed-certs\""
Jul 13 18:05:45.699192 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.699169    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"]
Jul 13 18:05:45.724949 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.724918    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:05:45.848231 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.848193    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-dshm\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.848428 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.848240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-tls-certs\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.848428 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.848326    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-model-cache\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.848428 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.848344    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-tmp-dir\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.848547 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.848437    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-home\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.848547 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.848468    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc4zt\" (UniqueName: \"kubernetes.io/projected/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-kube-api-access-mc4zt\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.949781 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.949695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-model-cache\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.949781 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.949732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-tmp-dir\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.949781 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.949762    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-home\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.949781 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.949781    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc4zt\" (UniqueName: \"kubernetes.io/projected/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-kube-api-access-mc4zt\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.950120 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.949813    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-dshm\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.950120 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.949838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-tls-certs\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.950202 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.950136    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-tmp-dir\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.950241 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.950205    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-home\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.950277 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.950254    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-model-cache\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.952106 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.952085    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-dshm\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.952457 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.952438    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-tls-certs\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.961084 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.961058    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc4zt\" (UniqueName: \"kubernetes.io/projected/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-kube-api-access-mc4zt\") pod \"rate-test-model-f54db3-kserve-78c556cb67-6jt6s\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") " pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:45.999538 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:45.999506    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:46.130928 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:46.130902    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"]
Jul 13 18:05:46.133445 ip-10-0-141-144 kubenswrapper[2579]: W0713 18:05:46.133403    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb1a6512_1b0b_4a6d_83ed_e62b1a24a6ac.slice/crio-71d7eaa418fb1bcafb01340834760e143ae0f4305e55eae5d565398a8cdbf97d WatchSource:0}: Error finding container 71d7eaa418fb1bcafb01340834760e143ae0f4305e55eae5d565398a8cdbf97d: Status 404 returned error can't find the container with id 71d7eaa418fb1bcafb01340834760e143ae0f4305e55eae5d565398a8cdbf97d
Jul 13 18:05:46.391551 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:46.391518    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s" event={"ID":"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac","Type":"ContainerStarted","Data":"63617724d30598e374790bd8e36c4e95c0d511174624e0c4e424d82bda9dddc9"}
Jul 13 18:05:46.391721 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:46.391559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s" event={"ID":"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac","Type":"ContainerStarted","Data":"71d7eaa418fb1bcafb01340834760e143ae0f4305e55eae5d565398a8cdbf97d"}
Jul 13 18:05:46.409822 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:46.409771    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s" podStartSLOduration=1.40975542 podStartE2EDuration="1.40975542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:05:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:05:46.408006049 +0000 UTC m=+2907.060128687" watchObservedRunningTime="2026-07-13 18:05:46.40975542 +0000 UTC m=+2907.061878045"
Jul 13 18:05:47.794955 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:47.794916    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv" podUID="84548429-bcda-4ae6-a7e2-22d6cce88e21" containerName="main" containerID="cri-o://567f8914ec5530ae6043d2d5a4db51c82671febedbdc482d806c0df4798a0a43" gracePeriod=45
Jul 13 18:05:48.043796 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.043770    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:05:48.168001 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.167971    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84548429-bcda-4ae6-a7e2-22d6cce88e21-tls-certs\") pod \"84548429-bcda-4ae6-a7e2-22d6cce88e21\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") "
Jul 13 18:05:48.168204 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.168030    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-model-cache\") pod \"84548429-bcda-4ae6-a7e2-22d6cce88e21\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") "
Jul 13 18:05:48.168204 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.168065    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-dshm\") pod \"84548429-bcda-4ae6-a7e2-22d6cce88e21\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") "
Jul 13 18:05:48.168204 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.168099    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxpc5\" (UniqueName: \"kubernetes.io/projected/84548429-bcda-4ae6-a7e2-22d6cce88e21-kube-api-access-sxpc5\") pod \"84548429-bcda-4ae6-a7e2-22d6cce88e21\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") "
Jul 13 18:05:48.168204 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.168126    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-tmp-dir\") pod \"84548429-bcda-4ae6-a7e2-22d6cce88e21\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") "
Jul 13 18:05:48.168204 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.168142    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-home\") pod \"84548429-bcda-4ae6-a7e2-22d6cce88e21\" (UID: \"84548429-bcda-4ae6-a7e2-22d6cce88e21\") "
Jul 13 18:05:48.168493 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.168340    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-model-cache" (OuterVolumeSpecName: "model-cache") pod "84548429-bcda-4ae6-a7e2-22d6cce88e21" (UID: "84548429-bcda-4ae6-a7e2-22d6cce88e21"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:05:48.168493 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.168468    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "84548429-bcda-4ae6-a7e2-22d6cce88e21" (UID: "84548429-bcda-4ae6-a7e2-22d6cce88e21"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:05:48.168493 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.168484    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-home" (OuterVolumeSpecName: "home") pod "84548429-bcda-4ae6-a7e2-22d6cce88e21" (UID: "84548429-bcda-4ae6-a7e2-22d6cce88e21"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:05:48.168887 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.168826    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-tmp-dir\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:05:48.168887 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.168851    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-home\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:05:48.168887 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.168865    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-model-cache\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:05:48.170475 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.170439    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-dshm" (OuterVolumeSpecName: "dshm") pod "84548429-bcda-4ae6-a7e2-22d6cce88e21" (UID: "84548429-bcda-4ae6-a7e2-22d6cce88e21"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:05:48.170475 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.170467    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84548429-bcda-4ae6-a7e2-22d6cce88e21-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "84548429-bcda-4ae6-a7e2-22d6cce88e21" (UID: "84548429-bcda-4ae6-a7e2-22d6cce88e21"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:05:48.170475 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.170443    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84548429-bcda-4ae6-a7e2-22d6cce88e21-kube-api-access-sxpc5" (OuterVolumeSpecName: "kube-api-access-sxpc5") pod "84548429-bcda-4ae6-a7e2-22d6cce88e21" (UID: "84548429-bcda-4ae6-a7e2-22d6cce88e21"). InnerVolumeSpecName "kube-api-access-sxpc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:05:48.269569 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.269533    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84548429-bcda-4ae6-a7e2-22d6cce88e21-dshm\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:05:48.269569 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.269564    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxpc5\" (UniqueName: \"kubernetes.io/projected/84548429-bcda-4ae6-a7e2-22d6cce88e21-kube-api-access-sxpc5\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:05:48.269569 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.269575    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84548429-bcda-4ae6-a7e2-22d6cce88e21-tls-certs\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:05:48.400305 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.400269    2579 generic.go:356] "Generic (PLEG): container finished" podID="84548429-bcda-4ae6-a7e2-22d6cce88e21" containerID="567f8914ec5530ae6043d2d5a4db51c82671febedbdc482d806c0df4798a0a43" exitCode=0
Jul 13 18:05:48.400436 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.400317    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"
Jul 13 18:05:48.400436 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.400367    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv" event={"ID":"84548429-bcda-4ae6-a7e2-22d6cce88e21","Type":"ContainerDied","Data":"567f8914ec5530ae6043d2d5a4db51c82671febedbdc482d806c0df4798a0a43"}
Jul 13 18:05:48.400436 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.400415    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv" event={"ID":"84548429-bcda-4ae6-a7e2-22d6cce88e21","Type":"ContainerDied","Data":"82a3a3dc1623e4b6bda99491ce4b5ba8a6bb8f9ff2d2f4b7b54a83e2b074aec1"}
Jul 13 18:05:48.400436 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.400432    2579 scope.go:117] "RemoveContainer" containerID="567f8914ec5530ae6043d2d5a4db51c82671febedbdc482d806c0df4798a0a43"
Jul 13 18:05:48.408797 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.408781    2579 scope.go:117] "RemoveContainer" containerID="567f8914ec5530ae6043d2d5a4db51c82671febedbdc482d806c0df4798a0a43"
Jul 13 18:05:48.409056 ip-10-0-141-144 kubenswrapper[2579]: E0713 18:05:48.409020    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"567f8914ec5530ae6043d2d5a4db51c82671febedbdc482d806c0df4798a0a43\": container with ID starting with 567f8914ec5530ae6043d2d5a4db51c82671febedbdc482d806c0df4798a0a43 not found: ID does not exist" containerID="567f8914ec5530ae6043d2d5a4db51c82671febedbdc482d806c0df4798a0a43"
Jul 13 18:05:48.409097 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.409063    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"567f8914ec5530ae6043d2d5a4db51c82671febedbdc482d806c0df4798a0a43"} err="failed to get container status \"567f8914ec5530ae6043d2d5a4db51c82671febedbdc482d806c0df4798a0a43\": rpc error: code = NotFound desc = could not find container \"567f8914ec5530ae6043d2d5a4db51c82671febedbdc482d806c0df4798a0a43\": container with ID starting with 567f8914ec5530ae6043d2d5a4db51c82671febedbdc482d806c0df4798a0a43 not found: ID does not exist"
Jul 13 18:05:48.419890 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.419840    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"]
Jul 13 18:05:48.423475 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.423454    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/sub-test-model-f54db3-kserve-5cf49cf699-pbvcv"]
Jul 13 18:05:48.614901 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.614869    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h" podUID="4110f2e2-6e5c-4eab-b116-3bb1abde336b" containerName="main" containerID="cri-o://3ee9038a2f4fded997505a9ee3016978eace4090292498a6d6451d4a5013e314" gracePeriod=45
Jul 13 18:05:48.856216 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.856188    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:05:48.975197 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.975159    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4110f2e2-6e5c-4eab-b116-3bb1abde336b-tls-certs\") pod \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") "
Jul 13 18:05:48.975392 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.975217    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fwpx\" (UniqueName: \"kubernetes.io/projected/4110f2e2-6e5c-4eab-b116-3bb1abde336b-kube-api-access-9fwpx\") pod \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") "
Jul 13 18:05:48.975392 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.975245    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-model-cache\") pod \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") "
Jul 13 18:05:48.975392 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.975278    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-home\") pod \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") "
Jul 13 18:05:48.975392 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.975299    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-dshm\") pod \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") "
Jul 13 18:05:48.975392 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.975326    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-tmp-dir\") pod \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\" (UID: \"4110f2e2-6e5c-4eab-b116-3bb1abde336b\") "
Jul 13 18:05:48.975681 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.975534    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-home" (OuterVolumeSpecName: "home") pod "4110f2e2-6e5c-4eab-b116-3bb1abde336b" (UID: "4110f2e2-6e5c-4eab-b116-3bb1abde336b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:05:48.975681 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.975547    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-model-cache" (OuterVolumeSpecName: "model-cache") pod "4110f2e2-6e5c-4eab-b116-3bb1abde336b" (UID: "4110f2e2-6e5c-4eab-b116-3bb1abde336b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:05:48.975789 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.975749    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4110f2e2-6e5c-4eab-b116-3bb1abde336b" (UID: "4110f2e2-6e5c-4eab-b116-3bb1abde336b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:05:48.977453 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.977422    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-dshm" (OuterVolumeSpecName: "dshm") pod "4110f2e2-6e5c-4eab-b116-3bb1abde336b" (UID: "4110f2e2-6e5c-4eab-b116-3bb1abde336b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:05:48.977561 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.977489    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4110f2e2-6e5c-4eab-b116-3bb1abde336b-kube-api-access-9fwpx" (OuterVolumeSpecName: "kube-api-access-9fwpx") pod "4110f2e2-6e5c-4eab-b116-3bb1abde336b" (UID: "4110f2e2-6e5c-4eab-b116-3bb1abde336b"). InnerVolumeSpecName "kube-api-access-9fwpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:05:48.977561 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:48.977508    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4110f2e2-6e5c-4eab-b116-3bb1abde336b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4110f2e2-6e5c-4eab-b116-3bb1abde336b" (UID: "4110f2e2-6e5c-4eab-b116-3bb1abde336b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:05:49.076648 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:49.076611    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4110f2e2-6e5c-4eab-b116-3bb1abde336b-tls-certs\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:05:49.076648 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:49.076639    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fwpx\" (UniqueName: \"kubernetes.io/projected/4110f2e2-6e5c-4eab-b116-3bb1abde336b-kube-api-access-9fwpx\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:05:49.076648 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:49.076649    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-model-cache\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:05:49.076648 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:49.076657    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-home\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:05:49.076895 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:49.076664    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-dshm\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:05:49.076895 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:49.076671    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4110f2e2-6e5c-4eab-b116-3bb1abde336b-tmp-dir\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:05:49.407181 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:49.407147    2579 generic.go:356] "Generic (PLEG): container finished" podID="4110f2e2-6e5c-4eab-b116-3bb1abde336b" containerID="3ee9038a2f4fded997505a9ee3016978eace4090292498a6d6451d4a5013e314" exitCode=0
Jul 13 18:05:49.407391 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:49.407220    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"
Jul 13 18:05:49.407391 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:49.407249    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h" event={"ID":"4110f2e2-6e5c-4eab-b116-3bb1abde336b","Type":"ContainerDied","Data":"3ee9038a2f4fded997505a9ee3016978eace4090292498a6d6451d4a5013e314"}
Jul 13 18:05:49.407391 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:49.407303    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h" event={"ID":"4110f2e2-6e5c-4eab-b116-3bb1abde336b","Type":"ContainerDied","Data":"ba554c035ddbcf15c5af166b97bcc52f99ca8e23d5fe6188003bf55e920725fe"}
Jul 13 18:05:49.407391 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:49.407327    2579 scope.go:117] "RemoveContainer" containerID="3ee9038a2f4fded997505a9ee3016978eace4090292498a6d6451d4a5013e314"
Jul 13 18:05:49.416258 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:49.416239    2579 scope.go:117] "RemoveContainer" containerID="3ee9038a2f4fded997505a9ee3016978eace4090292498a6d6451d4a5013e314"
Jul 13 18:05:49.416572 ip-10-0-141-144 kubenswrapper[2579]: E0713 18:05:49.416549    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ee9038a2f4fded997505a9ee3016978eace4090292498a6d6451d4a5013e314\": container with ID starting with 3ee9038a2f4fded997505a9ee3016978eace4090292498a6d6451d4a5013e314 not found: ID does not exist" containerID="3ee9038a2f4fded997505a9ee3016978eace4090292498a6d6451d4a5013e314"
Jul 13 18:05:49.416631 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:49.416584    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ee9038a2f4fded997505a9ee3016978eace4090292498a6d6451d4a5013e314"} err="failed to get container status \"3ee9038a2f4fded997505a9ee3016978eace4090292498a6d6451d4a5013e314\": rpc error: code = NotFound desc = could not find container \"3ee9038a2f4fded997505a9ee3016978eace4090292498a6d6451d4a5013e314\": container with ID starting with 3ee9038a2f4fded997505a9ee3016978eace4090292498a6d6451d4a5013e314 not found: ID does not exist"
Jul 13 18:05:49.431785 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:49.431751    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"]
Jul 13 18:05:49.435879 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:49.435856    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b57346/sub-test-model-b57346-kserve-66c4f578d5-b5h9h"]
Jul 13 18:05:50.070871 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:50.070839    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4110f2e2-6e5c-4eab-b116-3bb1abde336b" path="/var/lib/kubelet/pods/4110f2e2-6e5c-4eab-b116-3bb1abde336b/volumes"
Jul 13 18:05:50.071242 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:50.071214    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84548429-bcda-4ae6-a7e2-22d6cce88e21" path="/var/lib/kubelet/pods/84548429-bcda-4ae6-a7e2-22d6cce88e21/volumes"
Jul 13 18:05:55.999979 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:55.999938    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:56.000411 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:56.000015    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:56.012643 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:56.012614    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:56.448950 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:56.448921    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:05:59.487864 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:05:59.487831    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:06:07.723504 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:07.723466    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:06:25.239658 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:25.239623    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:06:25.484654 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:25.484617    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:06:32.130172 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.130139    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"]
Jul 13 18:06:32.130638 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.130460    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84548429-bcda-4ae6-a7e2-22d6cce88e21" containerName="main"
Jul 13 18:06:32.130638 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.130473    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="84548429-bcda-4ae6-a7e2-22d6cce88e21" containerName="main"
Jul 13 18:06:32.130638 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.130495    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4110f2e2-6e5c-4eab-b116-3bb1abde336b" containerName="main"
Jul 13 18:06:32.130638 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.130500    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4110f2e2-6e5c-4eab-b116-3bb1abde336b" containerName="main"
Jul 13 18:06:32.130638 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.130546    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4110f2e2-6e5c-4eab-b116-3bb1abde336b" containerName="main"
Jul 13 18:06:32.130638 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.130557    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="84548429-bcda-4ae6-a7e2-22d6cce88e21" containerName="main"
Jul 13 18:06:32.133227 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.133211    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.137994 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.137976    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b57346\"/\"kube-root-ca.crt\""
Jul 13 18:06:32.138910 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.138892    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b57346\"/\"openshift-service-ca.crt\""
Jul 13 18:06:32.138996 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.138944    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b57346\"/\"rate-test-model-b57346-kserve-self-signed-certs\""
Jul 13 18:06:32.139048 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.139034    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b57346\"/\"default-dockercfg-hxt9s\""
Jul 13 18:06:32.154573 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.154548    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"]
Jul 13 18:06:32.188938 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.188906    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:06:32.241177 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.241140    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-home\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.241336 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.241207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-tmp-dir\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.241336 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.241254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-model-cache\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.241336 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.241314    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dthj4\" (UniqueName: \"kubernetes.io/projected/cb684db7-edae-4dfc-a7e8-bc4df9129fce-kube-api-access-dthj4\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.241505 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.241340    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb684db7-edae-4dfc-a7e8-bc4df9129fce-tls-certs\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.241505 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.241382    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-dshm\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.342746 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.342706    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb684db7-edae-4dfc-a7e8-bc4df9129fce-tls-certs\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.342746 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.342752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-dshm\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.343009 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.342796    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-home\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.343009 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.342849    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-tmp-dir\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.343009 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.342874    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-model-cache\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.343009 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.342916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dthj4\" (UniqueName: \"kubernetes.io/projected/cb684db7-edae-4dfc-a7e8-bc4df9129fce-kube-api-access-dthj4\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.343279 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.343258    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-tmp-dir\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.343327 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.343307    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-model-cache\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.343388 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.343325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-home\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.345066 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.345042    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-dshm\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.345326 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.345310    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb684db7-edae-4dfc-a7e8-bc4df9129fce-tls-certs\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.352781 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.352757    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dthj4\" (UniqueName: \"kubernetes.io/projected/cb684db7-edae-4dfc-a7e8-bc4df9129fce-kube-api-access-dthj4\") pod \"rate-test-model-b57346-kserve-569d47c775-bbd4f\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") " pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.442482 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.442381    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:32.573015 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.572979    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"]
Jul 13 18:06:32.575999 ip-10-0-141-144 kubenswrapper[2579]: W0713 18:06:32.575971    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb684db7_edae_4dfc_a7e8_bc4df9129fce.slice/crio-9c455bc84297eb716b136a49f314b441e6f6382c11e8cc48f73311198cefa957 WatchSource:0}: Error finding container 9c455bc84297eb716b136a49f314b441e6f6382c11e8cc48f73311198cefa957: Status 404 returned error can't find the container with id 9c455bc84297eb716b136a49f314b441e6f6382c11e8cc48f73311198cefa957
Jul 13 18:06:32.586262 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:32.586234    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f" event={"ID":"cb684db7-edae-4dfc-a7e8-bc4df9129fce","Type":"ContainerStarted","Data":"9c455bc84297eb716b136a49f314b441e6f6382c11e8cc48f73311198cefa957"}
Jul 13 18:06:33.591883 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:33.591848    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f" event={"ID":"cb684db7-edae-4dfc-a7e8-bc4df9129fce","Type":"ContainerStarted","Data":"ba85132d3c33594a3176341dcf393c413028852f09cef0355b7bc8a499270abc"}
Jul 13 18:06:33.621538 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:33.621484    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f" podStartSLOduration=1.621466339 podStartE2EDuration="1.621466339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:06:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:06:33.618668808 +0000 UTC m=+2954.270791463" watchObservedRunningTime="2026-07-13 18:06:33.621466339 +0000 UTC m=+2954.273588963"
Jul 13 18:06:34.294414 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:34.294381    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:06:34.555397 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:34.555296    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:06:34.651263 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:34.651226    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:06:37.388412 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:37.388364    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:06:37.584744 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:37.584716    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:06:42.442663 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:42.442578    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:42.442663 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:42.442623    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:42.455094 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:42.455066    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:42.637278 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:42.637251    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:06:52.778337 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:06:52.778297    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:07:08.778169 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:08.778137    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:07:15.804709 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:15.804675    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"]
Jul 13 18:07:15.830326 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:15.830297    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:07:16.615235 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:16.615204    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"]
Jul 13 18:07:16.646607 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:16.646576    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:07:17.595589 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:17.595560    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7446-139629448998704"]
Jul 13 18:07:17.598846 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:17.598827    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629448998704"
Jul 13 18:07:17.601060 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:17.601035    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-tbcbl\""
Jul 13 18:07:17.604625 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:17.604604    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7446-139629448998704"]
Jul 13 18:07:17.699969 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:17.699934    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkw6x\" (UniqueName: \"kubernetes.io/projected/214abb68-d1a8-4b5e-bc96-6a8429eca20d-kube-api-access-wkw6x\") pod \"test-curl-7446-139629448998704\" (UID: \"214abb68-d1a8-4b5e-bc96-6a8429eca20d\") " pod="openshift-ingress/test-curl-7446-139629448998704"
Jul 13 18:07:17.801025 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:17.800992    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkw6x\" (UniqueName: \"kubernetes.io/projected/214abb68-d1a8-4b5e-bc96-6a8429eca20d-kube-api-access-wkw6x\") pod \"test-curl-7446-139629448998704\" (UID: \"214abb68-d1a8-4b5e-bc96-6a8429eca20d\") " pod="openshift-ingress/test-curl-7446-139629448998704"
Jul 13 18:07:17.809461 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:17.809440    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkw6x\" (UniqueName: \"kubernetes.io/projected/214abb68-d1a8-4b5e-bc96-6a8429eca20d-kube-api-access-wkw6x\") pod \"test-curl-7446-139629448998704\" (UID: \"214abb68-d1a8-4b5e-bc96-6a8429eca20d\") " pod="openshift-ingress/test-curl-7446-139629448998704"
Jul 13 18:07:17.909564 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:17.909536    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629448998704"
Jul 13 18:07:18.034710 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:18.034679    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7446-139629448998704"]
Jul 13 18:07:18.037671 ip-10-0-141-144 kubenswrapper[2579]: W0713 18:07:18.037644    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod214abb68_d1a8_4b5e_bc96_6a8429eca20d.slice/crio-2836ad5ccc4b35e315aa4491528119313b0cdd4d4d4eb92a3a3469726bc12c5a WatchSource:0}: Error finding container 2836ad5ccc4b35e315aa4491528119313b0cdd4d4d4eb92a3a3469726bc12c5a: Status 404 returned error can't find the container with id 2836ad5ccc4b35e315aa4491528119313b0cdd4d4d4eb92a3a3469726bc12c5a
Jul 13 18:07:18.039023 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:18.039006    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 18:07:18.770376 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:18.770328    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7446-139629448998704" event={"ID":"214abb68-d1a8-4b5e-bc96-6a8429eca20d","Type":"ContainerStarted","Data":"2836ad5ccc4b35e315aa4491528119313b0cdd4d4d4eb92a3a3469726bc12c5a"}
Jul 13 18:07:19.775516 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:19.775476    2579 generic.go:356] "Generic (PLEG): container finished" podID="214abb68-d1a8-4b5e-bc96-6a8429eca20d" containerID="16b183239fb344987e6b29cfe67c05e3b2e490f9abe6bedd7f219582298c870c" exitCode=0
Jul 13 18:07:19.775902 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:19.775528    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7446-139629448998704" event={"ID":"214abb68-d1a8-4b5e-bc96-6a8429eca20d","Type":"ContainerDied","Data":"16b183239fb344987e6b29cfe67c05e3b2e490f9abe6bedd7f219582298c870c"}
Jul 13 18:07:20.001462 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:20.001434    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 18:07:20.005141 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:20.005117    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tt87_e81c2d84-cf2f-403d-a6de-8da683e40aba/ovn-acl-logging/0.log"
Jul 13 18:07:20.913990 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:20.913963    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629448998704"
Jul 13 18:07:20.938373 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:20.938316    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7446-139629448998704_214abb68-d1a8-4b5e-bc96-6a8429eca20d/test-curl-7446-139629448998704/0.log"
Jul 13 18:07:20.967100 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:20.967075    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7446-139629448998704"]
Jul 13 18:07:20.969336 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:20.969314    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7446-139629448998704"]
Jul 13 18:07:21.029428 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:21.029402    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkw6x\" (UniqueName: \"kubernetes.io/projected/214abb68-d1a8-4b5e-bc96-6a8429eca20d-kube-api-access-wkw6x\") pod \"214abb68-d1a8-4b5e-bc96-6a8429eca20d\" (UID: \"214abb68-d1a8-4b5e-bc96-6a8429eca20d\") "
Jul 13 18:07:21.031706 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:21.031636    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/214abb68-d1a8-4b5e-bc96-6a8429eca20d-kube-api-access-wkw6x" (OuterVolumeSpecName: "kube-api-access-wkw6x") pod "214abb68-d1a8-4b5e-bc96-6a8429eca20d" (UID: "214abb68-d1a8-4b5e-bc96-6a8429eca20d"). InnerVolumeSpecName "kube-api-access-wkw6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:07:21.130851 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:21.130818    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkw6x\" (UniqueName: \"kubernetes.io/projected/214abb68-d1a8-4b5e-bc96-6a8429eca20d-kube-api-access-wkw6x\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:07:21.784618 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:21.784593    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2836ad5ccc4b35e315aa4491528119313b0cdd4d4d4eb92a3a3469726bc12c5a"
Jul 13 18:07:21.784797 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:21.784618    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629448998704"
Jul 13 18:07:21.793985 ip-10-0-141-144 kubenswrapper[2579]: E0713 18:07:21.793958    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7446-139629448998704\" is forbidden: User \"system:node:ip-10-0-141-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-144.ec2.internal' and this object" podUID="214abb68-d1a8-4b5e-bc96-6a8429eca20d" pod="openshift-ingress/test-curl-7446-139629448998704"
Jul 13 18:07:22.070581 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:22.070504    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="214abb68-d1a8-4b5e-bc96-6a8429eca20d" path="/var/lib/kubelet/pods/214abb68-d1a8-4b5e-bc96-6a8429eca20d/volumes"
Jul 13 18:07:22.681769 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:22.681738    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:07:30.824112 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:30.824062    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s" podUID="db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac" containerName="main" containerID="cri-o://63617724d30598e374790bd8e36c4e95c0d511174624e0c4e424d82bda9dddc9" gracePeriod=45
Jul 13 18:07:31.070553 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.070529    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:07:31.117166 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.117139    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc4zt\" (UniqueName: \"kubernetes.io/projected/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-kube-api-access-mc4zt\") pod \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") "
Jul 13 18:07:31.117309 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.117185    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-tmp-dir\") pod \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") "
Jul 13 18:07:31.117309 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.117274    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-dshm\") pod \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") "
Jul 13 18:07:31.117309 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.117303    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-model-cache\") pod \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") "
Jul 13 18:07:31.117520 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.117377    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-home\") pod \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") "
Jul 13 18:07:31.117520 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.117407    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-tls-certs\") pod \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\" (UID: \"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac\") "
Jul 13 18:07:31.117611 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.117524    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac" (UID: "db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:07:31.117668 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.117629    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-home" (OuterVolumeSpecName: "home") pod "db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac" (UID: "db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:07:31.117668 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.117651    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-model-cache" (OuterVolumeSpecName: "model-cache") pod "db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac" (UID: "db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:07:31.117757 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.117672    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-tmp-dir\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:07:31.119495 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.119473    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac" (UID: "db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:07:31.119605 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.119493    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-dshm" (OuterVolumeSpecName: "dshm") pod "db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac" (UID: "db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:07:31.119605 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.119570    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-kube-api-access-mc4zt" (OuterVolumeSpecName: "kube-api-access-mc4zt") pod "db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac" (UID: "db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac"). InnerVolumeSpecName "kube-api-access-mc4zt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:07:31.218901 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.218861    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-dshm\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:07:31.218901 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.218893    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-model-cache\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:07:31.218901 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.218903    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-home\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:07:31.219128 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.218913    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-tls-certs\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:07:31.219128 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.218922    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc4zt\" (UniqueName: \"kubernetes.io/projected/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac-kube-api-access-mc4zt\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:07:31.634306 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.634265    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f" podUID="cb684db7-edae-4dfc-a7e8-bc4df9129fce" containerName="main" containerID="cri-o://ba85132d3c33594a3176341dcf393c413028852f09cef0355b7bc8a499270abc" gracePeriod=45
Jul 13 18:07:31.829693 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.829658    2579 generic.go:356] "Generic (PLEG): container finished" podID="db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac" containerID="63617724d30598e374790bd8e36c4e95c0d511174624e0c4e424d82bda9dddc9" exitCode=0
Jul 13 18:07:31.830062 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.829760    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"
Jul 13 18:07:31.830062 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.829778    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s" event={"ID":"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac","Type":"ContainerDied","Data":"63617724d30598e374790bd8e36c4e95c0d511174624e0c4e424d82bda9dddc9"}
Jul 13 18:07:31.830062 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.829834    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s" event={"ID":"db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac","Type":"ContainerDied","Data":"71d7eaa418fb1bcafb01340834760e143ae0f4305e55eae5d565398a8cdbf97d"}
Jul 13 18:07:31.830062 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.829860    2579 scope.go:117] "RemoveContainer" containerID="63617724d30598e374790bd8e36c4e95c0d511174624e0c4e424d82bda9dddc9"
Jul 13 18:07:31.832251 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.832177    2579 generic.go:356] "Generic (PLEG): container finished" podID="cb684db7-edae-4dfc-a7e8-bc4df9129fce" containerID="ba85132d3c33594a3176341dcf393c413028852f09cef0355b7bc8a499270abc" exitCode=0
Jul 13 18:07:31.832251 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.832230    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f" event={"ID":"cb684db7-edae-4dfc-a7e8-bc4df9129fce","Type":"ContainerDied","Data":"ba85132d3c33594a3176341dcf393c413028852f09cef0355b7bc8a499270abc"}
Jul 13 18:07:31.841246 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.841232    2579 scope.go:117] "RemoveContainer" containerID="63617724d30598e374790bd8e36c4e95c0d511174624e0c4e424d82bda9dddc9"
Jul 13 18:07:31.841545 ip-10-0-141-144 kubenswrapper[2579]: E0713 18:07:31.841525    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63617724d30598e374790bd8e36c4e95c0d511174624e0c4e424d82bda9dddc9\": container with ID starting with 63617724d30598e374790bd8e36c4e95c0d511174624e0c4e424d82bda9dddc9 not found: ID does not exist" containerID="63617724d30598e374790bd8e36c4e95c0d511174624e0c4e424d82bda9dddc9"
Jul 13 18:07:31.841614 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.841551    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63617724d30598e374790bd8e36c4e95c0d511174624e0c4e424d82bda9dddc9"} err="failed to get container status \"63617724d30598e374790bd8e36c4e95c0d511174624e0c4e424d82bda9dddc9\": rpc error: code = NotFound desc = could not find container \"63617724d30598e374790bd8e36c4e95c0d511174624e0c4e424d82bda9dddc9\": container with ID starting with 63617724d30598e374790bd8e36c4e95c0d511174624e0c4e424d82bda9dddc9 not found: ID does not exist"
Jul 13 18:07:31.852243 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.852221    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"]
Jul 13 18:07:31.854118 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.854099    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f54db3/rate-test-model-f54db3-kserve-78c556cb67-6jt6s"]
Jul 13 18:07:31.879641 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.879620    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:07:31.924691 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.924609    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dthj4\" (UniqueName: \"kubernetes.io/projected/cb684db7-edae-4dfc-a7e8-bc4df9129fce-kube-api-access-dthj4\") pod \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") "
Jul 13 18:07:31.924691 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.924682    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb684db7-edae-4dfc-a7e8-bc4df9129fce-tls-certs\") pod \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") "
Jul 13 18:07:31.924865 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.924727    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-model-cache\") pod \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") "
Jul 13 18:07:31.924865 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.924750    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-home\") pod \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") "
Jul 13 18:07:31.924945 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.924881    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-tmp-dir\") pod \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") "
Jul 13 18:07:31.924945 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.924920    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-dshm\") pod \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\" (UID: \"cb684db7-edae-4dfc-a7e8-bc4df9129fce\") "
Jul 13 18:07:31.925039 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.925004    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-home" (OuterVolumeSpecName: "home") pod "cb684db7-edae-4dfc-a7e8-bc4df9129fce" (UID: "cb684db7-edae-4dfc-a7e8-bc4df9129fce"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:07:31.925039 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.925017    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-model-cache" (OuterVolumeSpecName: "model-cache") pod "cb684db7-edae-4dfc-a7e8-bc4df9129fce" (UID: "cb684db7-edae-4dfc-a7e8-bc4df9129fce"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:07:31.925149 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.925118    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cb684db7-edae-4dfc-a7e8-bc4df9129fce" (UID: "cb684db7-edae-4dfc-a7e8-bc4df9129fce"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:07:31.925232 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.925214    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-model-cache\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:07:31.925288 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.925237    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-home\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:07:31.925288 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.925250    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-tmp-dir\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:07:31.926856 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.926829    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-dshm" (OuterVolumeSpecName: "dshm") pod "cb684db7-edae-4dfc-a7e8-bc4df9129fce" (UID: "cb684db7-edae-4dfc-a7e8-bc4df9129fce"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:07:31.926953 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.926881    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb684db7-edae-4dfc-a7e8-bc4df9129fce-kube-api-access-dthj4" (OuterVolumeSpecName: "kube-api-access-dthj4") pod "cb684db7-edae-4dfc-a7e8-bc4df9129fce" (UID: "cb684db7-edae-4dfc-a7e8-bc4df9129fce"). InnerVolumeSpecName "kube-api-access-dthj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:07:31.926953 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:31.926897    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb684db7-edae-4dfc-a7e8-bc4df9129fce-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cb684db7-edae-4dfc-a7e8-bc4df9129fce" (UID: "cb684db7-edae-4dfc-a7e8-bc4df9129fce"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:07:32.025973 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:32.025945    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb684db7-edae-4dfc-a7e8-bc4df9129fce-tls-certs\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:07:32.025973 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:32.025968    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb684db7-edae-4dfc-a7e8-bc4df9129fce-dshm\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:07:32.025973 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:32.025978    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dthj4\" (UniqueName: \"kubernetes.io/projected/cb684db7-edae-4dfc-a7e8-bc4df9129fce-kube-api-access-dthj4\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:07:32.069799 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:32.069760    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac" path="/var/lib/kubelet/pods/db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac/volumes"
Jul 13 18:07:32.838693 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:32.838656    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f" event={"ID":"cb684db7-edae-4dfc-a7e8-bc4df9129fce","Type":"ContainerDied","Data":"9c455bc84297eb716b136a49f314b441e6f6382c11e8cc48f73311198cefa957"}
Jul 13 18:07:32.838693 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:32.838694    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"
Jul 13 18:07:32.839222 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:32.838714    2579 scope.go:117] "RemoveContainer" containerID="ba85132d3c33594a3176341dcf393c413028852f09cef0355b7bc8a499270abc"
Jul 13 18:07:32.854440 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:32.854410    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"]
Jul 13 18:07:32.859791 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:32.859770    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b57346/rate-test-model-b57346-kserve-569d47c775-bbd4f"]
Jul 13 18:07:33.199495 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.199462    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7446-139629445096480"]
Jul 13 18:07:33.199734 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.199723    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac" containerName="main"
Jul 13 18:07:33.199778 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.199737    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac" containerName="main"
Jul 13 18:07:33.199778 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.199745    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="214abb68-d1a8-4b5e-bc96-6a8429eca20d" containerName="test-curl-7446-139629448998704"
Jul 13 18:07:33.199778 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.199751    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="214abb68-d1a8-4b5e-bc96-6a8429eca20d" containerName="test-curl-7446-139629448998704"
Jul 13 18:07:33.199778 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.199766    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb684db7-edae-4dfc-a7e8-bc4df9129fce" containerName="main"
Jul 13 18:07:33.199778 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.199771    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb684db7-edae-4dfc-a7e8-bc4df9129fce" containerName="main"
Jul 13 18:07:33.199929 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.199815    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="214abb68-d1a8-4b5e-bc96-6a8429eca20d" containerName="test-curl-7446-139629448998704"
Jul 13 18:07:33.199929 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.199825    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="db1a6512-1b0b-4a6d-83ed-e62b1a24a6ac" containerName="main"
Jul 13 18:07:33.199929 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.199831    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb684db7-edae-4dfc-a7e8-bc4df9129fce" containerName="main"
Jul 13 18:07:33.204121 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.204102    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445096480"
Jul 13 18:07:33.206441 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.206416    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-tbcbl\""
Jul 13 18:07:33.209249 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.209229    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7446-139629445096480"]
Jul 13 18:07:33.335494 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.335449    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ch2k\" (UniqueName: \"kubernetes.io/projected/cad41bf4-c6fc-48e7-8e20-93ce41d371da-kube-api-access-5ch2k\") pod \"test-curl-7446-139629445096480\" (UID: \"cad41bf4-c6fc-48e7-8e20-93ce41d371da\") " pod="openshift-ingress/test-curl-7446-139629445096480"
Jul 13 18:07:33.436922 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.436891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ch2k\" (UniqueName: \"kubernetes.io/projected/cad41bf4-c6fc-48e7-8e20-93ce41d371da-kube-api-access-5ch2k\") pod \"test-curl-7446-139629445096480\" (UID: \"cad41bf4-c6fc-48e7-8e20-93ce41d371da\") " pod="openshift-ingress/test-curl-7446-139629445096480"
Jul 13 18:07:33.445293 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.445270    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ch2k\" (UniqueName: \"kubernetes.io/projected/cad41bf4-c6fc-48e7-8e20-93ce41d371da-kube-api-access-5ch2k\") pod \"test-curl-7446-139629445096480\" (UID: \"cad41bf4-c6fc-48e7-8e20-93ce41d371da\") " pod="openshift-ingress/test-curl-7446-139629445096480"
Jul 13 18:07:33.513905 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.513812    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445096480"
Jul 13 18:07:33.635952 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.635914    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7446-139629445096480"]
Jul 13 18:07:33.638838 ip-10-0-141-144 kubenswrapper[2579]: W0713 18:07:33.638815    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcad41bf4_c6fc_48e7_8e20_93ce41d371da.slice/crio-32547c219daa71bfbbff4d2a566432e9caba221c574b1a0b8c75112053cdc5ea WatchSource:0}: Error finding container 32547c219daa71bfbbff4d2a566432e9caba221c574b1a0b8c75112053cdc5ea: Status 404 returned error can't find the container with id 32547c219daa71bfbbff4d2a566432e9caba221c574b1a0b8c75112053cdc5ea
Jul 13 18:07:33.844479 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:33.844389    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7446-139629445096480" event={"ID":"cad41bf4-c6fc-48e7-8e20-93ce41d371da","Type":"ContainerStarted","Data":"32547c219daa71bfbbff4d2a566432e9caba221c574b1a0b8c75112053cdc5ea"}
Jul 13 18:07:34.074532 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:34.072497    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb684db7-edae-4dfc-a7e8-bc4df9129fce" path="/var/lib/kubelet/pods/cb684db7-edae-4dfc-a7e8-bc4df9129fce/volumes"
Jul 13 18:07:34.852302 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:34.852215    2579 generic.go:356] "Generic (PLEG): container finished" podID="cad41bf4-c6fc-48e7-8e20-93ce41d371da" containerID="4f5531f9fd6bf1c975d7428ea0e3b4dc4413502723aea96fcb804b714b46711f" exitCode=0
Jul 13 18:07:34.852694 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:34.852300    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7446-139629445096480" event={"ID":"cad41bf4-c6fc-48e7-8e20-93ce41d371da","Type":"ContainerDied","Data":"4f5531f9fd6bf1c975d7428ea0e3b4dc4413502723aea96fcb804b714b46711f"}
Jul 13 18:07:35.986726 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:35.986703    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445096480"
Jul 13 18:07:36.006589 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:36.006564    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7446-139629445096480_cad41bf4-c6fc-48e7-8e20-93ce41d371da/test-curl-7446-139629445096480/0.log"
Jul 13 18:07:36.031187 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:36.031158    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7446-139629445096480"]
Jul 13 18:07:36.036435 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:36.036414    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7446-139629445096480"]
Jul 13 18:07:36.057745 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:36.057722    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ch2k\" (UniqueName: \"kubernetes.io/projected/cad41bf4-c6fc-48e7-8e20-93ce41d371da-kube-api-access-5ch2k\") pod \"cad41bf4-c6fc-48e7-8e20-93ce41d371da\" (UID: \"cad41bf4-c6fc-48e7-8e20-93ce41d371da\") "
Jul 13 18:07:36.059755 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:36.059732    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cad41bf4-c6fc-48e7-8e20-93ce41d371da-kube-api-access-5ch2k" (OuterVolumeSpecName: "kube-api-access-5ch2k") pod "cad41bf4-c6fc-48e7-8e20-93ce41d371da" (UID: "cad41bf4-c6fc-48e7-8e20-93ce41d371da"). InnerVolumeSpecName "kube-api-access-5ch2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:07:36.070159 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:36.070136    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cad41bf4-c6fc-48e7-8e20-93ce41d371da" path="/var/lib/kubelet/pods/cad41bf4-c6fc-48e7-8e20-93ce41d371da/volumes"
Jul 13 18:07:36.158176 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:36.158151    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ch2k\" (UniqueName: \"kubernetes.io/projected/cad41bf4-c6fc-48e7-8e20-93ce41d371da-kube-api-access-5ch2k\") on node \"ip-10-0-141-144.ec2.internal\" DevicePath \"\""
Jul 13 18:07:36.862452 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:36.862412    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7446-139629445096480"
Jul 13 18:07:36.862634 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:36.862467    2579 scope.go:117] "RemoveContainer" containerID="4f5531f9fd6bf1c975d7428ea0e3b4dc4413502723aea96fcb804b714b46711f"
Jul 13 18:07:36.929902 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:36.929866    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:07:37.030195 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:37.030165    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:07:46.762219 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:46.762186    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:07:50.081032 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:50.080996    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:07:51.322103 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:51.322071    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:07:57.662769 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:57.662733    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:07:57.752689 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:07:57.752656    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:08:02.379780 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:02.379740    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:08:02.676589 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:02.676500    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:08:03.399695 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:03.399643    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:08:03.500813 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:03.500777    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:08:13.232866 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:13.232832    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:08:16.385748 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:16.385716    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-ftw68"]
Jul 13 18:08:17.887065 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:17.887033    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:08:24.374602 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:24.374568    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:08:24.533068 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:24.533036    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:08:28.608818 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:28.608784    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:08:28.862940 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:28.862913    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:08:29.299565 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:29.299488    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-dbd7f785d-9cmpx_0c8521e9-b662-47d6-9382-470ddaff2ebe/authorino/0.log"
Jul 13 18:08:35.091340 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:35.091309    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sbgsv_87b9d2b2-7dce-4b69-bac3-86fa7f311981/manager/0.log"
Jul 13 18:08:35.228782 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:35.228755    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v_0c7c33de-6523-4cb1-8d36-57519999d8c7/copy-manifests/0.log"
Jul 13 18:08:35.235826 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:35.235799    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v_0c7c33de-6523-4cb1-8d36-57519999d8c7/manager/0.log"
Jul 13 18:08:39.077563 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:39.077530    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-dbd7f785d-9cmpx_0c8521e9-b662-47d6-9382-470ddaff2ebe/authorino/0.log"
Jul 13 18:08:39.805661 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:39.805631    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ftw68_c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7/limitador/0.log"
Jul 13 18:08:40.666060 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:40.666027    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65c65495b5-dkb6v_fd8eb3a5-d860-4ffd-b82d-8327055b3c97/kube-auth-proxy/0.log"
Jul 13 18:08:42.034954 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:42.034923    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-kw7ff_e74f467c-efda-438e-88a1-accd2016c715/main/0.log"
Jul 13 18:08:42.157856 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:42.157817    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-24wl2_fbbbdc5b-841a-4fdb-9d70-c531b515ca72/main/0.log"
Jul 13 18:08:46.671048 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.671009    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dg5t9/must-gather-z96zw"]
Jul 13 18:08:46.671456 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.671306    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cad41bf4-c6fc-48e7-8e20-93ce41d371da" containerName="test-curl-7446-139629445096480"
Jul 13 18:08:46.671456 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.671319    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad41bf4-c6fc-48e7-8e20-93ce41d371da" containerName="test-curl-7446-139629445096480"
Jul 13 18:08:46.671456 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.671388    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cad41bf4-c6fc-48e7-8e20-93ce41d371da" containerName="test-curl-7446-139629445096480"
Jul 13 18:08:46.674374 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.674329    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dg5t9/must-gather-z96zw"
Jul 13 18:08:46.676726 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.676706    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dg5t9\"/\"openshift-service-ca.crt\""
Jul 13 18:08:46.676819 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.676707    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dg5t9\"/\"default-dockercfg-7czpt\""
Jul 13 18:08:46.677642 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.677627    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dg5t9\"/\"kube-root-ca.crt\""
Jul 13 18:08:46.682704 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.682679    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:08:46.692549 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.692530    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dg5t9/must-gather-z96zw"]
Jul 13 18:08:46.778777 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.778743    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:08:46.810878 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.810852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7b7p\" (UniqueName: \"kubernetes.io/projected/26323998-cd76-4c68-865f-029d324fcf42-kube-api-access-f7b7p\") pod \"must-gather-z96zw\" (UID: \"26323998-cd76-4c68-865f-029d324fcf42\") " pod="openshift-must-gather-dg5t9/must-gather-z96zw"
Jul 13 18:08:46.811008 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.810892    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26323998-cd76-4c68-865f-029d324fcf42-must-gather-output\") pod \"must-gather-z96zw\" (UID: \"26323998-cd76-4c68-865f-029d324fcf42\") " pod="openshift-must-gather-dg5t9/must-gather-z96zw"
Jul 13 18:08:46.911817 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.911784    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7b7p\" (UniqueName: \"kubernetes.io/projected/26323998-cd76-4c68-865f-029d324fcf42-kube-api-access-f7b7p\") pod \"must-gather-z96zw\" (UID: \"26323998-cd76-4c68-865f-029d324fcf42\") " pod="openshift-must-gather-dg5t9/must-gather-z96zw"
Jul 13 18:08:46.911955 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.911825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26323998-cd76-4c68-865f-029d324fcf42-must-gather-output\") pod \"must-gather-z96zw\" (UID: \"26323998-cd76-4c68-865f-029d324fcf42\") " pod="openshift-must-gather-dg5t9/must-gather-z96zw"
Jul 13 18:08:46.912178 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.912158    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26323998-cd76-4c68-865f-029d324fcf42-must-gather-output\") pod \"must-gather-z96zw\" (UID: \"26323998-cd76-4c68-865f-029d324fcf42\") " pod="openshift-must-gather-dg5t9/must-gather-z96zw"
Jul 13 18:08:46.925668 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.925610    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7b7p\" (UniqueName: \"kubernetes.io/projected/26323998-cd76-4c68-865f-029d324fcf42-kube-api-access-f7b7p\") pod \"must-gather-z96zw\" (UID: \"26323998-cd76-4c68-865f-029d324fcf42\") " pod="openshift-must-gather-dg5t9/must-gather-z96zw"
Jul 13 18:08:46.983712 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:46.983674    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dg5t9/must-gather-z96zw"
Jul 13 18:08:47.114987 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:47.114958    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dg5t9/must-gather-z96zw"]
Jul 13 18:08:47.118086 ip-10-0-141-144 kubenswrapper[2579]: W0713 18:08:47.118044    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26323998_cd76_4c68_865f_029d324fcf42.slice/crio-35a2fc263d2886a6507261b3441b5f9213651065da35eb70ca0361153c4611fa WatchSource:0}: Error finding container 35a2fc263d2886a6507261b3441b5f9213651065da35eb70ca0361153c4611fa: Status 404 returned error can't find the container with id 35a2fc263d2886a6507261b3441b5f9213651065da35eb70ca0361153c4611fa
Jul 13 18:08:47.146127 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:47.146102    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dg5t9/must-gather-z96zw" event={"ID":"26323998-cd76-4c68-865f-029d324fcf42","Type":"ContainerStarted","Data":"35a2fc263d2886a6507261b3441b5f9213651065da35eb70ca0361153c4611fa"}
Jul 13 18:08:49.158502 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:49.158465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dg5t9/must-gather-z96zw" event={"ID":"26323998-cd76-4c68-865f-029d324fcf42","Type":"ContainerStarted","Data":"04502cecc08367d56e390128455d9ba2528cd733178c955b5318e1754decb46c"}
Jul 13 18:08:49.159051 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:49.159025    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dg5t9/must-gather-z96zw" event={"ID":"26323998-cd76-4c68-865f-029d324fcf42","Type":"ContainerStarted","Data":"e83ee4753becbb4e7c1ca002ce99124ab5b287b915076bbc28cd30a5390ccff0"}
Jul 13 18:08:49.855012 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:49.854984    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5n7fg_68c215bc-8805-4045-bfc2-16b86752c850/global-pull-secret-syncer/0.log"
Jul 13 18:08:49.996793 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:49.996758    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log"
Jul 13 18:08:50.103149 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:50.103119    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-144.ec2.internal_1b903a136f96045e7d3d6d1be0500b2d/haproxy/0.log"
Jul 13 18:08:55.036381 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:55.033337    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-dbd7f785d-9cmpx_0c8521e9-b662-47d6-9382-470ddaff2ebe/authorino/0.log"
Jul 13 18:08:55.350577 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:55.350474    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-ftw68_c5f22c1d-28d2-48b5-91c4-8a4f1c9e13e7/limitador/0.log"
Jul 13 18:08:57.613277 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:57.613248    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x2vv6_f70b2ab0-fc99-42dd-a6f1-9ac388a46546/node-exporter/0.log"
Jul 13 18:08:57.642543 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:57.642490    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x2vv6_f70b2ab0-fc99-42dd-a6f1-9ac388a46546/kube-rbac-proxy/0.log"
Jul 13 18:08:57.671489 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:57.671463    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x2vv6_f70b2ab0-fc99-42dd-a6f1-9ac388a46546/init-textfile/0.log"
Jul 13 18:08:59.398739 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:59.398698    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-lhf7r_5571bd9a-9e0a-4361-af35-c68a2e789240/networking-console-plugin/0.log"
Jul 13 18:08:59.785058 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:59.784934    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dg5t9/must-gather-z96zw" podStartSLOduration=12.659821409 podStartE2EDuration="13.784909223s" totalImagesPullingTime="1.125087814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:08:49.177505008 +0000 UTC m=+3089.829627634" watchObservedRunningTime="2026-07-13 18:08:59.784909223 +0000 UTC m=+3100.437031849"
Jul 13 18:08:59.785953 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:59.785925    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"]
Jul 13 18:08:59.794057 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:59.794029    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:08:59.795615 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:59.795588    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"]
Jul 13 18:08:59.950202 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:59.950162    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6172efed-3d8b-4a8b-81c4-53555ebd9350-proc\") pod \"perf-node-gather-daemonset-q84zt\" (UID: \"6172efed-3d8b-4a8b-81c4-53555ebd9350\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:08:59.950537 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:59.950516    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6172efed-3d8b-4a8b-81c4-53555ebd9350-podres\") pod \"perf-node-gather-daemonset-q84zt\" (UID: \"6172efed-3d8b-4a8b-81c4-53555ebd9350\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:08:59.950756 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:59.950735    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zd7z\" (UniqueName: \"kubernetes.io/projected/6172efed-3d8b-4a8b-81c4-53555ebd9350-kube-api-access-6zd7z\") pod \"perf-node-gather-daemonset-q84zt\" (UID: \"6172efed-3d8b-4a8b-81c4-53555ebd9350\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:08:59.950895 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:59.950879    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6172efed-3d8b-4a8b-81c4-53555ebd9350-sys\") pod \"perf-node-gather-daemonset-q84zt\" (UID: \"6172efed-3d8b-4a8b-81c4-53555ebd9350\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:08:59.951031 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:08:59.951016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6172efed-3d8b-4a8b-81c4-53555ebd9350-lib-modules\") pod \"perf-node-gather-daemonset-q84zt\" (UID: \"6172efed-3d8b-4a8b-81c4-53555ebd9350\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:09:00.052676 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:00.052588    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6172efed-3d8b-4a8b-81c4-53555ebd9350-proc\") pod \"perf-node-gather-daemonset-q84zt\" (UID: \"6172efed-3d8b-4a8b-81c4-53555ebd9350\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:09:00.052966 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:00.052936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6172efed-3d8b-4a8b-81c4-53555ebd9350-podres\") pod \"perf-node-gather-daemonset-q84zt\" (UID: \"6172efed-3d8b-4a8b-81c4-53555ebd9350\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:09:00.053115 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:00.053080    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6172efed-3d8b-4a8b-81c4-53555ebd9350-podres\") pod \"perf-node-gather-daemonset-q84zt\" (UID: \"6172efed-3d8b-4a8b-81c4-53555ebd9350\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:09:00.053115 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:00.052966    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6172efed-3d8b-4a8b-81c4-53555ebd9350-proc\") pod \"perf-node-gather-daemonset-q84zt\" (UID: \"6172efed-3d8b-4a8b-81c4-53555ebd9350\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:09:00.053300 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:00.053115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zd7z\" (UniqueName: \"kubernetes.io/projected/6172efed-3d8b-4a8b-81c4-53555ebd9350-kube-api-access-6zd7z\") pod \"perf-node-gather-daemonset-q84zt\" (UID: \"6172efed-3d8b-4a8b-81c4-53555ebd9350\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:09:00.053300 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:00.053231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6172efed-3d8b-4a8b-81c4-53555ebd9350-sys\") pod \"perf-node-gather-daemonset-q84zt\" (UID: \"6172efed-3d8b-4a8b-81c4-53555ebd9350\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:09:00.053300 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:00.053259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6172efed-3d8b-4a8b-81c4-53555ebd9350-lib-modules\") pod \"perf-node-gather-daemonset-q84zt\" (UID: \"6172efed-3d8b-4a8b-81c4-53555ebd9350\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:09:00.053487 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:00.053434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6172efed-3d8b-4a8b-81c4-53555ebd9350-lib-modules\") pod \"perf-node-gather-daemonset-q84zt\" (UID: \"6172efed-3d8b-4a8b-81c4-53555ebd9350\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:09:00.053548 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:00.053489    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6172efed-3d8b-4a8b-81c4-53555ebd9350-sys\") pod \"perf-node-gather-daemonset-q84zt\" (UID: \"6172efed-3d8b-4a8b-81c4-53555ebd9350\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:09:00.062173 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:00.062152    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zd7z\" (UniqueName: \"kubernetes.io/projected/6172efed-3d8b-4a8b-81c4-53555ebd9350-kube-api-access-6zd7z\") pod \"perf-node-gather-daemonset-q84zt\" (UID: \"6172efed-3d8b-4a8b-81c4-53555ebd9350\") " pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:09:00.108818 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:00.108782    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:09:00.301415 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:00.301378    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"]
Jul 13 18:09:00.304768 ip-10-0-141-144 kubenswrapper[2579]: W0713 18:09:00.304686    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6172efed_3d8b_4a8b_81c4_53555ebd9350.slice/crio-9ef47f502b1118ea804a0ea5a544e0b442b19e6a56f927221bd77812c67dcd5f WatchSource:0}: Error finding container 9ef47f502b1118ea804a0ea5a544e0b442b19e6a56f927221bd77812c67dcd5f: Status 404 returned error can't find the container with id 9ef47f502b1118ea804a0ea5a544e0b442b19e6a56f927221bd77812c67dcd5f
Jul 13 18:09:01.255315 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:01.255263    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt" event={"ID":"6172efed-3d8b-4a8b-81c4-53555ebd9350","Type":"ContainerStarted","Data":"8b8e6c6056b2ce1adc6607abe6bed13bd32a54f13d03a5c1a9a53ebb6e6923f1"}
Jul 13 18:09:01.255796 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:01.255340    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt" event={"ID":"6172efed-3d8b-4a8b-81c4-53555ebd9350","Type":"ContainerStarted","Data":"9ef47f502b1118ea804a0ea5a544e0b442b19e6a56f927221bd77812c67dcd5f"}
Jul 13 18:09:01.255796 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:01.255483    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:09:01.271130 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:01.271086    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt" podStartSLOduration=2.271071032 podStartE2EDuration="2.271071032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:08:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:09:01.270145957 +0000 UTC m=+3101.922268596" watchObservedRunningTime="2026-07-13 18:09:01.271071032 +0000 UTC m=+3101.923193657"
Jul 13 18:09:02.293268 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:02.293238    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-74f6n_5099f672-6f0f-4f21-91ec-2141e149b826/dns/0.log"
Jul 13 18:09:02.316102 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:02.316062    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-74f6n_5099f672-6f0f-4f21-91ec-2141e149b826/kube-rbac-proxy/0.log"
Jul 13 18:09:02.482536 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:02.482495    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x4xxd_36370993-71ea-41fa-89c7-743d6ff32ee5/dns-node-resolver/0.log"
Jul 13 18:09:03.051613 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:03.051581    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jgf4v_db0bf4bc-76e1-40ca-9d7f-8bd50243db39/node-ca/0.log"
Jul 13 18:09:04.195402 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:04.195374    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65c65495b5-dkb6v_fd8eb3a5-d860-4ffd-b82d-8327055b3c97/kube-auth-proxy/0.log"
Jul 13 18:09:05.085058 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:05.085032    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8fncn_c25ca52e-783f-4c9e-ae13-6abb444e19c6/serve-healthcheck-canary/0.log"
Jul 13 18:09:05.787033 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:05.787007    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qq2qh_6b0248ec-0182-46f2-8dc8-52ce1e757c81/kube-rbac-proxy/0.log"
Jul 13 18:09:05.820066 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:05.820034    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qq2qh_6b0248ec-0182-46f2-8dc8-52ce1e757c81/exporter/0.log"
Jul 13 18:09:05.842974 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:05.842948    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qq2qh_6b0248ec-0182-46f2-8dc8-52ce1e757c81/extractor/0.log"
Jul 13 18:09:07.271186 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:07.271155    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dg5t9/perf-node-gather-daemonset-q84zt"
Jul 13 18:09:08.353446 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:08.353414    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:09:08.452173 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:08.452130    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fs6kx_504c70e2-e9b9-4bbe-973d-9037d326099b/konnectivity-agent/0.log" limit=1024
Jul 13 18:09:08.625227 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:08.625197    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sbgsv_87b9d2b2-7dce-4b69-bac3-86fa7f311981/manager/0.log"
Jul 13 18:09:08.657862 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:08.657828    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v_0c7c33de-6523-4cb1-8d36-57519999d8c7/manager/0.log"
Jul 13 18:09:08.688608 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:08.688583    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc4cfb8b6-2bj5v_0c7c33de-6523-4cb1-8d36-57519999d8c7/copy-manifests/0.log"
Jul 13 18:09:10.025078 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:10.025052    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65c65495b5-dkb6v_fd8eb3a5-d860-4ffd-b82d-8327055b3c97/kube-auth-proxy/0.log"
Jul 13 18:09:10.304446 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:10.304342    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5df8bf697-7r8nw_f44635a6-1d4d-4261-beef-d057708d010d/manager/0.log"
Jul 13 18:09:11.484383 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:11.484293    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65c65495b5-dkb6v_fd8eb3a5-d860-4ffd-b82d-8327055b3c97/kube-auth-proxy/0.log"
Jul 13 18:09:16.711485 ip-10-0-141-144 kubenswrapper[2579]: I0713 18:09:16.711455    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7cppw_106d80d3-2c06-4715-90e2-a5b2fb627cb9/kube-multus/0.log"