Jul 06 17:38:33.302009 ip-10-0-128-234 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 17:38:33.743271 ip-10-0-128-234 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 17:38:33.743271 ip-10-0-128-234 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 17:38:33.743271 ip-10-0-128-234 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 17:38:33.743271 ip-10-0-128-234 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 17:38:33.743271 ip-10-0-128-234 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 17:38:33.743271 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.709857    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 17:38:33.743271 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714380    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 17:38:33.743271 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714395    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 17:38:33.743271 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714400    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 17:38:33.743271 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714404    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 17:38:33.743271 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714408    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 17:38:33.743271 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714413    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 17:38:33.743271 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714416    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 17:38:33.743271 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714420    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714425    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714429    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714432    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714436    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714440    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714444    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714447    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714451    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714455    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714459    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714463    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714467    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714472    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714476    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714480    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714486    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714491    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714495    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714499    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 17:38:33.744591 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714504    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714509    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714514    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714518    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714524    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714528    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714532    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714535    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714539    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714542    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714546    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714550    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714555    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714559    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714562    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714566    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714569    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714573    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714577    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714580    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 17:38:33.745464 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714584    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714588    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714591    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714595    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714599    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714604    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714607    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714611    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714615    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714618    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714622    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714626    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714631    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714635    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714641    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714645    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714651    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714656    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714660    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 17:38:33.746346 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714663    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714667    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714673    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714678    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714684    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714688    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714706    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714712    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714715    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714719    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714723    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714726    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714730    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714734    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714738    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714742    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714745    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714749    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714753    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714757    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 17:38:33.747225 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714763    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714766    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714770    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714774    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714778    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714781    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714785    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714789    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714794    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714797    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714801    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714804    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.714809    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715845    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715854    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715859    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715863    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715867    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715872    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715877    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 17:38:33.748107 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715881    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715884    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715888    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715892    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715896    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715902    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715908    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715912    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715916    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715920    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715925    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715928    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715932    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715936    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715940    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715944    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715948    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715952    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715955    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715959    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 17:38:33.749018 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715962    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715966    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715970    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715974    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715977    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715981    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715985    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715989    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715992    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.715996    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716000    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716004    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716008    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716015    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716020    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716024    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716028    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716032    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716035    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 17:38:33.749908 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716039    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716043    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716047    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716052    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716055    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716059    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716063    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716066    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716070    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716074    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716078    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716082    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716086    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716093    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716098    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716101    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716105    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716109    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716114    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716118    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 17:38:33.750999 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716123    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716128    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716132    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716138    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716142    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716146    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716150    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716154    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716157    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716161    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716166    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716170    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716174    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716178    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716181    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716185    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716189    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716192    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716196    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 17:38:33.751876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716200    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716204    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716209    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716212    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716216    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716220    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716224    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716228    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716231    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716235    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716239    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716243    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716247    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716251    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716789    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716796    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716805    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716811    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716815    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716819    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 17:38:33.755372 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716823    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716826    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716830    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716834    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716838    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716842    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716845    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716849    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716852    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716859    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716864    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716869    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716873    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716879    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716884    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716888    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716892    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716896    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 17:38:33.756432 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716901    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716905    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716910    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716914    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716918    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716921    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716925    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716928    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716932    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716936    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716941    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716944    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716947    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716951    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716955    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716959    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716962    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716965    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716969    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716973    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 17:38:33.763295 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716977    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716980    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716985    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716988    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716991    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716995    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.716998    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717002    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717005    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717009    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717013    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717017    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717021    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717024    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717028    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717032    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717035    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717039    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717042    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717046    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 17:38:33.764202 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717049    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717053    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717058    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717062    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717065    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717068    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717073    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717077    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717083    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717089    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717093    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717097    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717101    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717105    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717108    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717112    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717116    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717119    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717123    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717127    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 17:38:33.765083 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717131    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717134    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717138    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717141    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717145    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717149    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717153    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717157    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717160    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717164    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717168    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717171    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717175    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717179    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.717184    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717275    2570 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717285    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717294    2570 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717300    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717307    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717314    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 17:38:33.765967 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717321    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717327    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717331    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717335    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717339    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717344    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717349    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717354    2570 flags.go:64] FLAG: --cgroup-root=""
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717357    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717362    2570 flags.go:64] FLAG: --client-ca-file=""
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717366    2570 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717371    2570 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717377    2570 flags.go:64] FLAG: --cluster-domain=""
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717381    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717386    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717390    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717395    2570 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717400    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717404    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717408    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717412    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717417    2570 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717422    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717426    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 17:38:33.766844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717431    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717436    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717442    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717447    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717451    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717455    2570 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717460    2570 flags.go:64] FLAG: --enable-server="true"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717466    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717473    2570 flags.go:64] FLAG: --event-burst="100"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717478    2570 flags.go:64] FLAG: --event-qps="50"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717482    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717486    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717491    2570 flags.go:64] FLAG: --eviction-hard=""
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717496    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717501    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717505    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717510    2570 flags.go:64] FLAG: --eviction-soft=""
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717514    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717519    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717523    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717528    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717531    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717535    2570 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717540    2570 flags.go:64] FLAG: --feature-gates=""
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717545    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 17:38:33.767970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717550    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717554    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717559    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717563    2570 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717568    2570 flags.go:64] FLAG: --help="false"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717572    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-128-234.ec2.internal"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717577    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717580    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717586    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717591    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717596    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717599    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717603    2570 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717608    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717614    2570 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717619    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717624    2570 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717628    2570 flags.go:64] FLAG: --kube-reserved=""
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717632    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717637    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717641    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717646    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717649    2570 flags.go:64] FLAG: --lock-file=""
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717653    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 17:38:33.769054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717658    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717662    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717670    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717673    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717677    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717681    2570 flags.go:64] FLAG: --logging-format="text"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717685    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717703    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717708    2570 flags.go:64] FLAG: --manifest-url=""
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717713    2570 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717719    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717723    2570 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717729    2570 flags.go:64] FLAG: --max-pods="110"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717734    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717738    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717742    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717748    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717752    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717757    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717760    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717771    2570 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717775    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717781    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 17:38:33.769872 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717785    2570 flags.go:64] FLAG: --pod-cidr=""
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717791    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717798    2570 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717803    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717808    2570 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717812    2570 flags.go:64] FLAG: --port="10250"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717817    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717821    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c32978e0792e6a8c"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717826    2570 flags.go:64] FLAG: --qos-reserved=""
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717830    2570 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717835    2570 flags.go:64] FLAG: --register-node="true"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717838    2570 flags.go:64] FLAG: --register-with-taints=""
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717843    2570 flags.go:64] FLAG: --registry-burst="10"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717848    2570 flags.go:64] FLAG: --registry-qps="5"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717851    2570 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717856    2570 flags.go:64] FLAG: --reserved-memory=""
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717861    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717865    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717869    2570 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717873    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717877    2570 flags.go:64] FLAG: --runonce="false"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717881    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717885    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717889    2570 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717894    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 17:38:33.770481 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717899    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717904    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717908    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717912    2570 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717916    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717920    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717926    2570 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717931    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717936    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717941    2570 flags.go:64] FLAG: --system-cgroups=""
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717946    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717953    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717957    2570 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717961    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717967    2570 flags.go:64] FLAG: --tls-min-version=""
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717971    2570 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717975    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717979    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717983    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717988    2570 flags.go:64] FLAG: --v="2"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717994    2570 flags.go:64] FLAG: --version="false"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.717999    2570 flags.go:64] FLAG: --vmodule=""
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.718004    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.718009    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718168    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 17:38:33.771534 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718172    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718177    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718182    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718185    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718189    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718193    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718196    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718203    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718206    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718210    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718216    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718221    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718225    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718229    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718234    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718238    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718243    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718248    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718253    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718257    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 17:38:33.772579 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718260    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718264    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718268    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718272    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718275    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718279    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718283    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718286    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718290    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718294    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718298    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718301    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718305    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718308    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718312    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718316    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718320    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718324    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718328    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718333    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 17:38:33.777266 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718337    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718341    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718345    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718349    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718353    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718356    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718362    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718366    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718369    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718373    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718378    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718382    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718385    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718389    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718393    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718397    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718401    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718405    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718410    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 17:38:33.779258 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718415    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718419    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718423    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718427    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718430    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718434    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718438    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718442    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718446    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718450    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718453    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718457    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718461    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718465    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718469    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718473    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718477    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718481    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718484    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718490    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 17:38:33.781535 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718494    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718498    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718501    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718505    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718510    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718513    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718517    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718521    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718525    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718528    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718532    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718536    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718539    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718543    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718566    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718571    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718576    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718579    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 17:38:33.782280 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.718583    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 17:38:33.782966 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.718591    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 17:38:33.782966 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.725687    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 17:38:33.782966 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.725724    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 17:38:33.782966 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.725743    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 17:38:33.782966 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.725754    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 17:38:33.782966 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725812    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 17:38:33.782966 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725817    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 17:38:33.782966 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725821    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 17:38:33.782966 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725824    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 17:38:33.782966 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725827    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 17:38:33.782966 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725830    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 17:38:33.782966 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725833    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 17:38:33.782966 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725836    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 17:38:33.782966 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725838    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 17:38:33.782966 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725841    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725844    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725848    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725852    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725855    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725858    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725861    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725864    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725867    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725870    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725875    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725878    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725881    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725884    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725887    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725889    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725892    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725894    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725897    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725900    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 17:38:33.783685 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725904    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 17:38:33.784135 ip-10-0-128-234 systemd[1]: Started Kubernetes Kubelet.
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725907    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725910    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725913    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725915    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725918    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725921    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725923    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725926    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725928    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725931    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725934    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725937    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725940    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725942    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725945    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725947    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725950    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725952    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725955    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 17:38:33.784876 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725957    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725960    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725964    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725966    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725969    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725971    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725974    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725977    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725980    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725982    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725985    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725988    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725990    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725994    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.725998    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726001    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726005    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726009    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726012    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 17:38:33.787116 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726015    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726018    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726020    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726023    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726026    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726029    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726031    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726034    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726036    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726039    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726041    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726045    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726047    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726049    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726052    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726056    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726059    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726062    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726066    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726068    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 17:38:33.789357 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726071    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 17:38:33.802442 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726073    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 17:38:33.802442 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726076    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 17:38:33.802442 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726078    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 17:38:33.802442 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726081    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 17:38:33.802442 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726084    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 17:38:33.802442 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726086    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 17:38:33.802442 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726089    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 17:38:33.802442 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726092    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 17:38:33.802442 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726094    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 17:38:33.802442 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726097    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 17:38:33.802442 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.726102    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 17:38:33.802442 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726217    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 17:38:33.802442 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726222    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 17:38:33.802442 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726225    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 17:38:33.802442 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726227    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726230    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726234    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726238    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726241    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726244    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726247    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726250    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726252    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726255    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726258    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726261    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726264    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726268    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726270    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726274    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726277    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726280    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726282    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726285    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 17:38:33.803306 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726288    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726291    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726295    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726298    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726301    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726304    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726307    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726310    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726312    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726315    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726317    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726320    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726323    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726325    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726328    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726330    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726333    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726335    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726338    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 17:38:33.806550 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726340    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726343    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726345    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726349    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726353    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726356    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726360    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726363    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726368    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726371    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726374    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726376    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726379    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726381    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726384    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726387    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726389    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726391    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726394    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726397    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 17:38:33.807232 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726399    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726402    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726404    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726407    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726409    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726412    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726414    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726417    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726420    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726422    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726425    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726427    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726430    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726432    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726435    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726438    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726440    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726443    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726447    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726450    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 17:38:33.807848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726454    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726457    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726459    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726462    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726464    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726467    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726470    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726472    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726474    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726477    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726480    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726482    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726485    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726488    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726490    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726493    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 17:38:33.808484 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:33.726496    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 17:38:33.975238 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.726500    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 17:38:33.975238 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.726622    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 17:38:33.975238 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.729524    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 17:38:33.975238 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.730939    2570 server.go:1019] "Starting client certificate rotation"
Jul 06 17:38:33.975238 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.731041    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 17:38:33.975238 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.731072    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 17:38:33.975238 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.733323    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 17:38:33.975238 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.736401    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 17:38:33.975238 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.746781    2570 log.go:25] "Validated CRI v1 runtime API"
Jul 06 17:38:33.975238 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.751752    2570 log.go:25] "Validated CRI v1 image API"
Jul 06 17:38:33.975238 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.753286    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 17:38:33.975238 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.756413    2570 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7e3c7fb1-a961-4b28-88c9-152edfabf5ad:/dev/nvme0n1p4 a78fc155-8f93-44bb-975b-f2b1304f1e8e:/dev/nvme0n1p3]
Jul 06 17:38:33.998405 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.756427    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 17:38:33.998405 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.761575    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.761860    2570 manager.go:216] Machine: {Timestamp:2026-07-06 17:38:33.760387282 +0000 UTC m=+0.338588110 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099628 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2208af7fb94a728691edcecddce5f6 SystemUUID:ec2208af-7fb9-4a72-8691-edcecddce5f6 BootID:1146bba1-72d6-45df-ba16-35b7995eab75 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d2:7f:69:79:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d2:7f:69:79:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:8f:e6:3e:f3:3c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.761971    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.762091    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.764146    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.764172    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.764816    2570 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.764826    2570 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.764834    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.765579    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.766807    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.770900    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.771018    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.771047    2570 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.771056    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.771072    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.771082    2570 kubelet.go:398] "Adding apiserver pod source"
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.771091    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 17:38:33.998751 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.771460    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.771475    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.773532    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.776121    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.776158    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.777150    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.777167    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.777175    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.777183    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.777193    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.777200    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.777209    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.777214    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.777220    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.777225    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.777239    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.777245    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.777937    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.777946    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.783243    2570 server.go:1268] "Started kubelet"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.783344    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.783415    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.783364    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.788167    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-njd7n"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:33.788750    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:33.788899    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.788957    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.789113    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-njd7n"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:33.790036    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.791549    2570 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.791652    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:33.799472    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-234.ec2.internal.18bfc40775d99272  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-234.ec2.internal,UID:ip-10-0-128-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-234.ec2.internal,},FirstTimestamp:2026-07-06 17:38:33.783014002 +0000 UTC m=+0.361214830,LastTimestamp:2026-07-06 17:38:33.783014002 +0000 UTC m=+0.361214830,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-234.ec2.internal,}"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.811004    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.811011    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:33.811114    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.816050    2570 factory.go:153] Registering CRI-O factory
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.816067    2570 factory.go:223] Registration of the crio container factory successfully
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.816116    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 17:38:33.999314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.816125    2570 factory.go:55] Registering systemd factory
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.816132    2570 factory.go:223] Registration of the systemd container factory successfully
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.816157    2570 factory.go:103] Registering Raw factory
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.816171    2570 manager.go:1196] Started watching for new ooms in manager
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.816269    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.816271    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.816292    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.816391    2570 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.816396    2570 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.816579    2570 manager.go:349] Starting recovery of all containers
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.822841    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:33.825927    2570 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-234.ec2.internal\" not found" node="ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.826348    2570 manager.go:354] Recovery completed
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.831900    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.833709    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.833737    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.833748    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.834221    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.834229    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.834244    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.834246    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.835517    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.835539    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.835548    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.836490    2570 policy_none.go:49] "None policy: Start"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.836508    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.836518    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.838442    2570 policy_none.go:47] "Start"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.887243    2570 manager.go:337] "Starting Device Plugin manager"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:33.887455    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.887469    2570 server.go:87] "Starting device plugin registration server"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.887743    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.887757    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.887853    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.887937    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.887948    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:33.888428    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:33.888486    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.966299    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.967543    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.967593    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.967618    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:33.967660    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.970464    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.990112    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.991096    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.991127    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.991141    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.991190    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:33.999681    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.000422 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:33.999716    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-234.ec2.internal\": node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.034405    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.068429    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"]
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.068531    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.069499    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.069528    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.069538    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.071815    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.071935    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.071965    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.073224    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.073227    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.073246    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.073256    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.073247    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.073290    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.075420    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.075444    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.076325    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.076341    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.076349    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.107621    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-234.ec2.internal\" not found" node="ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.112189    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-234.ec2.internal\" not found" node="ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.183216 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.136279    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 06 17:38:34.374634 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.217392    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3621fce897cec71d75ea532d62b7211-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"d3621fce897cec71d75ea532d62b7211\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.374634 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.217422    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1822161f850ef2b3317aaf5916b61399-config\") pod \"kube-apiserver-proxy-ip-10-0-128-234.ec2.internal\" (UID: \"1822161f850ef2b3317aaf5916b61399\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.374634 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.217440    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3621fce897cec71d75ea532d62b7211-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"d3621fce897cec71d75ea532d62b7211\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.374634 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.236610    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 06 17:38:34.374634 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.318355    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3621fce897cec71d75ea532d62b7211-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"d3621fce897cec71d75ea532d62b7211\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.374634 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.318396    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3621fce897cec71d75ea532d62b7211-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"d3621fce897cec71d75ea532d62b7211\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.374634 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.318415    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1822161f850ef2b3317aaf5916b61399-config\") pod \"kube-apiserver-proxy-ip-10-0-128-234.ec2.internal\" (UID: \"1822161f850ef2b3317aaf5916b61399\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.374634 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.318457    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1822161f850ef2b3317aaf5916b61399-config\") pod \"kube-apiserver-proxy-ip-10-0-128-234.ec2.internal\" (UID: \"1822161f850ef2b3317aaf5916b61399\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.374634 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.318468    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3621fce897cec71d75ea532d62b7211-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"d3621fce897cec71d75ea532d62b7211\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.374634 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.318468    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d3621fce897cec71d75ea532d62b7211-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"d3621fce897cec71d75ea532d62b7211\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.374634 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.337515    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 06 17:38:34.548258 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.410668    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.548258 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.414603    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.548258 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.438123    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 06 17:38:34.548258 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.539810    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 06 17:38:34.701250 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.640848    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Jul 06 17:38:34.701250 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.692919    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.711551    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.723326    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.725392    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.729900    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.730036    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.730083    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.730101    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.730103    2570 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://a24db72f7093546ebb78a7f446cb991f-3442e0978c4f8a80.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/pods\": read tcp 10.0.128.234:52374->34.235.246.102:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.772226    2570 apiserver.go:52] "Watching apiserver"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.789918    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.790255    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal","openshift-multus/multus-additional-cni-plugins-vnvng","openshift-multus/multus-dppdr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7","openshift-dns/node-resolver-rvnql","openshift-multus/network-metrics-daemon-4kzvg","openshift-network-diagnostics/network-check-target-ctmnm","openshift-network-operator/iptables-alerter-5bdqq","openshift-ovn-kubernetes/ovnkube-node-znx69","kube-system/global-pull-secret-syncer-zj4jw","kube-system/konnectivity-agent-qdlcp","kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal","openshift-cluster-node-tuning-operator/tuned-ppczn","openshift-image-registry/node-ca-ftklr"]
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.792883    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.792945    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.795052    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.797867    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.797970    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.797977    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.798147    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tdvgl\""
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.801107    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.801122    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.801217    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.801423    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.801442    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.801495    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5x2vf\""
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.803386    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.803746    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rvnql"
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.803776    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bvc2m\""
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.803973    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 17:38:34.830521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.804149    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.805996    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.806060    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.806409    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hswb7\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.806538    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.806730    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.808499    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.809882    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 17:33:34 +0000 UTC" deadline="2028-02-26 17:39:28.675831401 +0000 UTC"
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.809919    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14400h0m53.865914502s"
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.811053    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ftklr"
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.811073    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.811093    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.811197    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.811274    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.811198    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.811653    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kbcgn\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.812402    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.812493    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.813640    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d8f58\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.813776    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.813943    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.814190    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.814216    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.816154    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.816225    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.816288    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7b8qq\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.816348    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.816472    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.818583    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qdlcp"
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821086    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5bdqq"
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821170    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821203    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09179db9-f2bb-4347-94d1-1a3384e1916a-hosts-file\") pod \"node-resolver-rvnql\" (UID: \"09179db9-f2bb-4347-94d1-1a3384e1916a\") " pod="openshift-dns/node-resolver-rvnql"
Jul 06 17:38:34.833144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821229    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n7npx\""
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821239    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxwbx\" (UniqueName: \"kubernetes.io/projected/09179db9-f2bb-4347-94d1-1a3384e1916a-kube-api-access-xxwbx\") pod \"node-resolver-rvnql\" (UID: \"09179db9-f2bb-4347-94d1-1a3384e1916a\") " pod="openshift-dns/node-resolver-rvnql"
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821175    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821293    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7c5985e-315d-4459-8274-6dd000f12c0b-cnibin\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821369    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821399    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-systemd\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821424    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-host\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821450    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p9wn\" (UniqueName: \"kubernetes.io/projected/bd70feac-5dfd-48b2-aace-d6464eaab7cb-kube-api-access-8p9wn\") pod \"node-ca-ftklr\" (UID: \"bd70feac-5dfd-48b2-aace-d6464eaab7cb\") " pod="openshift-image-registry/node-ca-ftklr"
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821476    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-sysctl-conf\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821521    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-cnibin\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821559    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e407ce7-21d1-4316-b572-a4a28f3e2235-cni-binary-copy\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821588    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-hostroot\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821613    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-run-netns\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821636    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-var-lib-openvswitch\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821677    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7c5985e-315d-4459-8274-6dd000f12c0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821709    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-lib-modules\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821741    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-tuned\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.834456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821775    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-var-lib-cni-multus\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821792    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-log-socket\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821810    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc7tz\" (UniqueName: \"kubernetes.io/projected/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-kube-api-access-kc7tz\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821826    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-etc-selinux\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821842    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e763fe4-2283-4e52-8424-7a99d7680e5d-konnectivity-ca\") pod \"konnectivity-agent-qdlcp\" (UID: \"3e763fe4-2283-4e52-8424-7a99d7680e5d\") " pod="kube-system/konnectivity-agent-qdlcp"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821858    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-kubernetes\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821874    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-var-lib-cni-bin\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821889    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e407ce7-21d1-4316-b572-a4a28f3e2235-multus-daemon-config\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821910    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-run-multus-certs\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821927    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-run-openvswitch\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821960    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-ovnkube-config\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.821982    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pvs8\" (UniqueName: \"kubernetes.io/projected/c33ba8f0-913e-48a7-a455-54c14e022b74-kube-api-access-6pvs8\") pod \"network-metrics-daemon-4kzvg\" (UID: \"c33ba8f0-913e-48a7-a455-54c14e022b74\") " pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822001    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-ovnkube-script-lib\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822023    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-registration-dir\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822056    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4034c17-7d21-4541-998d-1c24d8e3ac45-kubelet-config\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822072    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wxqt\" (UniqueName: \"kubernetes.io/projected/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-kube-api-access-7wxqt\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.835381 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822087    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-kubelet\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822104    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-sys-fs\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822130    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd70feac-5dfd-48b2-aace-d6464eaab7cb-host\") pod \"node-ca-ftklr\" (UID: \"bd70feac-5dfd-48b2-aace-d6464eaab7cb\") " pod="openshift-image-registry/node-ca-ftklr"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822147    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e763fe4-2283-4e52-8424-7a99d7680e5d-agent-certs\") pod \"konnectivity-agent-qdlcp\" (UID: \"3e763fe4-2283-4e52-8424-7a99d7680e5d\") " pod="kube-system/konnectivity-agent-qdlcp"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822161    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-socket-dir\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822176    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09179db9-f2bb-4347-94d1-1a3384e1916a-tmp-dir\") pod \"node-resolver-rvnql\" (UID: \"09179db9-f2bb-4347-94d1-1a3384e1916a\") " pod="openshift-dns/node-resolver-rvnql"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822202    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-run\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822230    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-multus-conf-dir\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822246    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsrpr\" (UniqueName: \"kubernetes.io/projected/2e407ce7-21d1-4316-b572-a4a28f3e2235-kube-api-access-vsrpr\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822289    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-run-systemd\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822309    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-cni-netd\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822327    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822344    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klcv7\" (UniqueName: \"kubernetes.io/projected/e9e3032a-b013-4f3c-aa04-941e60038ac5-kube-api-access-klcv7\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822373    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-system-cni-dir\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822400    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-os-release\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822421    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-systemd-units\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822446    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-device-dir\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.836273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822470    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd70feac-5dfd-48b2-aace-d6464eaab7cb-serviceca\") pod \"node-ca-ftklr\" (UID: \"bd70feac-5dfd-48b2-aace-d6464eaab7cb\") " pod="openshift-image-registry/node-ca-ftklr"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822486    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7c5985e-315d-4459-8274-6dd000f12c0b-os-release\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822518    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-modprobe-d\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822538    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-multus-cni-dir\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822578    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-multus-socket-dir-parent\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822604    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-etc-kubernetes\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822624    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822641    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7c5985e-315d-4459-8274-6dd000f12c0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822655    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-var-lib-kubelet\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822680    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-run-ovn\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822720    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-cni-bin\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822790    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-env-overrides\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822817    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7c5985e-315d-4459-8274-6dd000f12c0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822835    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4034c17-7d21-4541-998d-1c24d8e3ac45-dbus\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822882    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-var-lib-kubelet\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822901    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-run-k8s-cni-cncf-io\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.837148 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822919    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fl8f\" (UniqueName: \"kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f\") pod \"network-check-target-ctmnm\" (UID: \"4e40e524-cfc3-4244-bf53-4a18cbdc1549\") " pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822934    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-sys\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822960    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-tmp\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.822986    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs\") pod \"network-metrics-daemon-4kzvg\" (UID: \"c33ba8f0-913e-48a7-a455-54c14e022b74\") " pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.823001    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-slash\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.823016    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-etc-openvswitch\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.823045    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-node-log\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.823065    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7c5985e-315d-4459-8274-6dd000f12c0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.823084    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-sysctl-d\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.823099    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-run-netns\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.823123    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-ovn-node-metrics-cert\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.823143    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7c5985e-315d-4459-8274-6dd000f12c0b-system-cni-dir\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.823158    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-sysconfig\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.823172    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-run-ovn-kubernetes\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.823201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgmrd\" (UniqueName: \"kubernetes.io/projected/d7c5985e-315d-4459-8274-6dd000f12c0b-kube-api-access-tgmrd\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.823717    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hvx7m\""
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.823935    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.824221    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.824221    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 17:38:34.838093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.826085    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 17:38:34.844445 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.842488    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4kxfv"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.850856    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4kxfv"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.917435    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923542    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-etc-kubernetes\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923580    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923606    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7c5985e-315d-4459-8274-6dd000f12c0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923632    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-var-lib-kubelet\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923655    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-run-ovn\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923656    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-etc-kubernetes\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923656    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923695    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-var-lib-kubelet\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923705    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-run-ovn\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923731    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-cni-bin\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923762    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-env-overrides\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923817    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-cni-bin\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923786    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73d95216-af95-42a3-928e-b244675545fb-iptables-alerter-script\") pod \"iptables-alerter-5bdqq\" (UID: \"73d95216-af95-42a3-928e-b244675545fb\") " pod="openshift-network-operator/iptables-alerter-5bdqq"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923870    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7c5985e-315d-4459-8274-6dd000f12c0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923890    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4034c17-7d21-4541-998d-1c24d8e3ac45-dbus\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:34.962301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923906    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-var-lib-kubelet\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923924    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-run-k8s-cni-cncf-io\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923942    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fl8f\" (UniqueName: \"kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f\") pod \"network-check-target-ctmnm\" (UID: \"4e40e524-cfc3-4244-bf53-4a18cbdc1549\") " pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923960    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-sys\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923976    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-tmp\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923993    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs\") pod \"network-metrics-daemon-4kzvg\" (UID: \"c33ba8f0-913e-48a7-a455-54c14e022b74\") " pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.923997    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-run-k8s-cni-cncf-io\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924009    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-slash\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924016    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-var-lib-kubelet\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924026    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-etc-openvswitch\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924075    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-slash\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924077    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-etc-openvswitch\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924097    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-node-log\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924105    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4034c17-7d21-4541-998d-1c24d8e3ac45-dbus\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924118    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-sys\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924139    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7c5985e-315d-4459-8274-6dd000f12c0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924150    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-node-log\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924170    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-sysctl-d\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.963184 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924186    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-run-netns\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.924207    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924243    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-ovn-node-metrics-cert\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924252    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-run-netns\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924267    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7c5985e-315d-4459-8274-6dd000f12c0b-system-cni-dir\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.924290    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs podName:c33ba8f0-913e-48a7-a455-54c14e022b74 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:35.424272159 +0000 UTC m=+2.002472979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs") pod "network-metrics-daemon-4kzvg" (UID: "c33ba8f0-913e-48a7-a455-54c14e022b74") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924294    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7c5985e-315d-4459-8274-6dd000f12c0b-system-cni-dir\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924292    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-sysctl-d\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924328    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-sysconfig\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924349    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-run-ovn-kubernetes\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924366    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgmrd\" (UniqueName: \"kubernetes.io/projected/d7c5985e-315d-4459-8274-6dd000f12c0b-kube-api-access-tgmrd\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924394    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73d95216-af95-42a3-928e-b244675545fb-host-slash\") pod \"iptables-alerter-5bdqq\" (UID: \"73d95216-af95-42a3-928e-b244675545fb\") " pod="openshift-network-operator/iptables-alerter-5bdqq"
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924422    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09179db9-f2bb-4347-94d1-1a3384e1916a-hosts-file\") pod \"node-resolver-rvnql\" (UID: \"09179db9-f2bb-4347-94d1-1a3384e1916a\") " pod="openshift-dns/node-resolver-rvnql"
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924421    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-run-ovn-kubernetes\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924424    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-sysconfig\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924461    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxwbx\" (UniqueName: \"kubernetes.io/projected/09179db9-f2bb-4347-94d1-1a3384e1916a-kube-api-access-xxwbx\") pod \"node-resolver-rvnql\" (UID: \"09179db9-f2bb-4347-94d1-1a3384e1916a\") " pod="openshift-dns/node-resolver-rvnql"
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7c5985e-315d-4459-8274-6dd000f12c0b-cnibin\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.964078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924531    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924542    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7c5985e-315d-4459-8274-6dd000f12c0b-cnibin\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924558    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-systemd\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924579    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09179db9-f2bb-4347-94d1-1a3384e1916a-hosts-file\") pod \"node-resolver-rvnql\" (UID: \"09179db9-f2bb-4347-94d1-1a3384e1916a\") " pod="openshift-dns/node-resolver-rvnql"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924575    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-host\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924606    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p9wn\" (UniqueName: \"kubernetes.io/projected/bd70feac-5dfd-48b2-aace-d6464eaab7cb-kube-api-access-8p9wn\") pod \"node-ca-ftklr\" (UID: \"bd70feac-5dfd-48b2-aace-d6464eaab7cb\") " pod="openshift-image-registry/node-ca-ftklr"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924622    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-sysctl-conf\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924642    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-cnibin\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.924651    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924659    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e407ce7-21d1-4316-b572-a4a28f3e2235-cni-binary-copy\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.924700    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret podName:a4034c17-7d21-4541-998d-1c24d8e3ac45 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:35.424685122 +0000 UTC m=+2.002885957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret") pod "global-pull-secret-syncer-zj4jw" (UID: "a4034c17-7d21-4541-998d-1c24d8e3ac45") : object "kube-system"/"original-pull-secret" not registered
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924639    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-systemd\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924747    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-cnibin\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924784    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-hostroot\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924787    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-host\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924812    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-run-netns\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924834    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-hostroot\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924846    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-var-lib-openvswitch\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.966696 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924846    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-sysctl-conf\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924875    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-run-netns\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924891    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7c5985e-315d-4459-8274-6dd000f12c0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924910    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-var-lib-openvswitch\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924915    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-lib-modules\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924944    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-tuned\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924961    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-var-lib-cni-multus\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924979    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-log-socket\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924993    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-lib-modules\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.924996    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc7tz\" (UniqueName: \"kubernetes.io/projected/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-kube-api-access-kc7tz\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925025    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-var-lib-cni-multus\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925038    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8czh\" (UniqueName: \"kubernetes.io/projected/73d95216-af95-42a3-928e-b244675545fb-kube-api-access-z8czh\") pod \"iptables-alerter-5bdqq\" (UID: \"73d95216-af95-42a3-928e-b244675545fb\") " pod="openshift-network-operator/iptables-alerter-5bdqq"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925074    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-etc-selinux\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925103    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e763fe4-2283-4e52-8424-7a99d7680e5d-konnectivity-ca\") pod \"konnectivity-agent-qdlcp\" (UID: \"3e763fe4-2283-4e52-8424-7a99d7680e5d\") " pod="kube-system/konnectivity-agent-qdlcp"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925095    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-log-socket\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925128    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-kubernetes\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925154    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-var-lib-cni-bin\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.967579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925180    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e407ce7-21d1-4316-b572-a4a28f3e2235-multus-daemon-config\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925208    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-run-multus-certs\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925234    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-run-openvswitch\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925260    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-ovnkube-config\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925265    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-etc-selinux\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925286    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pvs8\" (UniqueName: \"kubernetes.io/projected/c33ba8f0-913e-48a7-a455-54c14e022b74-kube-api-access-6pvs8\") pod \"network-metrics-daemon-4kzvg\" (UID: \"c33ba8f0-913e-48a7-a455-54c14e022b74\") " pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925303    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-var-lib-cni-bin\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925315    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-ovnkube-script-lib\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925378    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-registration-dir\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925404    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4034c17-7d21-4541-998d-1c24d8e3ac45-kubelet-config\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925429    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wxqt\" (UniqueName: \"kubernetes.io/projected/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-kube-api-access-7wxqt\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925319    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-host-run-multus-certs\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925454    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-kubelet\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925531    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-kubernetes\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925565    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-sys-fs\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925593    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd70feac-5dfd-48b2-aace-d6464eaab7cb-host\") pod \"node-ca-ftklr\" (UID: \"bd70feac-5dfd-48b2-aace-d6464eaab7cb\") " pod="openshift-image-registry/node-ca-ftklr"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925619    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e763fe4-2283-4e52-8424-7a99d7680e5d-agent-certs\") pod \"konnectivity-agent-qdlcp\" (UID: \"3e763fe4-2283-4e52-8424-7a99d7680e5d\") " pod="kube-system/konnectivity-agent-qdlcp"
Jul 06 17:38:34.969432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925645    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-socket-dir\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925670    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09179db9-f2bb-4347-94d1-1a3384e1916a-tmp-dir\") pod \"node-resolver-rvnql\" (UID: \"09179db9-f2bb-4347-94d1-1a3384e1916a\") " pod="openshift-dns/node-resolver-rvnql"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925692    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-run\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925715    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-multus-conf-dir\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925787    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsrpr\" (UniqueName: \"kubernetes.io/projected/2e407ce7-21d1-4316-b572-a4a28f3e2235-kube-api-access-vsrpr\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925815    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-run-systemd\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925843    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-cni-netd\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925869    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925894    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klcv7\" (UniqueName: \"kubernetes.io/projected/e9e3032a-b013-4f3c-aa04-941e60038ac5-kube-api-access-klcv7\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925919    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-system-cni-dir\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925944    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-os-release\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925969    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-systemd-units\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.925994    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-device-dir\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926022    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd70feac-5dfd-48b2-aace-d6464eaab7cb-serviceca\") pod \"node-ca-ftklr\" (UID: \"bd70feac-5dfd-48b2-aace-d6464eaab7cb\") " pod="openshift-image-registry/node-ca-ftklr"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926047    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7c5985e-315d-4459-8274-6dd000f12c0b-os-release\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926073    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-modprobe-d\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926099    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-multus-cni-dir\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926169    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-multus-socket-dir-parent\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.970309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926285    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-multus-socket-dir-parent\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926305    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7c5985e-315d-4459-8274-6dd000f12c0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926322    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-cni-netd\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926355    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-sys-fs\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926374    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-run\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926376    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926407    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-multus-conf-dir\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926577    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-os-release\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926627    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-run-systemd\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926655    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-systemd-units\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926683    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-system-cni-dir\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926709    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-registration-dir\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926743    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7c5985e-315d-4459-8274-6dd000f12c0b-os-release\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926810    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd70feac-5dfd-48b2-aace-d6464eaab7cb-host\") pod \"node-ca-ftklr\" (UID: \"bd70feac-5dfd-48b2-aace-d6464eaab7cb\") " pod="openshift-image-registry/node-ca-ftklr"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926833    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4034c17-7d21-4541-998d-1c24d8e3ac45-kubelet-config\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926961    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-host-kubelet\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.926997    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-modprobe-d\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.927003    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-device-dir\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.972119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.927097    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-run-openvswitch\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.927152    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e407ce7-21d1-4316-b572-a4a28f3e2235-multus-cni-dir\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.927209    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9e3032a-b013-4f3c-aa04-941e60038ac5-socket-dir\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.927905    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-env-overrides\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.927973    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-ovnkube-script-lib\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.928028    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-ovnkube-config\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.928390    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7c5985e-315d-4459-8274-6dd000f12c0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.928446    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7c5985e-315d-4459-8274-6dd000f12c0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.928543    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7c5985e-315d-4459-8274-6dd000f12c0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.928753    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.929054    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09179db9-f2bb-4347-94d1-1a3384e1916a-tmp-dir\") pod \"node-resolver-rvnql\" (UID: \"09179db9-f2bb-4347-94d1-1a3384e1916a\") " pod="openshift-dns/node-resolver-rvnql"
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.929192    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bd70feac-5dfd-48b2-aace-d6464eaab7cb-serviceca\") pod \"node-ca-ftklr\" (UID: \"bd70feac-5dfd-48b2-aace-d6464eaab7cb\") " pod="openshift-image-registry/node-ca-ftklr"
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.929271    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3e763fe4-2283-4e52-8424-7a99d7680e5d-konnectivity-ca\") pod \"konnectivity-agent-qdlcp\" (UID: \"3e763fe4-2283-4e52-8424-7a99d7680e5d\") " pod="kube-system/konnectivity-agent-qdlcp"
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.929815    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e407ce7-21d1-4316-b572-a4a28f3e2235-cni-binary-copy\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.929878    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e407ce7-21d1-4316-b572-a4a28f3e2235-multus-daemon-config\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.930969    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.930992    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 17:38:34.973007 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.931006    2570 projected.go:196] Error preparing data for projected volume kube-api-access-4fl8f for pod openshift-network-diagnostics/network-check-target-ctmnm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 17:38:34.974787 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:34.931069    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f podName:4e40e524-cfc3-4244-bf53-4a18cbdc1549 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:35.431054798 +0000 UTC m=+2.009255627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4fl8f" (UniqueName: "kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f") pod "network-check-target-ctmnm" (UID: "4e40e524-cfc3-4244-bf53-4a18cbdc1549") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 17:38:34.974787 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.932571    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-tmp\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.974787 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.932616    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-etc-tuned\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:34.974787 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.932707    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3e763fe4-2283-4e52-8424-7a99d7680e5d-agent-certs\") pod \"konnectivity-agent-qdlcp\" (UID: \"3e763fe4-2283-4e52-8424-7a99d7680e5d\") " pod="kube-system/konnectivity-agent-qdlcp"
Jul 06 17:38:34.974787 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.932855    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-ovn-node-metrics-cert\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.974787 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.933671    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgmrd\" (UniqueName: \"kubernetes.io/projected/d7c5985e-315d-4459-8274-6dd000f12c0b-kube-api-access-tgmrd\") pod \"multus-additional-cni-plugins-vnvng\" (UID: \"d7c5985e-315d-4459-8274-6dd000f12c0b\") " pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:34.974787 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.934948    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc7tz\" (UniqueName: \"kubernetes.io/projected/72bc3e2a-027f-4ebb-922d-37aa52ad9be3-kube-api-access-kc7tz\") pod \"ovnkube-node-znx69\" (UID: \"72bc3e2a-027f-4ebb-922d-37aa52ad9be3\") " pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:34.974787 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.935327    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsrpr\" (UniqueName: \"kubernetes.io/projected/2e407ce7-21d1-4316-b572-a4a28f3e2235-kube-api-access-vsrpr\") pod \"multus-dppdr\" (UID: \"2e407ce7-21d1-4316-b572-a4a28f3e2235\") " pod="openshift-multus/multus-dppdr"
Jul 06 17:38:35.095250 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.988472    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pvs8\" (UniqueName: \"kubernetes.io/projected/c33ba8f0-913e-48a7-a455-54c14e022b74-kube-api-access-6pvs8\") pod \"network-metrics-daemon-4kzvg\" (UID: \"c33ba8f0-913e-48a7-a455-54c14e022b74\") " pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:35.095250 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.988495    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p9wn\" (UniqueName: \"kubernetes.io/projected/bd70feac-5dfd-48b2-aace-d6464eaab7cb-kube-api-access-8p9wn\") pod \"node-ca-ftklr\" (UID: \"bd70feac-5dfd-48b2-aace-d6464eaab7cb\") " pod="openshift-image-registry/node-ca-ftklr"
Jul 06 17:38:35.095250 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.988472    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxwbx\" (UniqueName: \"kubernetes.io/projected/09179db9-f2bb-4347-94d1-1a3384e1916a-kube-api-access-xxwbx\") pod \"node-resolver-rvnql\" (UID: \"09179db9-f2bb-4347-94d1-1a3384e1916a\") " pod="openshift-dns/node-resolver-rvnql"
Jul 06 17:38:35.095250 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.988553    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klcv7\" (UniqueName: \"kubernetes.io/projected/e9e3032a-b013-4f3c-aa04-941e60038ac5-kube-api-access-klcv7\") pod \"aws-ebs-csi-driver-node-ffvc7\" (UID: \"e9e3032a-b013-4f3c-aa04-941e60038ac5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:35.095250 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:34.990194    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wxqt\" (UniqueName: \"kubernetes.io/projected/4df6b3a7-f662-4051-95ae-f02aa7ac31f0-kube-api-access-7wxqt\") pod \"tuned-ppczn\" (UID: \"4df6b3a7-f662-4051-95ae-f02aa7ac31f0\") " pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:35.095250 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.027042    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73d95216-af95-42a3-928e-b244675545fb-host-slash\") pod \"iptables-alerter-5bdqq\" (UID: \"73d95216-af95-42a3-928e-b244675545fb\") " pod="openshift-network-operator/iptables-alerter-5bdqq"
Jul 06 17:38:35.095250 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.027094    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8czh\" (UniqueName: \"kubernetes.io/projected/73d95216-af95-42a3-928e-b244675545fb-kube-api-access-z8czh\") pod \"iptables-alerter-5bdqq\" (UID: \"73d95216-af95-42a3-928e-b244675545fb\") " pod="openshift-network-operator/iptables-alerter-5bdqq"
Jul 06 17:38:35.095250 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.027147    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73d95216-af95-42a3-928e-b244675545fb-iptables-alerter-script\") pod \"iptables-alerter-5bdqq\" (UID: \"73d95216-af95-42a3-928e-b244675545fb\") " pod="openshift-network-operator/iptables-alerter-5bdqq"
Jul 06 17:38:35.095250 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.027151    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73d95216-af95-42a3-928e-b244675545fb-host-slash\") pod \"iptables-alerter-5bdqq\" (UID: \"73d95216-af95-42a3-928e-b244675545fb\") " pod="openshift-network-operator/iptables-alerter-5bdqq"
Jul 06 17:38:35.095250 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.027864    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73d95216-af95-42a3-928e-b244675545fb-iptables-alerter-script\") pod \"iptables-alerter-5bdqq\" (UID: \"73d95216-af95-42a3-928e-b244675545fb\") " pod="openshift-network-operator/iptables-alerter-5bdqq"
Jul 06 17:38:35.095250 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.034860    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8czh\" (UniqueName: \"kubernetes.io/projected/73d95216-af95-42a3-928e-b244675545fb-kube-api-access-z8czh\") pod \"iptables-alerter-5bdqq\" (UID: \"73d95216-af95-42a3-928e-b244675545fb\") " pod="openshift-network-operator/iptables-alerter-5bdqq"
Jul 06 17:38:35.228093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.188072    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 17:38:35.502659 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.430134    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs\") pod \"network-metrics-daemon-4kzvg\" (UID: \"c33ba8f0-913e-48a7-a455-54c14e022b74\") " pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:35.502659 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.430181    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:35.502659 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:35.430299    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 17:38:35.502659 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:35.430314    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 17:38:35.502659 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:35.430383    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret podName:a4034c17-7d21-4541-998d-1c24d8e3ac45 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:36.430360931 +0000 UTC m=+3.008561764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret") pod "global-pull-secret-syncer-zj4jw" (UID: "a4034c17-7d21-4541-998d-1c24d8e3ac45") : object "kube-system"/"original-pull-secret" not registered
Jul 06 17:38:35.502659 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:35.430403    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs podName:c33ba8f0-913e-48a7-a455-54c14e022b74 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:36.430391999 +0000 UTC m=+3.008592826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs") pod "network-metrics-daemon-4kzvg" (UID: "c33ba8f0-913e-48a7-a455-54c14e022b74") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 17:38:35.634367 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.531151    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fl8f\" (UniqueName: \"kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f\") pod \"network-check-target-ctmnm\" (UID: \"4e40e524-cfc3-4244-bf53-4a18cbdc1549\") " pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:35.634367 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:35.531267    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 17:38:35.634367 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:35.531281    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 17:38:35.634367 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:35.531292    2570 projected.go:196] Error preparing data for projected volume kube-api-access-4fl8f for pod openshift-network-diagnostics/network-check-target-ctmnm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 17:38:35.634367 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:35.531341    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f podName:4e40e524-cfc3-4244-bf53-4a18cbdc1549 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:36.531328818 +0000 UTC m=+3.109529634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4fl8f" (UniqueName: "kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f") pod "network-check-target-ctmnm" (UID: "4e40e524-cfc3-4244-bf53-4a18cbdc1549") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 17:38:35.853960 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.853906    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 17:33:35 +0000 UTC" deadline="2028-04-01 00:33:57.407069274 +0000 UTC"
Jul 06 17:38:35.853960 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.853956    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15222h55m21.553116019s"
Jul 06 17:38:35.893786 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.893759    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ppczn"
Jul 06 17:38:35.907814 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.907794    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dppdr"
Jul 06 17:38:35.920408 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.920378    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7"
Jul 06 17:38:35.934479 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.934459    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rvnql"
Jul 06 17:38:35.940685 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.940668    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:38:35.943086 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.943066    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 17:38:35.957447 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.957423    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ftklr"
Jul 06 17:38:35.968425 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.968406    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:35.968551 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:35.968531    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:38:35.977135 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.977117    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vnvng"
Jul 06 17:38:35.982161 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:35.982145    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qdlcp"
Jul 06 17:38:36.000277 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:36.000260    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5bdqq"
Jul 06 17:38:36.009490 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:36.009459    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e763fe4_2283_4e52_8424_7a99d7680e5d.slice/crio-20daff2a278bfa7612596649e9450ffd9cc81261e38dd15c3c8dabe211929718 WatchSource:0}: Error finding container 20daff2a278bfa7612596649e9450ffd9cc81261e38dd15c3c8dabe211929718: Status 404 returned error can't find the container with id 20daff2a278bfa7612596649e9450ffd9cc81261e38dd15c3c8dabe211929718
Jul 06 17:38:36.010274 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:36.010241    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3621fce897cec71d75ea532d62b7211.slice/crio-76cf2c407ae34af0130a3e4b438339476184c973b4f4907a5299fc4f3ad2a287 WatchSource:0}: Error finding container 76cf2c407ae34af0130a3e4b438339476184c973b4f4907a5299fc4f3ad2a287: Status 404 returned error can't find the container with id 76cf2c407ae34af0130a3e4b438339476184c973b4f4907a5299fc4f3ad2a287
Jul 06 17:38:36.016598 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:36.016521    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 17:38:36.018436 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:36.018411    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1822161f850ef2b3317aaf5916b61399.slice/crio-94a9966506581877cefdbab17c53457279a195013d0e84952be5a9a002045453 WatchSource:0}: Error finding container 94a9966506581877cefdbab17c53457279a195013d0e84952be5a9a002045453: Status 404 returned error can't find the container with id 94a9966506581877cefdbab17c53457279a195013d0e84952be5a9a002045453
Jul 06 17:38:36.020150 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:36.020126    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d95216_af95_42a3_928e_b244675545fb.slice/crio-32df3afba145dc4e9d2b3c426f52ab2513686c562c4c6d07f51f8d947ce5f57e WatchSource:0}: Error finding container 32df3afba145dc4e9d2b3c426f52ab2513686c562c4c6d07f51f8d947ce5f57e: Status 404 returned error can't find the container with id 32df3afba145dc4e9d2b3c426f52ab2513686c562c4c6d07f51f8d947ce5f57e
Jul 06 17:38:36.227459 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:36.227433    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e407ce7_21d1_4316_b572_a4a28f3e2235.slice/crio-fa4603578cf8b43a70e312227578fcebb00cfeefcf28039d18583ed54e1f8909 WatchSource:0}: Error finding container fa4603578cf8b43a70e312227578fcebb00cfeefcf28039d18583ed54e1f8909: Status 404 returned error can't find the container with id fa4603578cf8b43a70e312227578fcebb00cfeefcf28039d18583ed54e1f8909
Jul 06 17:38:36.254147 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:36.254118    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e3032a_b013_4f3c_aa04_941e60038ac5.slice/crio-6957afd0c734cd3555ca37370025b12150d8f253279bdfef1a0578d60b2ca319 WatchSource:0}: Error finding container 6957afd0c734cd3555ca37370025b12150d8f253279bdfef1a0578d60b2ca319: Status 404 returned error can't find the container with id 6957afd0c734cd3555ca37370025b12150d8f253279bdfef1a0578d60b2ca319
Jul 06 17:38:36.264132 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:36.264111    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 17:38:36.332593 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:36.332559    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c5985e_315d_4459_8274_6dd000f12c0b.slice/crio-391f44cbbc67f95a2adfae1b1be8b9faebc629e944e3b7eb1705dce1adec8b3e WatchSource:0}: Error finding container 391f44cbbc67f95a2adfae1b1be8b9faebc629e944e3b7eb1705dce1adec8b3e: Status 404 returned error can't find the container with id 391f44cbbc67f95a2adfae1b1be8b9faebc629e944e3b7eb1705dce1adec8b3e
Jul 06 17:38:36.429894 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:36.429867    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09179db9_f2bb_4347_94d1_1a3384e1916a.slice/crio-4546dafc0434240ad291f9991efc2d5d724a83ebefc54906401e686090e93336 WatchSource:0}: Error finding container 4546dafc0434240ad291f9991efc2d5d724a83ebefc54906401e686090e93336: Status 404 returned error can't find the container with id 4546dafc0434240ad291f9991efc2d5d724a83ebefc54906401e686090e93336
Jul 06 17:38:36.438686 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:36.438663    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs\") pod \"network-metrics-daemon-4kzvg\" (UID: \"c33ba8f0-913e-48a7-a455-54c14e022b74\") " pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:36.438818 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:36.438715    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:36.438938 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:36.438920    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 17:38:36.439005 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:36.438991    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret podName:a4034c17-7d21-4541-998d-1c24d8e3ac45 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:38.438970881 +0000 UTC m=+5.017171712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret") pod "global-pull-secret-syncer-zj4jw" (UID: "a4034c17-7d21-4541-998d-1c24d8e3ac45") : object "kube-system"/"original-pull-secret" not registered
Jul 06 17:38:36.439073 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:36.438923    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 17:38:36.439134 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:36.439077    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs podName:c33ba8f0-913e-48a7-a455-54c14e022b74 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:38.439051705 +0000 UTC m=+5.017252535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs") pod "network-metrics-daemon-4kzvg" (UID: "c33ba8f0-913e-48a7-a455-54c14e022b74") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 17:38:36.439422 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:36.439404    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72bc3e2a_027f_4ebb_922d_37aa52ad9be3.slice/crio-9a93078adc203978bbee619f7add107e74a2f85e83b063f10d761e2335fb6343 WatchSource:0}: Error finding container 9a93078adc203978bbee619f7add107e74a2f85e83b063f10d761e2335fb6343: Status 404 returned error can't find the container with id 9a93078adc203978bbee619f7add107e74a2f85e83b063f10d761e2335fb6343
Jul 06 17:38:36.440085 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:38:36.440060    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df6b3a7_f662_4051_95ae_f02aa7ac31f0.slice/crio-69b5194019163d85ad280555d3ccaed3d6bb544170d5530fe31e8b94b5b21d6b WatchSource:0}: Error finding container 69b5194019163d85ad280555d3ccaed3d6bb544170d5530fe31e8b94b5b21d6b: Status 404 returned error can't find the container with id 69b5194019163d85ad280555d3ccaed3d6bb544170d5530fe31e8b94b5b21d6b
Jul 06 17:38:36.539480 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:36.539377    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fl8f\" (UniqueName: \"kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f\") pod \"network-check-target-ctmnm\" (UID: \"4e40e524-cfc3-4244-bf53-4a18cbdc1549\") " pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:36.539646 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:36.539548    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 17:38:36.539646 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:36.539574    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 17:38:36.539646 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:36.539587    2570 projected.go:196] Error preparing data for projected volume kube-api-access-4fl8f for pod openshift-network-diagnostics/network-check-target-ctmnm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 17:38:36.539844 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:36.539652    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f podName:4e40e524-cfc3-4244-bf53-4a18cbdc1549 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:38.539629653 +0000 UTC m=+5.117830484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4fl8f" (UniqueName: "kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f") pod "network-check-target-ctmnm" (UID: "4e40e524-cfc3-4244-bf53-4a18cbdc1549") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 17:38:36.854502 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:36.854383    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 17:33:35 +0000 UTC" deadline="2028-02-25 21:08:40.829490902 +0000 UTC"
Jul 06 17:38:36.854502 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:36.854450    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14379h30m3.975046628s"
Jul 06 17:38:36.968461 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:36.968431    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:36.968640 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:36.968579    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:38:36.969064 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:36.969040    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:36.969164 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:36.969141    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:38:37.017647 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:37.017580    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ftklr" event={"ID":"bd70feac-5dfd-48b2-aace-d6464eaab7cb","Type":"ContainerStarted","Data":"4aa024157dcd401989b3f0c0f1bb97cf7166ab6a77da8ffeceff26eaed907e37"}
Jul 06 17:38:37.043919 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:37.043538    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znx69" event={"ID":"72bc3e2a-027f-4ebb-922d-37aa52ad9be3","Type":"ContainerStarted","Data":"9a93078adc203978bbee619f7add107e74a2f85e83b063f10d761e2335fb6343"}
Jul 06 17:38:37.063141 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:37.063036    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ppczn" event={"ID":"4df6b3a7-f662-4051-95ae-f02aa7ac31f0","Type":"ContainerStarted","Data":"69b5194019163d85ad280555d3ccaed3d6bb544170d5530fe31e8b94b5b21d6b"}
Jul 06 17:38:37.079237 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:37.079208    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 17:38:37.081232 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:37.081200    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rvnql" event={"ID":"09179db9-f2bb-4347-94d1-1a3384e1916a","Type":"ContainerStarted","Data":"4546dafc0434240ad291f9991efc2d5d724a83ebefc54906401e686090e93336"}
Jul 06 17:38:37.116232 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:37.115680    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnvng" event={"ID":"d7c5985e-315d-4459-8274-6dd000f12c0b","Type":"ContainerStarted","Data":"391f44cbbc67f95a2adfae1b1be8b9faebc629e944e3b7eb1705dce1adec8b3e"}
Jul 06 17:38:37.135918 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:37.135878    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dppdr" event={"ID":"2e407ce7-21d1-4316-b572-a4a28f3e2235","Type":"ContainerStarted","Data":"fa4603578cf8b43a70e312227578fcebb00cfeefcf28039d18583ed54e1f8909"}
Jul 06 17:38:37.147456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:37.147388    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5bdqq" event={"ID":"73d95216-af95-42a3-928e-b244675545fb","Type":"ContainerStarted","Data":"32df3afba145dc4e9d2b3c426f52ab2513686c562c4c6d07f51f8d947ce5f57e"}
Jul 06 17:38:37.152495 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:37.152055    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qdlcp" event={"ID":"3e763fe4-2283-4e52-8424-7a99d7680e5d","Type":"ContainerStarted","Data":"20daff2a278bfa7612596649e9450ffd9cc81261e38dd15c3c8dabe211929718"}
Jul 06 17:38:37.167039 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:37.167004    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7" event={"ID":"e9e3032a-b013-4f3c-aa04-941e60038ac5","Type":"ContainerStarted","Data":"6957afd0c734cd3555ca37370025b12150d8f253279bdfef1a0578d60b2ca319"}
Jul 06 17:38:37.172722 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:37.172683    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" event={"ID":"1822161f850ef2b3317aaf5916b61399","Type":"ContainerStarted","Data":"94a9966506581877cefdbab17c53457279a195013d0e84952be5a9a002045453"}
Jul 06 17:38:37.177238 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:37.177206    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" event={"ID":"d3621fce897cec71d75ea532d62b7211","Type":"ContainerStarted","Data":"76cf2c407ae34af0130a3e4b438339476184c973b4f4907a5299fc4f3ad2a287"}
Jul 06 17:38:37.971030 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:37.970442    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:37.971030 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:37.970586    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:38:38.462127 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:38.461316    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs\") pod \"network-metrics-daemon-4kzvg\" (UID: \"c33ba8f0-913e-48a7-a455-54c14e022b74\") " pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:38.462127 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:38.461374    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:38.462127 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:38.461550    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 17:38:38.462127 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:38.461613    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret podName:a4034c17-7d21-4541-998d-1c24d8e3ac45 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:42.461594613 +0000 UTC m=+9.039795436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret") pod "global-pull-secret-syncer-zj4jw" (UID: "a4034c17-7d21-4541-998d-1c24d8e3ac45") : object "kube-system"/"original-pull-secret" not registered
Jul 06 17:38:38.462127 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:38.462041    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 17:38:38.462127 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:38.462092    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs podName:c33ba8f0-913e-48a7-a455-54c14e022b74 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:42.462075595 +0000 UTC m=+9.040276417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs") pod "network-metrics-daemon-4kzvg" (UID: "c33ba8f0-913e-48a7-a455-54c14e022b74") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 17:38:38.562464 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:38.561793    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fl8f\" (UniqueName: \"kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f\") pod \"network-check-target-ctmnm\" (UID: \"4e40e524-cfc3-4244-bf53-4a18cbdc1549\") " pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:38.562464 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:38.561999    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 17:38:38.562464 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:38.562020    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 17:38:38.562464 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:38.562034    2570 projected.go:196] Error preparing data for projected volume kube-api-access-4fl8f for pod openshift-network-diagnostics/network-check-target-ctmnm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 17:38:38.562464 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:38.562098    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f podName:4e40e524-cfc3-4244-bf53-4a18cbdc1549 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:42.56207834 +0000 UTC m=+9.140279164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4fl8f" (UniqueName: "kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f") pod "network-check-target-ctmnm" (UID: "4e40e524-cfc3-4244-bf53-4a18cbdc1549") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 17:38:38.968951 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:38.968192    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:38.968951 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:38.968315    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:38:38.968951 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:38.968703    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:38.968951 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:38.968822    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:38:39.968255 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:39.968213    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:39.968781 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:39.968370    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:38:40.969623 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:40.968684    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:40.969623 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:40.968841    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:38:40.969623 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:40.969230    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:40.969623 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:40.969336    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:38:41.968470 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:41.968421    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:41.968636 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:41.968556    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:38:42.498004 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:42.497959    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:42.498505 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:42.498072    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs\") pod \"network-metrics-daemon-4kzvg\" (UID: \"c33ba8f0-913e-48a7-a455-54c14e022b74\") " pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:42.498505 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:42.498107    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 17:38:42.498505 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:42.498179    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret podName:a4034c17-7d21-4541-998d-1c24d8e3ac45 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:50.498159024 +0000 UTC m=+17.076359861 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret") pod "global-pull-secret-syncer-zj4jw" (UID: "a4034c17-7d21-4541-998d-1c24d8e3ac45") : object "kube-system"/"original-pull-secret" not registered
Jul 06 17:38:42.498505 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:42.498201    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 17:38:42.498505 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:42.498269    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs podName:c33ba8f0-913e-48a7-a455-54c14e022b74 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:50.498249232 +0000 UTC m=+17.076450050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs") pod "network-metrics-daemon-4kzvg" (UID: "c33ba8f0-913e-48a7-a455-54c14e022b74") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 17:38:42.598823 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:42.598778    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fl8f\" (UniqueName: \"kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f\") pod \"network-check-target-ctmnm\" (UID: \"4e40e524-cfc3-4244-bf53-4a18cbdc1549\") " pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:42.599011 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:42.598975    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 17:38:42.599011 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:42.599003    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 17:38:42.599125 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:42.599017    2570 projected.go:196] Error preparing data for projected volume kube-api-access-4fl8f for pod openshift-network-diagnostics/network-check-target-ctmnm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 17:38:42.599125 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:42.599084    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f podName:4e40e524-cfc3-4244-bf53-4a18cbdc1549 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:50.599066029 +0000 UTC m=+17.177266865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4fl8f" (UniqueName: "kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f") pod "network-check-target-ctmnm" (UID: "4e40e524-cfc3-4244-bf53-4a18cbdc1549") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 17:38:42.968340 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:42.968255    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:42.968340 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:42.968273    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:42.968569 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:42.968395    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:38:42.968569 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:42.968491    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:38:43.968842 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:43.968800    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:43.969336 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:43.968931    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:38:44.968105 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:44.968073    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:44.968275 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:44.968189    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:38:44.968275 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:44.968237    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:44.968406 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:44.968381    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:38:45.970259 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:45.970226    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:45.970750 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:45.970365    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:38:46.968472 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:46.968435    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:46.968659 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:46.968476    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:46.968659 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:46.968570    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:38:46.968853 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:46.968745    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:38:47.968277 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:47.967983    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:47.968277 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:47.968128    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:38:48.968464 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:48.968433    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:48.968938 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:48.968555    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:38:48.968938 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:48.968604    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:48.968938 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:48.968751    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:38:49.967964 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:49.967932    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:49.968154 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:49.968061    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:38:50.565048 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:50.565007    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs\") pod \"network-metrics-daemon-4kzvg\" (UID: \"c33ba8f0-913e-48a7-a455-54c14e022b74\") " pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:50.565491 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:50.565064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:50.565491 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:50.565186    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 17:38:50.565491 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:50.565265    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs podName:c33ba8f0-913e-48a7-a455-54c14e022b74 nodeName:}" failed. No retries permitted until 2026-07-06 17:39:06.565244149 +0000 UTC m=+33.143444967 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs") pod "network-metrics-daemon-4kzvg" (UID: "c33ba8f0-913e-48a7-a455-54c14e022b74") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 17:38:50.565491 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:50.565192    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 17:38:50.565491 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:50.565365    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret podName:a4034c17-7d21-4541-998d-1c24d8e3ac45 nodeName:}" failed. No retries permitted until 2026-07-06 17:39:06.565343509 +0000 UTC m=+33.143544337 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret") pod "global-pull-secret-syncer-zj4jw" (UID: "a4034c17-7d21-4541-998d-1c24d8e3ac45") : object "kube-system"/"original-pull-secret" not registered
Jul 06 17:38:50.666247 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:50.666214    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fl8f\" (UniqueName: \"kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f\") pod \"network-check-target-ctmnm\" (UID: \"4e40e524-cfc3-4244-bf53-4a18cbdc1549\") " pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:50.666434 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:50.666411    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 17:38:50.666512 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:50.666439    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 17:38:50.666512 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:50.666453    2570 projected.go:196] Error preparing data for projected volume kube-api-access-4fl8f for pod openshift-network-diagnostics/network-check-target-ctmnm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 17:38:50.666512 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:50.666508    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f podName:4e40e524-cfc3-4244-bf53-4a18cbdc1549 nodeName:}" failed. No retries permitted until 2026-07-06 17:39:06.66649112 +0000 UTC m=+33.244691935 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4fl8f" (UniqueName: "kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f") pod "network-check-target-ctmnm" (UID: "4e40e524-cfc3-4244-bf53-4a18cbdc1549") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 17:38:50.967965 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:50.967884    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:50.967965 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:50.967903    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:50.968180 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:50.968024    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:38:50.968232 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:50.968167    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:38:51.968001 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:51.967968    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:51.968466 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:51.968083    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:38:52.968554 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:52.968516    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:52.968554 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:52.968555    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:52.969068 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:52.968671    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:38:52.969068 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:52.968803    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:38:53.969669 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:53.969629    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:53.970155 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:53.969766    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:38:54.968173 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:54.968133    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:54.968366 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:54.968177    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:54.968366 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:54.968263    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:38:54.968485 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:54.968386    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:38:55.971367 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:55.971337    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:55.971852 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:55.971453    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:38:56.968202 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:56.968175    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:56.968342 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:56.968175    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:56.968342 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:56.968274    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:38:56.968426 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:56.968353    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:38:57.220618 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:57.220458    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znx69" event={"ID":"72bc3e2a-027f-4ebb-922d-37aa52ad9be3","Type":"ContainerStarted","Data":"c1b1d4dc196a4437c0797b5f8feff0c0deab835dd9046ee502eb3e426d6fbed2"}
Jul 06 17:38:57.221149 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:57.220742    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znx69" event={"ID":"72bc3e2a-027f-4ebb-922d-37aa52ad9be3","Type":"ContainerStarted","Data":"2c06378084e22b4ae506308d45701581d7da96abb00d0c4a1dffcf2c23e2b71f"}
Jul 06 17:38:57.222118 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:57.222085    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ppczn" event={"ID":"4df6b3a7-f662-4051-95ae-f02aa7ac31f0","Type":"ContainerStarted","Data":"c8071d593f8fa040bfede549d44e671306bc6260af4491ac6ab206d47f66f406"}
Jul 06 17:38:57.223551 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:57.223526    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dppdr" event={"ID":"2e407ce7-21d1-4316-b572-a4a28f3e2235","Type":"ContainerStarted","Data":"0ce2776edfef4155c33881e2a89a56efdb1a6fcc0b55f9eacbdf305860dd5735"}
Jul 06 17:38:57.228483 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:57.228457    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" event={"ID":"1822161f850ef2b3317aaf5916b61399","Type":"ContainerStarted","Data":"b894ce65621a59119c875ce612366bd7e6073e8aa51a60b76c806b6cd7d49490"}
Jul 06 17:38:57.237783 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:57.237736    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ppczn" podStartSLOduration=2.984039682 podStartE2EDuration="23.237717764s" totalImagesPullingTime="20.253678082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:38:57.237248448 +0000 UTC m=+23.815449285" watchObservedRunningTime="2026-07-06 17:38:57.237717764 +0000 UTC m=+23.815918599"
Jul 06 17:38:57.265975 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:57.265932    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dppdr" podStartSLOduration=2.7672460770000002 podStartE2EDuration="23.26591698s" totalImagesPullingTime="20.498670903s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:38:57.253110586 +0000 UTC m=+23.831311447" watchObservedRunningTime="2026-07-06 17:38:57.26591698 +0000 UTC m=+23.844117806"
Jul 06 17:38:57.266592 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:57.266552    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" podStartSLOduration=22.266536936 podStartE2EDuration="22.266536936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:38:57.266191063 +0000 UTC m=+23.844391899" watchObservedRunningTime="2026-07-06 17:38:57.266536936 +0000 UTC m=+23.844737773"
Jul 06 17:38:57.967927 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:57.967892    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:57.968102 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:57.968003    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:38:58.232074 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.232046    2570 generic.go:356] "Generic (PLEG): container finished" podID="d7c5985e-315d-4459-8274-6dd000f12c0b" containerID="92d49f105c9579f9e48850c396538dbef31c722efe82389956903e0d5c6850f6" exitCode=0
Jul 06 17:38:58.232743 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.232123    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnvng" event={"ID":"d7c5985e-315d-4459-8274-6dd000f12c0b","Type":"ContainerDied","Data":"92d49f105c9579f9e48850c396538dbef31c722efe82389956903e0d5c6850f6"}
Jul 06 17:38:58.233763 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.233620    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qdlcp" event={"ID":"3e763fe4-2283-4e52-8424-7a99d7680e5d","Type":"ContainerStarted","Data":"455b3581bdb3d7825aaf835d8b4fd6987012a853f6e682590cf7338433a754f3"}
Jul 06 17:38:58.235162 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.235095    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7" event={"ID":"e9e3032a-b013-4f3c-aa04-941e60038ac5","Type":"ContainerStarted","Data":"4892732708e3565c3fb1b38db47783298d04a260c61c4f5eb3872d2f6100804e"}
Jul 06 17:38:58.236642 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.236475    2570 generic.go:356] "Generic (PLEG): container finished" podID="d3621fce897cec71d75ea532d62b7211" containerID="f9e6cd1106b478bc83dd633cf18c7b2aeaab0af7d4e44761abcf6a01c932ca65" exitCode=0
Jul 06 17:38:58.236756 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.236546    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" event={"ID":"d3621fce897cec71d75ea532d62b7211","Type":"ContainerDied","Data":"f9e6cd1106b478bc83dd633cf18c7b2aeaab0af7d4e44761abcf6a01c932ca65"}
Jul 06 17:38:58.238165 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.238142    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ftklr" event={"ID":"bd70feac-5dfd-48b2-aace-d6464eaab7cb","Type":"ContainerStarted","Data":"88cdbec901c0fa0223c3a810d3fec1db74e8888b7674634e1706d8c6985d731a"}
Jul 06 17:38:58.244748 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.244726    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znx69" event={"ID":"72bc3e2a-027f-4ebb-922d-37aa52ad9be3","Type":"ContainerStarted","Data":"c38ec524b6d281e090a060ccabd3e3ce44163035c7f11773f45c29a79a3419ab"}
Jul 06 17:38:58.244856 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.244815    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znx69" event={"ID":"72bc3e2a-027f-4ebb-922d-37aa52ad9be3","Type":"ContainerStarted","Data":"343ea31c08e60ed00e37c49a060fd74826d43530a980e0a383c47f8f6ebc5ccf"}
Jul 06 17:38:58.244856 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.244852    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znx69" event={"ID":"72bc3e2a-027f-4ebb-922d-37aa52ad9be3","Type":"ContainerStarted","Data":"303954dbe8d67420d539fb1418c0ee60e22f894afcf342f8d3d62141282c870a"}
Jul 06 17:38:58.244968 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.244887    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znx69" event={"ID":"72bc3e2a-027f-4ebb-922d-37aa52ad9be3","Type":"ContainerStarted","Data":"eaaa2b420a0c12882306d973471c76aa102990c6e951d38076774e2bd216ac79"}
Jul 06 17:38:58.246056 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.246033    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rvnql" event={"ID":"09179db9-f2bb-4347-94d1-1a3384e1916a","Type":"ContainerStarted","Data":"c64a30ac5b6f04c1a85368ad87b1bbd7d952f83260453624f4d641dc4807ec02"}
Jul 06 17:38:58.276709 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.276654    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rvnql" podStartSLOduration=4.014682117 podStartE2EDuration="24.276640029s" totalImagesPullingTime="20.261957912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:38:58.276388277 +0000 UTC m=+24.854589112" watchObservedRunningTime="2026-07-06 17:38:58.276640029 +0000 UTC m=+24.854840864"
Jul 06 17:38:58.289557 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.289524    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ftklr" podStartSLOduration=4.061980924 podStartE2EDuration="24.28951483s" totalImagesPullingTime="20.227533906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:38:58.289310346 +0000 UTC m=+24.867511188" watchObservedRunningTime="2026-07-06 17:38:58.28951483 +0000 UTC m=+24.867715666"
Jul 06 17:38:58.317897 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.317859    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qdlcp" podStartSLOduration=8.286210072 podStartE2EDuration="24.317846108s" totalImagesPullingTime="16.031636036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:38:58.317440984 +0000 UTC m=+24.895641820" watchObservedRunningTime="2026-07-06 17:38:58.317846108 +0000 UTC m=+24.896046947"
Jul 06 17:38:58.967828 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.967796    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:38:58.968082 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:58.967844    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:38:58.968082 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:58.967903    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:38:58.968082 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:58.968038    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:38:59.228131 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:59.228005    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 17:38:59.249403 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:59.249375    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5bdqq" event={"ID":"73d95216-af95-42a3-928e-b244675545fb","Type":"ContainerStarted","Data":"dfb4cbb7fed7bc60e1c4c9ed4a8bb0bc73ba7478ecdfc1ce2055d3c7b56ddb10"}
Jul 06 17:38:59.251294 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:59.251261    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7" event={"ID":"e9e3032a-b013-4f3c-aa04-941e60038ac5","Type":"ContainerStarted","Data":"b74efb9e5cd589a104dcfb6b3565bdf8aacadb0dbc4384843d65578939788c77"}
Jul 06 17:38:59.253334 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:59.253311    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" event={"ID":"d3621fce897cec71d75ea532d62b7211","Type":"ContainerStarted","Data":"0b022742f2ae6f5b8cc48c32d9f095b8669318dcce83250e8a2410eda475f9bb"}
Jul 06 17:38:59.263496 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:59.263454    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5bdqq" podStartSLOduration=4.590120544 podStartE2EDuration="25.263440405s" totalImagesPullingTime="20.673319861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:38:59.262716418 +0000 UTC m=+25.840917252" watchObservedRunningTime="2026-07-06 17:38:59.263440405 +0000 UTC m=+25.841641240"
Jul 06 17:38:59.278410 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:59.278362    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" podStartSLOduration=24.278344626 podStartE2EDuration="24.278344626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:38:59.278054575 +0000 UTC m=+25.856255411" watchObservedRunningTime="2026-07-06 17:38:59.278344626 +0000 UTC m=+25.856545464"
Jul 06 17:38:59.902014 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:59.901799    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T17:38:59.228018077Z","UUID":"e9943626-3e37-4cd0-9249-47aa8c292ec0","Handler":null,"Name":"","Endpoint":""}
Jul 06 17:38:59.903891 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:59.903858    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 17:38:59.904010 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:59.903906    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 17:38:59.973336 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:38:59.973304    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:38:59.973661 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:38:59.973426    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:39:00.347524 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:00.347486    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qdlcp"
Jul 06 17:39:00.348162 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:00.348135    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qdlcp"
Jul 06 17:39:00.968487 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:00.968462    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:39:00.968675 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:00.968503    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:39:00.968675 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:00.968587    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:39:00.968818 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:00.968688    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:39:01.261086 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:01.261002    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znx69" event={"ID":"72bc3e2a-027f-4ebb-922d-37aa52ad9be3","Type":"ContainerStarted","Data":"f7bdd9621b117da57f67c79db296b85ad865980012e35de2b1e9b8cdcfddb3b0"}
Jul 06 17:39:01.263244 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:01.263216    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7" event={"ID":"e9e3032a-b013-4f3c-aa04-941e60038ac5","Type":"ContainerStarted","Data":"85cba590675ab6434f1c8314e6c094e3cc019ac58440fdd362446787e49a9517"}
Jul 06 17:39:01.263578 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:01.263518    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qdlcp"
Jul 06 17:39:01.263921 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:01.263903    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qdlcp"
Jul 06 17:39:01.281117 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:01.281078    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ffvc7" podStartSLOduration=4.307135259 podStartE2EDuration="27.281065724s" totalImagesPullingTime="22.973930465s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:01.28095639 +0000 UTC m=+27.859157226" watchObservedRunningTime="2026-07-06 17:39:01.281065724 +0000 UTC m=+27.859266559"
Jul 06 17:39:01.971286 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:01.971223    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:39:01.971714 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:01.971316    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:39:02.968237 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:02.968044    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:39:02.968408 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:02.968079    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:39:02.968408 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:02.968324    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:39:02.968408 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:02.968385    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:39:03.272241 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:03.272061    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-znx69" event={"ID":"72bc3e2a-027f-4ebb-922d-37aa52ad9be3","Type":"ContainerStarted","Data":"1a20ed87c548fa9d95238739f2b87c1cb654c5615f8bd85b42c49f0fef004f53"}
Jul 06 17:39:03.304133 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:03.304083    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-znx69" podStartSLOduration=8.712824414 podStartE2EDuration="29.304068868s" totalImagesPullingTime="20.591244454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:03.303680107 +0000 UTC m=+29.881880955" watchObservedRunningTime="2026-07-06 17:39:03.304068868 +0000 UTC m=+29.882269703"
Jul 06 17:39:03.969232 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:03.969199    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:39:03.969450 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:03.969318    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:39:04.274645 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:04.274391    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:39:04.275143 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:04.274742    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:39:04.275143 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:04.274804    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:39:04.290540 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:04.290469    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:39:04.290808 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:04.290785    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:39:04.455933 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:04.455888    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zj4jw"]
Jul 06 17:39:04.456118 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:04.456020    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:39:04.456176 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:04.456135    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:39:04.456644 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:04.456618    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ctmnm"]
Jul 06 17:39:04.456791 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:04.456748    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:39:04.456834 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:04.456819    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:39:04.461855 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:04.461826    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4kzvg"]
Jul 06 17:39:04.461992 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:04.461940    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:39:04.462061 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:04.462041    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:39:05.967911 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:05.967885    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:39:05.968201 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:05.967893    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:39:05.968201 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:05.968000    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:39:05.968201 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:05.968002    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:39:05.968201 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:05.968088    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:39:05.968201 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:05.968165    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:39:06.279961 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:06.279924    2570 generic.go:356] "Generic (PLEG): container finished" podID="d7c5985e-315d-4459-8274-6dd000f12c0b" containerID="248594daec45fb45c5aa4eba5d16a51ca01076d419a70f36307debe4be3e5f87" exitCode=0
Jul 06 17:39:06.280137 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:06.280012    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnvng" event={"ID":"d7c5985e-315d-4459-8274-6dd000f12c0b","Type":"ContainerDied","Data":"248594daec45fb45c5aa4eba5d16a51ca01076d419a70f36307debe4be3e5f87"}
Jul 06 17:39:06.587462 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:06.587389    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs\") pod \"network-metrics-daemon-4kzvg\" (UID: \"c33ba8f0-913e-48a7-a455-54c14e022b74\") " pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:39:06.587462 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:06.587430    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:39:06.587642 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:06.587544    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 17:39:06.587642 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:06.587600    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret podName:a4034c17-7d21-4541-998d-1c24d8e3ac45 nodeName:}" failed. No retries permitted until 2026-07-06 17:39:38.587587923 +0000 UTC m=+65.165788736 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret") pod "global-pull-secret-syncer-zj4jw" (UID: "a4034c17-7d21-4541-998d-1c24d8e3ac45") : object "kube-system"/"original-pull-secret" not registered
Jul 06 17:39:06.587642 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:06.587544    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 17:39:06.587775 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:06.587669    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs podName:c33ba8f0-913e-48a7-a455-54c14e022b74 nodeName:}" failed. No retries permitted until 2026-07-06 17:39:38.587658368 +0000 UTC m=+65.165859198 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs") pod "network-metrics-daemon-4kzvg" (UID: "c33ba8f0-913e-48a7-a455-54c14e022b74") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 17:39:06.688054 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:06.688026    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fl8f\" (UniqueName: \"kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f\") pod \"network-check-target-ctmnm\" (UID: \"4e40e524-cfc3-4244-bf53-4a18cbdc1549\") " pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:39:06.688202 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:06.688145    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 17:39:06.688202 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:06.688158    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 17:39:06.688202 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:06.688167    2570 projected.go:196] Error preparing data for projected volume kube-api-access-4fl8f for pod openshift-network-diagnostics/network-check-target-ctmnm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 17:39:06.688316 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:06.688208    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f podName:4e40e524-cfc3-4244-bf53-4a18cbdc1549 nodeName:}" failed. No retries permitted until 2026-07-06 17:39:38.688195637 +0000 UTC m=+65.266396451 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4fl8f" (UniqueName: "kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f") pod "network-check-target-ctmnm" (UID: "4e40e524-cfc3-4244-bf53-4a18cbdc1549") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 17:39:07.284686 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:07.284602    2570 generic.go:356] "Generic (PLEG): container finished" podID="d7c5985e-315d-4459-8274-6dd000f12c0b" containerID="351057c12d63d80f987862943487bfca396c59c9372eb906ef8ac7c14e47f4f9" exitCode=0
Jul 06 17:39:07.284686 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:07.284651    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnvng" event={"ID":"d7c5985e-315d-4459-8274-6dd000f12c0b","Type":"ContainerDied","Data":"351057c12d63d80f987862943487bfca396c59c9372eb906ef8ac7c14e47f4f9"}
Jul 06 17:39:07.968090 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:07.968053    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:39:07.968193 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:07.968069    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:39:07.968193 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:07.968170    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:39:07.968193 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:07.968188    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:39:07.968332 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:07.968297    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:39:07.968408 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:07.968392    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:39:08.289046 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:08.288957    2570 generic.go:356] "Generic (PLEG): container finished" podID="d7c5985e-315d-4459-8274-6dd000f12c0b" containerID="bf21c1b6a1bbdf0f1e81c7c35cfcc95f2b1eae66184bff8aed353d3623c60ac0" exitCode=0
Jul 06 17:39:08.289046 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:08.289008    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnvng" event={"ID":"d7c5985e-315d-4459-8274-6dd000f12c0b","Type":"ContainerDied","Data":"bf21c1b6a1bbdf0f1e81c7c35cfcc95f2b1eae66184bff8aed353d3623c60ac0"}
Jul 06 17:39:09.969050 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:09.968815    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:39:09.969454 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:09.968869    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:39:09.969454 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:09.969166    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4kzvg" podUID="c33ba8f0-913e-48a7-a455-54c14e022b74"
Jul 06 17:39:09.969454 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:09.968867    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:39:09.969454 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:09.969235    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj4jw" podUID="a4034c17-7d21-4541-998d-1c24d8e3ac45"
Jul 06 17:39:09.969454 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:09.969310    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ctmnm" podUID="4e40e524-cfc3-4244-bf53-4a18cbdc1549"
Jul 06 17:39:10.701281 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:10.701241    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeReady"
Jul 06 17:39:10.701510 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:10.701397    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 17:39:10.749418 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:10.749308    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5wj5t"]
Jul 06 17:39:10.841203 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:10.841175    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4f8mj"]
Jul 06 17:39:10.841364 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:10.841307    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:10.844325 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:10.844298    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 17:39:10.844325 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:10.844324    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-75j6z\""
Jul 06 17:39:10.844510 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:10.844343    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 17:39:10.855482 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:10.855452    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4f8mj"]
Jul 06 17:39:10.855591 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:10.855489    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5wj5t"]
Jul 06 17:39:10.855591 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:10.855569    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4f8mj"
Jul 06 17:39:10.859950 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:10.859932    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 17:39:10.860217 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:10.860193    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 17:39:10.860778 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:10.860765    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 17:39:10.861421 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:10.861406    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-46kbs\""
Jul 06 17:39:11.023714 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.023623    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:11.023714 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.023665    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgx2v\" (UniqueName: \"kubernetes.io/projected/3030c401-885a-4d9b-b58f-159282dee0ea-kube-api-access-wgx2v\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:11.024141 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.023755    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3030c401-885a-4d9b-b58f-159282dee0ea-config-volume\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:11.024141 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.023789    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc879502-ae48-40d5-9e23-c58c6fa046b4-cert\") pod \"ingress-canary-4f8mj\" (UID: \"fc879502-ae48-40d5-9e23-c58c6fa046b4\") " pod="openshift-ingress-canary/ingress-canary-4f8mj"
Jul 06 17:39:11.024141 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.023814    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6jh4\" (UniqueName: \"kubernetes.io/projected/fc879502-ae48-40d5-9e23-c58c6fa046b4-kube-api-access-j6jh4\") pod \"ingress-canary-4f8mj\" (UID: \"fc879502-ae48-40d5-9e23-c58c6fa046b4\") " pod="openshift-ingress-canary/ingress-canary-4f8mj"
Jul 06 17:39:11.024141 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.023848    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3030c401-885a-4d9b-b58f-159282dee0ea-tmp-dir\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:11.124931 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.124894    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3030c401-885a-4d9b-b58f-159282dee0ea-config-volume\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:11.125119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.124937    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc879502-ae48-40d5-9e23-c58c6fa046b4-cert\") pod \"ingress-canary-4f8mj\" (UID: \"fc879502-ae48-40d5-9e23-c58c6fa046b4\") " pod="openshift-ingress-canary/ingress-canary-4f8mj"
Jul 06 17:39:11.125119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.124966    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6jh4\" (UniqueName: \"kubernetes.io/projected/fc879502-ae48-40d5-9e23-c58c6fa046b4-kube-api-access-j6jh4\") pod \"ingress-canary-4f8mj\" (UID: \"fc879502-ae48-40d5-9e23-c58c6fa046b4\") " pod="openshift-ingress-canary/ingress-canary-4f8mj"
Jul 06 17:39:11.125119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.124995    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3030c401-885a-4d9b-b58f-159282dee0ea-tmp-dir\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:11.125119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.125051    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:11.125119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.125077    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgx2v\" (UniqueName: \"kubernetes.io/projected/3030c401-885a-4d9b-b58f-159282dee0ea-kube-api-access-wgx2v\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:11.125347 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:11.125162    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 17:39:11.125347 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:11.125240    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls podName:3030c401-885a-4d9b-b58f-159282dee0ea nodeName:}" failed. No retries permitted until 2026-07-06 17:39:11.6252195 +0000 UTC m=+38.203420335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls") pod "dns-default-5wj5t" (UID: "3030c401-885a-4d9b-b58f-159282dee0ea") : secret "dns-default-metrics-tls" not found
Jul 06 17:39:11.125347 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.125321    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3030c401-885a-4d9b-b58f-159282dee0ea-tmp-dir\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:11.125513 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.125495    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3030c401-885a-4d9b-b58f-159282dee0ea-config-volume\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:11.129045 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.129028    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc879502-ae48-40d5-9e23-c58c6fa046b4-cert\") pod \"ingress-canary-4f8mj\" (UID: \"fc879502-ae48-40d5-9e23-c58c6fa046b4\") " pod="openshift-ingress-canary/ingress-canary-4f8mj"
Jul 06 17:39:11.135735 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.135712    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgx2v\" (UniqueName: \"kubernetes.io/projected/3030c401-885a-4d9b-b58f-159282dee0ea-kube-api-access-wgx2v\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:11.135907 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.135887    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6jh4\" (UniqueName: \"kubernetes.io/projected/fc879502-ae48-40d5-9e23-c58c6fa046b4-kube-api-access-j6jh4\") pod \"ingress-canary-4f8mj\" (UID: \"fc879502-ae48-40d5-9e23-c58c6fa046b4\") " pod="openshift-ingress-canary/ingress-canary-4f8mj"
Jul 06 17:39:11.164770 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.164748    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4f8mj"
Jul 06 17:39:11.361805 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.361770    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4f8mj"]
Jul 06 17:39:11.365833 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:39:11.365809    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc879502_ae48_40d5_9e23_c58c6fa046b4.slice/crio-84e563c041aed56f3d1ec75bb4fbab7f842ed244a7d3bc6d086e6c5d0d83fd40 WatchSource:0}: Error finding container 84e563c041aed56f3d1ec75bb4fbab7f842ed244a7d3bc6d086e6c5d0d83fd40: Status 404 returned error can't find the container with id 84e563c041aed56f3d1ec75bb4fbab7f842ed244a7d3bc6d086e6c5d0d83fd40
Jul 06 17:39:11.629432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.629348    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:11.629609 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:11.629480    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 17:39:11.629609 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:11.629551    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls podName:3030c401-885a-4d9b-b58f-159282dee0ea nodeName:}" failed. No retries permitted until 2026-07-06 17:39:12.629531178 +0000 UTC m=+39.207732016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls") pod "dns-default-5wj5t" (UID: "3030c401-885a-4d9b-b58f-159282dee0ea") : secret "dns-default-metrics-tls" not found
Jul 06 17:39:11.968187 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.968149    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:39:11.968371 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.968198    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:39:11.968371 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.968149    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:39:11.973264 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.973234    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 17:39:11.973407 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.973269    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wwzt2\""
Jul 06 17:39:11.973407 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.973305    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkf68\""
Jul 06 17:39:11.973407 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.973239    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 17:39:11.973407 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.973305    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 17:39:11.973407 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:11.973272    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 17:39:12.299821 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:12.299742    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4f8mj" event={"ID":"fc879502-ae48-40d5-9e23-c58c6fa046b4","Type":"ContainerStarted","Data":"84e563c041aed56f3d1ec75bb4fbab7f842ed244a7d3bc6d086e6c5d0d83fd40"}
Jul 06 17:39:12.637042 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:12.636901    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:12.637191 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:12.637075    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 17:39:12.637191 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:12.637151    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls podName:3030c401-885a-4d9b-b58f-159282dee0ea nodeName:}" failed. No retries permitted until 2026-07-06 17:39:14.637126539 +0000 UTC m=+41.215327365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls") pod "dns-default-5wj5t" (UID: "3030c401-885a-4d9b-b58f-159282dee0ea") : secret "dns-default-metrics-tls" not found
Jul 06 17:39:14.652808 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:14.652575    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:14.653243 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:14.652720    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 17:39:14.653243 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:14.652888    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls podName:3030c401-885a-4d9b-b58f-159282dee0ea nodeName:}" failed. No retries permitted until 2026-07-06 17:39:18.65286613 +0000 UTC m=+45.231066962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls") pod "dns-default-5wj5t" (UID: "3030c401-885a-4d9b-b58f-159282dee0ea") : secret "dns-default-metrics-tls" not found
Jul 06 17:39:16.310495 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:16.310459    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4f8mj" event={"ID":"fc879502-ae48-40d5-9e23-c58c6fa046b4","Type":"ContainerStarted","Data":"8bf9969b7aae1488b53947e7087383108f7ebb9a947d5e6bf95632b8bbca8f33"}
Jul 06 17:39:16.313447 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:16.313402    2570 generic.go:356] "Generic (PLEG): container finished" podID="d7c5985e-315d-4459-8274-6dd000f12c0b" containerID="93660b5cbf37437c4ba6a8379f682922023277e9a25ed21eef6a3bbb00abf7b2" exitCode=0
Jul 06 17:39:16.313567 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:16.313465    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnvng" event={"ID":"d7c5985e-315d-4459-8274-6dd000f12c0b","Type":"ContainerDied","Data":"93660b5cbf37437c4ba6a8379f682922023277e9a25ed21eef6a3bbb00abf7b2"}
Jul 06 17:39:16.328850 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:16.328809    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4f8mj" podStartSLOduration=2.018970604 podStartE2EDuration="6.328795345s" totalImagesPullingTime="4.309824741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:16.327759315 +0000 UTC m=+42.905960150" watchObservedRunningTime="2026-07-06 17:39:16.328795345 +0000 UTC m=+42.906996181"
Jul 06 17:39:17.318427 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:17.318394    2570 generic.go:356] "Generic (PLEG): container finished" podID="d7c5985e-315d-4459-8274-6dd000f12c0b" containerID="7ac7022ab9ed8235307eb43a24374b6087fb0635ffda44663190bf4bc97e697c" exitCode=0
Jul 06 17:39:17.318889 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:17.318491    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnvng" event={"ID":"d7c5985e-315d-4459-8274-6dd000f12c0b","Type":"ContainerDied","Data":"7ac7022ab9ed8235307eb43a24374b6087fb0635ffda44663190bf4bc97e697c"}
Jul 06 17:39:18.323714 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:18.323667    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vnvng" event={"ID":"d7c5985e-315d-4459-8274-6dd000f12c0b","Type":"ContainerStarted","Data":"18f6febaad8d58b2222bbde6e892681c1fdead388857ac7d8fb5f7ec57edc481"}
Jul 06 17:39:18.347392 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:18.347116    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vnvng" podStartSLOduration=7.579686884 podStartE2EDuration="44.347094341s" totalImagesPullingTime="36.767407457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:18.345173026 +0000 UTC m=+44.923373861" watchObservedRunningTime="2026-07-06 17:39:18.347094341 +0000 UTC m=+44.925295178"
Jul 06 17:39:18.678415 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:18.678321    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:18.678567 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:18.678463    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 17:39:18.678567 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:18.678528    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls podName:3030c401-885a-4d9b-b58f-159282dee0ea nodeName:}" failed. No retries permitted until 2026-07-06 17:39:26.678514076 +0000 UTC m=+53.256714925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls") pod "dns-default-5wj5t" (UID: "3030c401-885a-4d9b-b58f-159282dee0ea") : secret "dns-default-metrics-tls" not found
Jul 06 17:39:26.726258 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:26.726155    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:26.726745 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:26.726271    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 17:39:26.726745 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:26.726329    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls podName:3030c401-885a-4d9b-b58f-159282dee0ea nodeName:}" failed. No retries permitted until 2026-07-06 17:39:42.726316218 +0000 UTC m=+69.304517032 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls") pod "dns-default-5wj5t" (UID: "3030c401-885a-4d9b-b58f-159282dee0ea") : secret "dns-default-metrics-tls" not found
Jul 06 17:39:36.290586 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:36.290555    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-znx69"
Jul 06 17:39:38.609274 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:38.609226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs\") pod \"network-metrics-daemon-4kzvg\" (UID: \"c33ba8f0-913e-48a7-a455-54c14e022b74\") " pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:39:38.609274 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:38.609285    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:39:38.611866 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:38.611849    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 17:39:38.612175 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:38.612159    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 17:39:38.620454 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:38.620433    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 17:39:38.620537 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:38.620525    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs podName:c33ba8f0-913e-48a7-a455-54c14e022b74 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:42.620505696 +0000 UTC m=+129.198706512 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs") pod "network-metrics-daemon-4kzvg" (UID: "c33ba8f0-913e-48a7-a455-54c14e022b74") : secret "metrics-daemon-secret" not found
Jul 06 17:39:38.623406 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:38.623383    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4034c17-7d21-4541-998d-1c24d8e3ac45-original-pull-secret\") pod \"global-pull-secret-syncer-zj4jw\" (UID: \"a4034c17-7d21-4541-998d-1c24d8e3ac45\") " pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:39:38.691738 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:38.691710    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj4jw"
Jul 06 17:39:38.710417 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:38.710390    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fl8f\" (UniqueName: \"kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f\") pod \"network-check-target-ctmnm\" (UID: \"4e40e524-cfc3-4244-bf53-4a18cbdc1549\") " pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:39:38.713504 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:38.713485    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 17:39:38.723816 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:38.723792    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 17:39:38.733580 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:38.733556    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fl8f\" (UniqueName: \"kubernetes.io/projected/4e40e524-cfc3-4244-bf53-4a18cbdc1549-kube-api-access-4fl8f\") pod \"network-check-target-ctmnm\" (UID: \"4e40e524-cfc3-4244-bf53-4a18cbdc1549\") " pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:39:38.807718 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:38.807677    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zj4jw"]
Jul 06 17:39:38.810737 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:39:38.810707    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4034c17_7d21_4541_998d_1c24d8e3ac45.slice/crio-600942e3e9db6f2a8001b77cff56b0d0d3d7f1cde312fc85947cd5d5a2536526 WatchSource:0}: Error finding container 600942e3e9db6f2a8001b77cff56b0d0d3d7f1cde312fc85947cd5d5a2536526: Status 404 returned error can't find the container with id 600942e3e9db6f2a8001b77cff56b0d0d3d7f1cde312fc85947cd5d5a2536526
Jul 06 17:39:38.988218 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:38.988189    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkf68\""
Jul 06 17:39:38.996375 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:38.996357    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:39:39.108530 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:39.108499    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ctmnm"]
Jul 06 17:39:39.112114 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:39:39.112077    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e40e524_cfc3_4244_bf53_4a18cbdc1549.slice/crio-4409568e187adc5fc2843485b35a3f482825fd703645bdd8e70aba03749cb2cf WatchSource:0}: Error finding container 4409568e187adc5fc2843485b35a3f482825fd703645bdd8e70aba03749cb2cf: Status 404 returned error can't find the container with id 4409568e187adc5fc2843485b35a3f482825fd703645bdd8e70aba03749cb2cf
Jul 06 17:39:39.376226 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:39.376147    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ctmnm" event={"ID":"4e40e524-cfc3-4244-bf53-4a18cbdc1549","Type":"ContainerStarted","Data":"4409568e187adc5fc2843485b35a3f482825fd703645bdd8e70aba03749cb2cf"}
Jul 06 17:39:39.377159 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:39.377135    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zj4jw" event={"ID":"a4034c17-7d21-4541-998d-1c24d8e3ac45","Type":"ContainerStarted","Data":"600942e3e9db6f2a8001b77cff56b0d0d3d7f1cde312fc85947cd5d5a2536526"}
Jul 06 17:39:42.738085 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:42.738052    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:39:42.738602 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:42.738171    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 17:39:42.738602 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:39:42.738236    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls podName:3030c401-885a-4d9b-b58f-159282dee0ea nodeName:}" failed. No retries permitted until 2026-07-06 17:40:14.738219448 +0000 UTC m=+101.316420262 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls") pod "dns-default-5wj5t" (UID: "3030c401-885a-4d9b-b58f-159282dee0ea") : secret "dns-default-metrics-tls" not found
Jul 06 17:39:44.391986 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:44.391951    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ctmnm" event={"ID":"4e40e524-cfc3-4244-bf53-4a18cbdc1549","Type":"ContainerStarted","Data":"2d0c83d8c95213e3a2468daa1c17f1ac6f4b064b16ca145d43b9caf933c53ed7"}
Jul 06 17:39:44.392411 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:44.392074    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:39:44.393439 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:44.393418    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zj4jw" event={"ID":"a4034c17-7d21-4541-998d-1c24d8e3ac45","Type":"ContainerStarted","Data":"901d570815a4910b442724f793e0911989204bd3e3ff6ea35c554f8b7422a91f"}
Jul 06 17:39:44.408029 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:44.407986    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ctmnm" podStartSLOduration=65.851104555 podStartE2EDuration="1m10.407971363s" totalImagesPullingTime="4.556866808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:44.40741431 +0000 UTC m=+70.985615146" watchObservedRunningTime="2026-07-06 17:39:44.407971363 +0000 UTC m=+70.986172203"
Jul 06 17:39:44.422106 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:44.422017    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zj4jw" podStartSLOduration=65.559133251 podStartE2EDuration="1m10.422001764s" totalImagesPullingTime="4.862868513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:44.421803998 +0000 UTC m=+71.000004835" watchObservedRunningTime="2026-07-06 17:39:44.422001764 +0000 UTC m=+71.000202595"
Jul 06 17:39:59.728828 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.728719    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-k5ghp"]
Jul 06 17:39:59.732630 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.732613    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.735395 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.735371    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 17:39:59.735527 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.735510    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 17:39:59.736653 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.736636    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 17:39:59.736653 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.736649    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bpmbv\""
Jul 06 17:39:59.736916 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.736683    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 17:39:59.742009 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.741982    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 17:39:59.742154 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.742138    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-k5ghp"]
Jul 06 17:39:59.853806 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.853778    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a82af56-16d0-456d-a04f-b82f288688c8-serving-cert\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.853948 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.853818    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a82af56-16d0-456d-a04f-b82f288688c8-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.853948 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.853848    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a82af56-16d0-456d-a04f-b82f288688c8-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.853948 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.853879    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqhnh\" (UniqueName: \"kubernetes.io/projected/6a82af56-16d0-456d-a04f-b82f288688c8-kube-api-access-tqhnh\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.853948 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.853917    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6a82af56-16d0-456d-a04f-b82f288688c8-snapshots\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.854078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.853958    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a82af56-16d0-456d-a04f-b82f288688c8-tmp\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.954977 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.954938    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6a82af56-16d0-456d-a04f-b82f288688c8-snapshots\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.955132 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.955001    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a82af56-16d0-456d-a04f-b82f288688c8-tmp\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.955132 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.955021    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a82af56-16d0-456d-a04f-b82f288688c8-serving-cert\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.955132 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.955051    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a82af56-16d0-456d-a04f-b82f288688c8-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.955132 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.955070    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a82af56-16d0-456d-a04f-b82f288688c8-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.955132 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.955088    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqhnh\" (UniqueName: \"kubernetes.io/projected/6a82af56-16d0-456d-a04f-b82f288688c8-kube-api-access-tqhnh\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.955602 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.955582    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a82af56-16d0-456d-a04f-b82f288688c8-tmp\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.955679 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.955664    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a82af56-16d0-456d-a04f-b82f288688c8-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.955757 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.955725    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6a82af56-16d0-456d-a04f-b82f288688c8-snapshots\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.955927 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.955909    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a82af56-16d0-456d-a04f-b82f288688c8-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.957421 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.957399    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a82af56-16d0-456d-a04f-b82f288688c8-serving-cert\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:39:59.963158 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:39:59.963133    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqhnh\" (UniqueName: \"kubernetes.io/projected/6a82af56-16d0-456d-a04f-b82f288688c8-kube-api-access-tqhnh\") pod \"insights-operator-5c847dcfc4-k5ghp\" (UID: \"6a82af56-16d0-456d-a04f-b82f288688c8\") " pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:40:00.041367 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:00.041292    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp"
Jul 06 17:40:00.157332 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:00.157300    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-k5ghp"]
Jul 06 17:40:00.160044 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:40:00.160015    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a82af56_16d0_456d_a04f_b82f288688c8.slice/crio-c93fecbab1908fe1b0a53f457afdabdc09ccf93e5a4942b81d07097b06e7a534 WatchSource:0}: Error finding container c93fecbab1908fe1b0a53f457afdabdc09ccf93e5a4942b81d07097b06e7a534: Status 404 returned error can't find the container with id c93fecbab1908fe1b0a53f457afdabdc09ccf93e5a4942b81d07097b06e7a534
Jul 06 17:40:00.431456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:00.431370    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp" event={"ID":"6a82af56-16d0-456d-a04f-b82f288688c8","Type":"ContainerStarted","Data":"c93fecbab1908fe1b0a53f457afdabdc09ccf93e5a4942b81d07097b06e7a534"}
Jul 06 17:40:03.440889 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:03.440848    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp" event={"ID":"6a82af56-16d0-456d-a04f-b82f288688c8","Type":"ContainerStarted","Data":"ac5b4704f5cc6fa59156c26c61c32bf2034953d301b2f8b832466b6d884576ce"}
Jul 06 17:40:03.461462 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:03.461413    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp" podStartSLOduration=1.793802698 podStartE2EDuration="4.461394428s" totalImagesPullingTime="2.66759173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:03.461319494 +0000 UTC m=+90.039520356" watchObservedRunningTime="2026-07-06 17:40:03.461394428 +0000 UTC m=+90.039595264"
Jul 06 17:40:04.804856 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.804815    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f899r"]
Jul 06 17:40:04.808957 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.808741    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:04.811992 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.811963    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-chbhn\""
Jul 06 17:40:04.812126 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.812006    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 17:40:04.812126 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.812012    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 17:40:04.826556 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.826529    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f899r"]
Jul 06 17:40:04.889987 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.889954    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:04.890147 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.889995    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-data-volume\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:04.890147 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.890026    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:04.890222 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.890147    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mzfn\" (UniqueName: \"kubernetes.io/projected/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-api-access-5mzfn\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:04.890222 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.890194    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-crio-socket\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:04.991264 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.991229    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-crio-socket\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:04.991264 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.991267    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:04.991608 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.991290    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-data-volume\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:04.991608 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.991310    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:04.991608 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.991363    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-crio-socket\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:04.991608 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.991380    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mzfn\" (UniqueName: \"kubernetes.io/projected/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-api-access-5mzfn\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:04.991608 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:04.991373    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 17:40:04.991608 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:04.991434    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 17:40:04.991608 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:04.991489    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls podName:d6a988e7-d4c4-4517-9f16-2d597b9a67ed nodeName:}" failed. No retries permitted until 2026-07-06 17:40:05.491474317 +0000 UTC m=+92.069675163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f899r" (UID: "d6a988e7-d4c4-4517-9f16-2d597b9a67ed") : secret "insights-runtime-extractor-tls" not found
Jul 06 17:40:04.991608 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:04.991556    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm podName:d6a988e7-d4c4-4517-9f16-2d597b9a67ed nodeName:}" failed. No retries permitted until 2026-07-06 17:40:05.491537696 +0000 UTC m=+92.069738530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f899r" (UID: "d6a988e7-d4c4-4517-9f16-2d597b9a67ed") : configmap "kube-rbac-proxy" not found
Jul 06 17:40:04.991905 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.991689    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-data-volume\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:04.999990 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:04.999971    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mzfn\" (UniqueName: \"kubernetes.io/projected/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-api-access-5mzfn\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:05.495353 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:05.495300    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:05.495542 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:05.495434    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:05.495542 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:05.495470    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 17:40:05.495542 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:05.495501    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 17:40:05.495685 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:05.495550    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls podName:d6a988e7-d4c4-4517-9f16-2d597b9a67ed nodeName:}" failed. No retries permitted until 2026-07-06 17:40:06.495533919 +0000 UTC m=+93.073734750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f899r" (UID: "d6a988e7-d4c4-4517-9f16-2d597b9a67ed") : secret "insights-runtime-extractor-tls" not found
Jul 06 17:40:05.495685 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:05.495566    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm podName:d6a988e7-d4c4-4517-9f16-2d597b9a67ed nodeName:}" failed. No retries permitted until 2026-07-06 17:40:06.495559007 +0000 UTC m=+93.073759820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f899r" (UID: "d6a988e7-d4c4-4517-9f16-2d597b9a67ed") : configmap "kube-rbac-proxy" not found
Jul 06 17:40:06.501829 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:06.501791    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:06.501829 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:06.501832    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:06.502272 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:06.501914    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 17:40:06.502272 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:06.501929    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 17:40:06.502272 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:06.501978    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls podName:d6a988e7-d4c4-4517-9f16-2d597b9a67ed nodeName:}" failed. No retries permitted until 2026-07-06 17:40:08.501965889 +0000 UTC m=+95.080166719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f899r" (UID: "d6a988e7-d4c4-4517-9f16-2d597b9a67ed") : secret "insights-runtime-extractor-tls" not found
Jul 06 17:40:06.502272 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:06.502071    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm podName:d6a988e7-d4c4-4517-9f16-2d597b9a67ed nodeName:}" failed. No retries permitted until 2026-07-06 17:40:08.502054177 +0000 UTC m=+95.080254994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f899r" (UID: "d6a988e7-d4c4-4517-9f16-2d597b9a67ed") : configmap "kube-rbac-proxy" not found
Jul 06 17:40:06.688546 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:06.688511    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"]
Jul 06 17:40:06.691689 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:06.691669    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"
Jul 06 17:40:06.694295 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:06.694277    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 17:40:06.694394 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:06.694322    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 17:40:06.694394 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:06.694335    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 17:40:06.694394 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:06.694322    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qq6vl\""
Jul 06 17:40:06.699521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:06.699497    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"]
Jul 06 17:40:06.803870 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:06.803780    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nngdq\" (UID: \"a0e96fec-da0d-496f-a7ff-d55e0ba0103f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"
Jul 06 17:40:06.803870 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:06.803840    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68n8c\" (UniqueName: \"kubernetes.io/projected/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-kube-api-access-68n8c\") pod \"cluster-samples-operator-56fcf86bf-nngdq\" (UID: \"a0e96fec-da0d-496f-a7ff-d55e0ba0103f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"
Jul 06 17:40:06.904211 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:06.904178    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nngdq\" (UID: \"a0e96fec-da0d-496f-a7ff-d55e0ba0103f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"
Jul 06 17:40:06.904370 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:06.904229    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68n8c\" (UniqueName: \"kubernetes.io/projected/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-kube-api-access-68n8c\") pod \"cluster-samples-operator-56fcf86bf-nngdq\" (UID: \"a0e96fec-da0d-496f-a7ff-d55e0ba0103f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"
Jul 06 17:40:06.904370 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:06.904325    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 17:40:06.904439 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:06.904403    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls podName:a0e96fec-da0d-496f-a7ff-d55e0ba0103f nodeName:}" failed. No retries permitted until 2026-07-06 17:40:07.404386604 +0000 UTC m=+93.982587419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nngdq" (UID: "a0e96fec-da0d-496f-a7ff-d55e0ba0103f") : secret "samples-operator-tls" not found
Jul 06 17:40:06.913137 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:06.913114    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68n8c\" (UniqueName: \"kubernetes.io/projected/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-kube-api-access-68n8c\") pod \"cluster-samples-operator-56fcf86bf-nngdq\" (UID: \"a0e96fec-da0d-496f-a7ff-d55e0ba0103f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"
Jul 06 17:40:06.992423 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:06.992398    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rvnql_09179db9-f2bb-4347-94d1-1a3384e1916a/dns-node-resolver/0.log"
Jul 06 17:40:07.392592 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.392559    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ftklr_bd70feac-5dfd-48b2-aace-d6464eaab7cb/node-ca/0.log"
Jul 06 17:40:07.406834 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.406806    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nngdq\" (UID: \"a0e96fec-da0d-496f-a7ff-d55e0ba0103f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"
Jul 06 17:40:07.406958 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:07.406946    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 17:40:07.407012 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:07.407003    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls podName:a0e96fec-da0d-496f-a7ff-d55e0ba0103f nodeName:}" failed. No retries permitted until 2026-07-06 17:40:08.40698586 +0000 UTC m=+94.985186680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nngdq" (UID: "a0e96fec-da0d-496f-a7ff-d55e0ba0103f") : secret "samples-operator-tls" not found
Jul 06 17:40:07.728429 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.728391    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-b7j6m"]
Jul 06 17:40:07.731480 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.731461    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:07.734427 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.734407    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 17:40:07.734533 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.734413    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dw2nb\""
Jul 06 17:40:07.734533 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.734442    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 17:40:07.735731 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.735708    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 17:40:07.735827 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.735736    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 17:40:07.740847 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.740824    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 17:40:07.741582 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.741564    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-b7j6m"]
Jul 06 17:40:07.810144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.810114    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01de017a-3d89-4c44-9ed4-c7ea05a9a84e-serving-cert\") pod \"console-operator-68b757fb67-b7j6m\" (UID: \"01de017a-3d89-4c44-9ed4-c7ea05a9a84e\") " pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:07.810144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.810146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxw8s\" (UniqueName: \"kubernetes.io/projected/01de017a-3d89-4c44-9ed4-c7ea05a9a84e-kube-api-access-sxw8s\") pod \"console-operator-68b757fb67-b7j6m\" (UID: \"01de017a-3d89-4c44-9ed4-c7ea05a9a84e\") " pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:07.810384 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.810313    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01de017a-3d89-4c44-9ed4-c7ea05a9a84e-config\") pod \"console-operator-68b757fb67-b7j6m\" (UID: \"01de017a-3d89-4c44-9ed4-c7ea05a9a84e\") " pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:07.810384 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.810349    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01de017a-3d89-4c44-9ed4-c7ea05a9a84e-trusted-ca\") pod \"console-operator-68b757fb67-b7j6m\" (UID: \"01de017a-3d89-4c44-9ed4-c7ea05a9a84e\") " pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:07.911511 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.911470    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01de017a-3d89-4c44-9ed4-c7ea05a9a84e-serving-cert\") pod \"console-operator-68b757fb67-b7j6m\" (UID: \"01de017a-3d89-4c44-9ed4-c7ea05a9a84e\") " pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:07.911511 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.911510    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxw8s\" (UniqueName: \"kubernetes.io/projected/01de017a-3d89-4c44-9ed4-c7ea05a9a84e-kube-api-access-sxw8s\") pod \"console-operator-68b757fb67-b7j6m\" (UID: \"01de017a-3d89-4c44-9ed4-c7ea05a9a84e\") " pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:07.911802 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.911559    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01de017a-3d89-4c44-9ed4-c7ea05a9a84e-config\") pod \"console-operator-68b757fb67-b7j6m\" (UID: \"01de017a-3d89-4c44-9ed4-c7ea05a9a84e\") " pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:07.911802 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.911574    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01de017a-3d89-4c44-9ed4-c7ea05a9a84e-trusted-ca\") pod \"console-operator-68b757fb67-b7j6m\" (UID: \"01de017a-3d89-4c44-9ed4-c7ea05a9a84e\") " pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:07.912239 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.912218    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/01de017a-3d89-4c44-9ed4-c7ea05a9a84e-config\") pod \"console-operator-68b757fb67-b7j6m\" (UID: \"01de017a-3d89-4c44-9ed4-c7ea05a9a84e\") " pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:07.912382 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.912366    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01de017a-3d89-4c44-9ed4-c7ea05a9a84e-trusted-ca\") pod \"console-operator-68b757fb67-b7j6m\" (UID: \"01de017a-3d89-4c44-9ed4-c7ea05a9a84e\") " pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:07.913819 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.913801    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01de017a-3d89-4c44-9ed4-c7ea05a9a84e-serving-cert\") pod \"console-operator-68b757fb67-b7j6m\" (UID: \"01de017a-3d89-4c44-9ed4-c7ea05a9a84e\") " pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:07.920530 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:07.920504    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxw8s\" (UniqueName: \"kubernetes.io/projected/01de017a-3d89-4c44-9ed4-c7ea05a9a84e-kube-api-access-sxw8s\") pod \"console-operator-68b757fb67-b7j6m\" (UID: \"01de017a-3d89-4c44-9ed4-c7ea05a9a84e\") " pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:08.040501 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:08.040420    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:08.159062 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:08.159039    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-b7j6m"]
Jul 06 17:40:08.161521 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:40:08.161496    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01de017a_3d89_4c44_9ed4_c7ea05a9a84e.slice/crio-bebb19c1905b618ad6fa2cdd48a9ca5b2b3e8f172c51485244354f58f565a6fd WatchSource:0}: Error finding container bebb19c1905b618ad6fa2cdd48a9ca5b2b3e8f172c51485244354f58f565a6fd: Status 404 returned error can't find the container with id bebb19c1905b618ad6fa2cdd48a9ca5b2b3e8f172c51485244354f58f565a6fd
Jul 06 17:40:08.192357 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:08.192336    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4f8mj_fc879502-ae48-40d5-9e23-c58c6fa046b4/serve-healthcheck-canary/0.log"
Jul 06 17:40:08.416313 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:08.416234    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nngdq\" (UID: \"a0e96fec-da0d-496f-a7ff-d55e0ba0103f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"
Jul 06 17:40:08.416457 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:08.416344    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 17:40:08.416457 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:08.416395    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls podName:a0e96fec-da0d-496f-a7ff-d55e0ba0103f nodeName:}" failed. No retries permitted until 2026-07-06 17:40:10.416382072 +0000 UTC m=+96.994582885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nngdq" (UID: "a0e96fec-da0d-496f-a7ff-d55e0ba0103f") : secret "samples-operator-tls" not found
Jul 06 17:40:08.454506 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:08.454473    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m" event={"ID":"01de017a-3d89-4c44-9ed4-c7ea05a9a84e","Type":"ContainerStarted","Data":"bebb19c1905b618ad6fa2cdd48a9ca5b2b3e8f172c51485244354f58f565a6fd"}
Jul 06 17:40:08.517189 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:08.517157    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:08.517339 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:08.517201    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:08.517339 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:08.517279    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 17:40:08.517536 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:08.517340    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm podName:d6a988e7-d4c4-4517-9f16-2d597b9a67ed nodeName:}" failed. No retries permitted until 2026-07-06 17:40:12.51732609 +0000 UTC m=+99.095526907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f899r" (UID: "d6a988e7-d4c4-4517-9f16-2d597b9a67ed") : configmap "kube-rbac-proxy" not found
Jul 06 17:40:08.517536 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:08.517346    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 17:40:08.517536 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:08.517387    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls podName:d6a988e7-d4c4-4517-9f16-2d597b9a67ed nodeName:}" failed. No retries permitted until 2026-07-06 17:40:12.517374757 +0000 UTC m=+99.095575571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f899r" (UID: "d6a988e7-d4c4-4517-9f16-2d597b9a67ed") : secret "insights-runtime-extractor-tls" not found
Jul 06 17:40:09.686087 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.686054    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj"]
Jul 06 17:40:09.689250 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.689230    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj"
Jul 06 17:40:09.691977 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.691955    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 17:40:09.692240 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.692220    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 17:40:09.692334 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.692218    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 17:40:09.692334 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.692254    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 17:40:09.693371 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.693353    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ffctr\""
Jul 06 17:40:09.698887 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.698856    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj"]
Jul 06 17:40:09.796570 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.796539    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh"]
Jul 06 17:40:09.801048 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.801022    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh"
Jul 06 17:40:09.804479 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.804456    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 17:40:09.804577 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.804493    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 17:40:09.804910 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.804888    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 17:40:09.805512 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.805495    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 17:40:09.805815 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.805797    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xfjs2\""
Jul 06 17:40:09.822842 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.822815    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh"]
Jul 06 17:40:09.827982 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.827961    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/25433e62-4542-4b17-bd00-2b522d351fd1-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-95rjj\" (UID: \"25433e62-4542-4b17-bd00-2b522d351fd1\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj"
Jul 06 17:40:09.828097 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.827994    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppwcg\" (UniqueName: \"kubernetes.io/projected/25433e62-4542-4b17-bd00-2b522d351fd1-kube-api-access-ppwcg\") pod \"service-ca-operator-5d46d9ffd4-95rjj\" (UID: \"25433e62-4542-4b17-bd00-2b522d351fd1\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj"
Jul 06 17:40:09.828097 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.828038    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25433e62-4542-4b17-bd00-2b522d351fd1-config\") pod \"service-ca-operator-5d46d9ffd4-95rjj\" (UID: \"25433e62-4542-4b17-bd00-2b522d351fd1\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj"
Jul 06 17:40:09.928933 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.928901    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppwcg\" (UniqueName: \"kubernetes.io/projected/25433e62-4542-4b17-bd00-2b522d351fd1-kube-api-access-ppwcg\") pod \"service-ca-operator-5d46d9ffd4-95rjj\" (UID: \"25433e62-4542-4b17-bd00-2b522d351fd1\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj"
Jul 06 17:40:09.929133 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.929019    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q44c\" (UniqueName: \"kubernetes.io/projected/235b3c7e-5ad8-4006-9424-31d2f85b9b72-kube-api-access-7q44c\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9knh\" (UID: \"235b3c7e-5ad8-4006-9424-31d2f85b9b72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh"
Jul 06 17:40:09.929133 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.929055    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/25433e62-4542-4b17-bd00-2b522d351fd1-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-95rjj\" (UID: \"25433e62-4542-4b17-bd00-2b522d351fd1\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj"
Jul 06 17:40:09.929133 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.929092    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25433e62-4542-4b17-bd00-2b522d351fd1-config\") pod \"service-ca-operator-5d46d9ffd4-95rjj\" (UID: \"25433e62-4542-4b17-bd00-2b522d351fd1\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj"
Jul 06 17:40:09.929304 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.929137    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/235b3c7e-5ad8-4006-9424-31d2f85b9b72-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9knh\" (UID: \"235b3c7e-5ad8-4006-9424-31d2f85b9b72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh"
Jul 06 17:40:09.929304 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.929179    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/235b3c7e-5ad8-4006-9424-31d2f85b9b72-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9knh\" (UID: \"235b3c7e-5ad8-4006-9424-31d2f85b9b72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh"
Jul 06 17:40:09.929782 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.929755    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/25433e62-4542-4b17-bd00-2b522d351fd1-config\") pod \"service-ca-operator-5d46d9ffd4-95rjj\" (UID: \"25433e62-4542-4b17-bd00-2b522d351fd1\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj"
Jul 06 17:40:09.931659 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.931624    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/25433e62-4542-4b17-bd00-2b522d351fd1-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-95rjj\" (UID: \"25433e62-4542-4b17-bd00-2b522d351fd1\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj"
Jul 06 17:40:09.938140 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.938079    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppwcg\" (UniqueName: \"kubernetes.io/projected/25433e62-4542-4b17-bd00-2b522d351fd1-kube-api-access-ppwcg\") pod \"service-ca-operator-5d46d9ffd4-95rjj\" (UID: \"25433e62-4542-4b17-bd00-2b522d351fd1\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj"
Jul 06 17:40:09.998137 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:09.998103    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj"
Jul 06 17:40:10.030402 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.030367    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/235b3c7e-5ad8-4006-9424-31d2f85b9b72-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9knh\" (UID: \"235b3c7e-5ad8-4006-9424-31d2f85b9b72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh"
Jul 06 17:40:10.030553 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.030421    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/235b3c7e-5ad8-4006-9424-31d2f85b9b72-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9knh\" (UID: \"235b3c7e-5ad8-4006-9424-31d2f85b9b72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh"
Jul 06 17:40:10.030622 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.030559    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q44c\" (UniqueName: \"kubernetes.io/projected/235b3c7e-5ad8-4006-9424-31d2f85b9b72-kube-api-access-7q44c\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9knh\" (UID: \"235b3c7e-5ad8-4006-9424-31d2f85b9b72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh"
Jul 06 17:40:10.031004 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.030969    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/235b3c7e-5ad8-4006-9424-31d2f85b9b72-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9knh\" (UID: \"235b3c7e-5ad8-4006-9424-31d2f85b9b72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh"
Jul 06 17:40:10.032905 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.032884    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/235b3c7e-5ad8-4006-9424-31d2f85b9b72-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9knh\" (UID: \"235b3c7e-5ad8-4006-9424-31d2f85b9b72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh"
Jul 06 17:40:10.039303 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.039282    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q44c\" (UniqueName: \"kubernetes.io/projected/235b3c7e-5ad8-4006-9424-31d2f85b9b72-kube-api-access-7q44c\") pod \"kube-storage-version-migrator-operator-846bf668f7-n9knh\" (UID: \"235b3c7e-5ad8-4006-9424-31d2f85b9b72\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh"
Jul 06 17:40:10.111448 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.111405    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh"
Jul 06 17:40:10.321268 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.321187    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh"]
Jul 06 17:40:10.324176 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:40:10.324153    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod235b3c7e_5ad8_4006_9424_31d2f85b9b72.slice/crio-d998a6e0ddb3330c79e3622e7d43a265b6490150d915f866621443d787468be3 WatchSource:0}: Error finding container d998a6e0ddb3330c79e3622e7d43a265b6490150d915f866621443d787468be3: Status 404 returned error can't find the container with id d998a6e0ddb3330c79e3622e7d43a265b6490150d915f866621443d787468be3
Jul 06 17:40:10.335888 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.335861    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj"]
Jul 06 17:40:10.340242 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:40:10.340186    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25433e62_4542_4b17_bd00_2b522d351fd1.slice/crio-26a381575fac90452f5f2bb5cadb2403650f2c7483add07431f27d9db5574976 WatchSource:0}: Error finding container 26a381575fac90452f5f2bb5cadb2403650f2c7483add07431f27d9db5574976: Status 404 returned error can't find the container with id 26a381575fac90452f5f2bb5cadb2403650f2c7483add07431f27d9db5574976
Jul 06 17:40:10.435869 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.435838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nngdq\" (UID: \"a0e96fec-da0d-496f-a7ff-d55e0ba0103f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"
Jul 06 17:40:10.436014 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:10.435993    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 17:40:10.436071 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:10.436062    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls podName:a0e96fec-da0d-496f-a7ff-d55e0ba0103f nodeName:}" failed. No retries permitted until 2026-07-06 17:40:14.436045996 +0000 UTC m=+101.014246809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nngdq" (UID: "a0e96fec-da0d-496f-a7ff-d55e0ba0103f") : secret "samples-operator-tls" not found
Jul 06 17:40:10.461542 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.461483    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/0.log"
Jul 06 17:40:10.461542 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.461519    2570 generic.go:356] "Generic (PLEG): container finished" podID="01de017a-3d89-4c44-9ed4-c7ea05a9a84e" containerID="9690d1b360286fd136e508125c09b12856a920241a1119591ba3d5ddb74fe97e" exitCode=255
Jul 06 17:40:10.461715 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.461553    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m" event={"ID":"01de017a-3d89-4c44-9ed4-c7ea05a9a84e","Type":"ContainerDied","Data":"9690d1b360286fd136e508125c09b12856a920241a1119591ba3d5ddb74fe97e"}
Jul 06 17:40:10.461863 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.461844    2570 scope.go:117] "RemoveContainer" containerID="9690d1b360286fd136e508125c09b12856a920241a1119591ba3d5ddb74fe97e"
Jul 06 17:40:10.462752 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.462721    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh" event={"ID":"235b3c7e-5ad8-4006-9424-31d2f85b9b72","Type":"ContainerStarted","Data":"d998a6e0ddb3330c79e3622e7d43a265b6490150d915f866621443d787468be3"}
Jul 06 17:40:10.463968 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:10.463942    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj" event={"ID":"25433e62-4542-4b17-bd00-2b522d351fd1","Type":"ContainerStarted","Data":"26a381575fac90452f5f2bb5cadb2403650f2c7483add07431f27d9db5574976"}
Jul 06 17:40:11.470559 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:11.470525    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/1.log"
Jul 06 17:40:11.471045 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:11.471028    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/0.log"
Jul 06 17:40:11.471106 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:11.471069    2570 generic.go:356] "Generic (PLEG): container finished" podID="01de017a-3d89-4c44-9ed4-c7ea05a9a84e" containerID="bf6b8e785104968545fcc6e91dc2dcad8c14fc0f1171f78a0ac07719dd5e62d3" exitCode=255
Jul 06 17:40:11.471150 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:11.471108    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m" event={"ID":"01de017a-3d89-4c44-9ed4-c7ea05a9a84e","Type":"ContainerDied","Data":"bf6b8e785104968545fcc6e91dc2dcad8c14fc0f1171f78a0ac07719dd5e62d3"}
Jul 06 17:40:11.471229 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:11.471217    2570 scope.go:117] "RemoveContainer" containerID="9690d1b360286fd136e508125c09b12856a920241a1119591ba3d5ddb74fe97e"
Jul 06 17:40:11.471447 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:11.471424    2570 scope.go:117] "RemoveContainer" containerID="bf6b8e785104968545fcc6e91dc2dcad8c14fc0f1171f78a0ac07719dd5e62d3"
Jul 06 17:40:11.471645 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:11.471620    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-b7j6m_openshift-console-operator(01de017a-3d89-4c44-9ed4-c7ea05a9a84e)\"" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m" podUID="01de017a-3d89-4c44-9ed4-c7ea05a9a84e"
Jul 06 17:40:12.475577 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:12.475544    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/1.log"
Jul 06 17:40:12.476053 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:12.475930    2570 scope.go:117] "RemoveContainer" containerID="bf6b8e785104968545fcc6e91dc2dcad8c14fc0f1171f78a0ac07719dd5e62d3"
Jul 06 17:40:12.476116 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:12.476085    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-b7j6m_openshift-console-operator(01de017a-3d89-4c44-9ed4-c7ea05a9a84e)\"" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m" podUID="01de017a-3d89-4c44-9ed4-c7ea05a9a84e"
Jul 06 17:40:12.554106 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:12.554061    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:12.554263 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:12.554192    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:12.554263 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:12.554248    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 17:40:12.554389 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:12.554327    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls podName:d6a988e7-d4c4-4517-9f16-2d597b9a67ed nodeName:}" failed. No retries permitted until 2026-07-06 17:40:20.554304224 +0000 UTC m=+107.132505039 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f899r" (UID: "d6a988e7-d4c4-4517-9f16-2d597b9a67ed") : secret "insights-runtime-extractor-tls" not found
Jul 06 17:40:12.554389 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:12.554345    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 17:40:12.554504 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:12.554399    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm podName:d6a988e7-d4c4-4517-9f16-2d597b9a67ed nodeName:}" failed. No retries permitted until 2026-07-06 17:40:20.554383234 +0000 UTC m=+107.132584050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f899r" (UID: "d6a988e7-d4c4-4517-9f16-2d597b9a67ed") : configmap "kube-rbac-proxy" not found
Jul 06 17:40:13.480831 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:13.480792    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh" event={"ID":"235b3c7e-5ad8-4006-9424-31d2f85b9b72","Type":"ContainerStarted","Data":"194e075a6d43e32a37d96cd37e42d196e3990d5a6294d97a2da6367aae7afe74"}
Jul 06 17:40:13.482575 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:13.482548    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj" event={"ID":"25433e62-4542-4b17-bd00-2b522d351fd1","Type":"ContainerStarted","Data":"5d4bde314cfbe0900f6fb1a5f595eb35596fe390056dca2170c976c8fa2d45c5"}
Jul 06 17:40:13.499110 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:13.499062    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh" podStartSLOduration=1.50108013 podStartE2EDuration="4.499047952s" totalImagesPullingTime="2.997967822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:13.498086762 +0000 UTC m=+100.076287598" watchObservedRunningTime="2026-07-06 17:40:13.499047952 +0000 UTC m=+100.077248787"
Jul 06 17:40:13.518188 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:13.518130    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj" podStartSLOduration=1.533934032 podStartE2EDuration="4.518108154s" totalImagesPullingTime="2.984174122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:13.516993899 +0000 UTC m=+100.095194728" watchObservedRunningTime="2026-07-06 17:40:13.518108154 +0000 UTC m=+100.096308991"
Jul 06 17:40:14.471370 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:14.471333    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nngdq\" (UID: \"a0e96fec-da0d-496f-a7ff-d55e0ba0103f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"
Jul 06 17:40:14.471563 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:14.471483    2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 17:40:14.471563 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:14.471552    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls podName:a0e96fec-da0d-496f-a7ff-d55e0ba0103f nodeName:}" failed. No retries permitted until 2026-07-06 17:40:22.471535818 +0000 UTC m=+109.049736633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-nngdq" (UID: "a0e96fec-da0d-496f-a7ff-d55e0ba0103f") : secret "samples-operator-tls" not found
Jul 06 17:40:14.774380 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:14.774283    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:40:14.774867 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:14.774455    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 17:40:14.774867 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:14.774526    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls podName:3030c401-885a-4d9b-b58f-159282dee0ea nodeName:}" failed. No retries permitted until 2026-07-06 17:41:18.774512779 +0000 UTC m=+165.352713596 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls") pod "dns-default-5wj5t" (UID: "3030c401-885a-4d9b-b58f-159282dee0ea") : secret "dns-default-metrics-tls" not found
Jul 06 17:40:15.398288 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:15.398261    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ctmnm"
Jul 06 17:40:18.041526 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:18.041487    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:18.041940 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:18.041546    2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:18.041940 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:18.041891    2570 scope.go:117] "RemoveContainer" containerID="bf6b8e785104968545fcc6e91dc2dcad8c14fc0f1171f78a0ac07719dd5e62d3"
Jul 06 17:40:18.042053 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:18.042035    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-b7j6m_openshift-console-operator(01de017a-3d89-4c44-9ed4-c7ea05a9a84e)\"" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m" podUID="01de017a-3d89-4c44-9ed4-c7ea05a9a84e"
Jul 06 17:40:20.618977 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:20.618941    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:20.619367 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:20.619018    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:20.619367 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:20.619120    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 17:40:20.619367 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:20.619176    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls podName:d6a988e7-d4c4-4517-9f16-2d597b9a67ed nodeName:}" failed. No retries permitted until 2026-07-06 17:40:36.619162724 +0000 UTC m=+123.197363538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f899r" (UID: "d6a988e7-d4c4-4517-9f16-2d597b9a67ed") : secret "insights-runtime-extractor-tls" not found
Jul 06 17:40:20.619482 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:20.619454    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:22.534378 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:22.534334    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nngdq\" (UID: \"a0e96fec-da0d-496f-a7ff-d55e0ba0103f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"
Jul 06 17:40:22.536591 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:22.536572    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0e96fec-da0d-496f-a7ff-d55e0ba0103f-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-nngdq\" (UID: \"a0e96fec-da0d-496f-a7ff-d55e0ba0103f\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"
Jul 06 17:40:22.601286 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:22.601247    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"
Jul 06 17:40:22.721100 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:22.721066    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq"]
Jul 06 17:40:23.514169 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:23.514132    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq" event={"ID":"a0e96fec-da0d-496f-a7ff-d55e0ba0103f","Type":"ContainerStarted","Data":"54db1c96577359931e337f210b525640654235755c1099526a5ec9f27c4b8d4e"}
Jul 06 17:40:25.521619 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:25.521582    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq" event={"ID":"a0e96fec-da0d-496f-a7ff-d55e0ba0103f","Type":"ContainerStarted","Data":"b14b60dc62077ef557173f1e9dfa8bd4fcd1c861422bb92e14706222ba18e60b"}
Jul 06 17:40:25.522038 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:25.521637    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq" event={"ID":"a0e96fec-da0d-496f-a7ff-d55e0ba0103f","Type":"ContainerStarted","Data":"678713056ea941e843f9cec57c70958662fa4e6212892ccbd87ba9c85fd90ebc"}
Jul 06 17:40:25.537688 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:25.537638    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-nngdq" podStartSLOduration=17.372637761 podStartE2EDuration="19.537625217s" totalImagesPullingTime="2.164987456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:25.536270296 +0000 UTC m=+112.114471133" watchObservedRunningTime="2026-07-06 17:40:25.537625217 +0000 UTC m=+112.115826121"
Jul 06 17:40:28.969034 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:28.969003    2570 scope.go:117] "RemoveContainer" containerID="bf6b8e785104968545fcc6e91dc2dcad8c14fc0f1171f78a0ac07719dd5e62d3"
Jul 06 17:40:29.534361 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:29.534330    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 17:40:29.534729 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:29.534711    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/1.log"
Jul 06 17:40:29.534845 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:29.534749    2570 generic.go:356] "Generic (PLEG): container finished" podID="01de017a-3d89-4c44-9ed4-c7ea05a9a84e" containerID="8df51170e8e93962e732ed40aab4c2acb55532ff8f4682e6a905a33f0cb37e1a" exitCode=255
Jul 06 17:40:29.534845 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:29.534794    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m" event={"ID":"01de017a-3d89-4c44-9ed4-c7ea05a9a84e","Type":"ContainerDied","Data":"8df51170e8e93962e732ed40aab4c2acb55532ff8f4682e6a905a33f0cb37e1a"}
Jul 06 17:40:29.534955 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:29.534849    2570 scope.go:117] "RemoveContainer" containerID="bf6b8e785104968545fcc6e91dc2dcad8c14fc0f1171f78a0ac07719dd5e62d3"
Jul 06 17:40:29.535143 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:29.535122    2570 scope.go:117] "RemoveContainer" containerID="8df51170e8e93962e732ed40aab4c2acb55532ff8f4682e6a905a33f0cb37e1a"
Jul 06 17:40:29.535363 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:29.535338    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-b7j6m_openshift-console-operator(01de017a-3d89-4c44-9ed4-c7ea05a9a84e)\"" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m" podUID="01de017a-3d89-4c44-9ed4-c7ea05a9a84e"
Jul 06 17:40:30.539092 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:30.539063    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 17:40:36.634811 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.634783    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-4hwlm"]
Jul 06 17:40:36.638519 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.638503    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-4hwlm"
Jul 06 17:40:36.642039 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.642023    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-f424l\""
Jul 06 17:40:36.643591 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.643567    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 17:40:36.643591 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.643583    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 17:40:36.643908 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.643891    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fbd867d4-g6fld"]
Jul 06 17:40:36.644712 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.644669    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:36.646483 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.646462    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"]
Jul 06 17:40:36.646604 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.646576    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fbd867d4-g6fld"
Jul 06 17:40:36.647171 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.647150    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6a988e7-d4c4-4517-9f16-2d597b9a67ed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f899r\" (UID: \"d6a988e7-d4c4-4517-9f16-2d597b9a67ed\") " pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:36.649247 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.649221    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7b567\""
Jul 06 17:40:36.649388 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.649372    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 17:40:36.649432 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.649372    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 17:40:36.649482 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.649462    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.649625 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.649609    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 17:40:36.649719 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.649647    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 17:40:36.652678 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.652346    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 17:40:36.652678 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.652378    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 17:40:36.652678 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.652481    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 17:40:36.652678 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.652586    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 17:40:36.653153 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.653136    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-4hwlm"]
Jul 06 17:40:36.658132 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.658091    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fbd867d4-g6fld"]
Jul 06 17:40:36.659402 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.659382    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"]
Jul 06 17:40:36.745256 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.745224    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/acbb464c-22e3-4ceb-818d-3667917f1b3a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.745256 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.745261    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/acbb464c-22e3-4ceb-818d-3667917f1b3a-ca\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.745455 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.745294    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9twnj\" (UniqueName: \"kubernetes.io/projected/acbb464c-22e3-4ceb-818d-3667917f1b3a-kube-api-access-9twnj\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.745455 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.745319    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4c6abc92-6390-431d-a869-a937ed5365e9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-4hwlm\" (UID: \"4c6abc92-6390-431d-a869-a937ed5365e9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-4hwlm"
Jul 06 17:40:36.745455 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.745337    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c6abc92-6390-431d-a869-a937ed5365e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-4hwlm\" (UID: \"4c6abc92-6390-431d-a869-a937ed5365e9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-4hwlm"
Jul 06 17:40:36.745455 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.745373    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/acbb464c-22e3-4ceb-818d-3667917f1b3a-hub\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.745455 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.745437    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b29bee9f-8b6d-4b5c-866e-00a755cecac8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59fbd867d4-g6fld\" (UID: \"b29bee9f-8b6d-4b5c-866e-00a755cecac8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fbd867d4-g6fld"
Jul 06 17:40:36.745629 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.745491    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/acbb464c-22e3-4ceb-818d-3667917f1b3a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.745629 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.745531    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/acbb464c-22e3-4ceb-818d-3667917f1b3a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.745629 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.745579    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whsvh\" (UniqueName: \"kubernetes.io/projected/b29bee9f-8b6d-4b5c-866e-00a755cecac8-kube-api-access-whsvh\") pod \"managed-serviceaccount-addon-agent-59fbd867d4-g6fld\" (UID: \"b29bee9f-8b6d-4b5c-866e-00a755cecac8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fbd867d4-g6fld"
Jul 06 17:40:36.846895 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.846864    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/acbb464c-22e3-4ceb-818d-3667917f1b3a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.846895 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.846896    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/acbb464c-22e3-4ceb-818d-3667917f1b3a-ca\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.847094 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.846922    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9twnj\" (UniqueName: \"kubernetes.io/projected/acbb464c-22e3-4ceb-818d-3667917f1b3a-kube-api-access-9twnj\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.847094 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.846951    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4c6abc92-6390-431d-a869-a937ed5365e9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-4hwlm\" (UID: \"4c6abc92-6390-431d-a869-a937ed5365e9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-4hwlm"
Jul 06 17:40:36.847094 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.846976    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c6abc92-6390-431d-a869-a937ed5365e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-4hwlm\" (UID: \"4c6abc92-6390-431d-a869-a937ed5365e9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-4hwlm"
Jul 06 17:40:36.847094 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.847023    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/acbb464c-22e3-4ceb-818d-3667917f1b3a-hub\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.847094 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.847049    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b29bee9f-8b6d-4b5c-866e-00a755cecac8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59fbd867d4-g6fld\" (UID: \"b29bee9f-8b6d-4b5c-866e-00a755cecac8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fbd867d4-g6fld"
Jul 06 17:40:36.847094 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.847079    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/acbb464c-22e3-4ceb-818d-3667917f1b3a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.847398 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.847105    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/acbb464c-22e3-4ceb-818d-3667917f1b3a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.847398 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.847141    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whsvh\" (UniqueName: \"kubernetes.io/projected/b29bee9f-8b6d-4b5c-866e-00a755cecac8-kube-api-access-whsvh\") pod \"managed-serviceaccount-addon-agent-59fbd867d4-g6fld\" (UID: \"b29bee9f-8b6d-4b5c-866e-00a755cecac8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fbd867d4-g6fld"
Jul 06 17:40:36.847938 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.847878    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4c6abc92-6390-431d-a869-a937ed5365e9-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-4hwlm\" (UID: \"4c6abc92-6390-431d-a869-a937ed5365e9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-4hwlm"
Jul 06 17:40:36.847938 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.847908    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/acbb464c-22e3-4ceb-818d-3667917f1b3a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.849874 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.849845    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c6abc92-6390-431d-a869-a937ed5365e9-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-4hwlm\" (UID: \"4c6abc92-6390-431d-a869-a937ed5365e9\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-4hwlm"
Jul 06 17:40:36.849874 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.849860    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/acbb464c-22e3-4ceb-818d-3667917f1b3a-hub\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.850062 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.849962    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/acbb464c-22e3-4ceb-818d-3667917f1b3a-ca\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.850123 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.850072    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/acbb464c-22e3-4ceb-818d-3667917f1b3a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.850220 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.850202    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/acbb464c-22e3-4ceb-818d-3667917f1b3a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.850925 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.850906    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b29bee9f-8b6d-4b5c-866e-00a755cecac8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59fbd867d4-g6fld\" (UID: \"b29bee9f-8b6d-4b5c-866e-00a755cecac8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fbd867d4-g6fld"
Jul 06 17:40:36.858590 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.858564    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whsvh\" (UniqueName: \"kubernetes.io/projected/b29bee9f-8b6d-4b5c-866e-00a755cecac8-kube-api-access-whsvh\") pod \"managed-serviceaccount-addon-agent-59fbd867d4-g6fld\" (UID: \"b29bee9f-8b6d-4b5c-866e-00a755cecac8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fbd867d4-g6fld"
Jul 06 17:40:36.858706 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.858658    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9twnj\" (UniqueName: \"kubernetes.io/projected/acbb464c-22e3-4ceb-818d-3667917f1b3a-kube-api-access-9twnj\") pod \"cluster-proxy-proxy-agent-54d677ff7d-rgss8\" (UID: \"acbb464c-22e3-4ceb-818d-3667917f1b3a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:36.920272 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.920204    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-chbhn\""
Jul 06 17:40:36.928414 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.928391    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f899r"
Jul 06 17:40:36.948222 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.948203    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-4hwlm"
Jul 06 17:40:36.970359 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.970302    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fbd867d4-g6fld"
Jul 06 17:40:36.975333 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:36.975150    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"
Jul 06 17:40:37.113832 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:37.113810    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f899r"]
Jul 06 17:40:37.119917 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:40:37.119884    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a988e7_d4c4_4517_9f16_2d597b9a67ed.slice/crio-e78a94b4f70c10e00e7dc631560d3847258d72f77ef75e43bb4a636a9903f68b WatchSource:0}: Error finding container e78a94b4f70c10e00e7dc631560d3847258d72f77ef75e43bb4a636a9903f68b: Status 404 returned error can't find the container with id e78a94b4f70c10e00e7dc631560d3847258d72f77ef75e43bb4a636a9903f68b
Jul 06 17:40:37.128170 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:37.128123    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-4hwlm"]
Jul 06 17:40:37.132145 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:40:37.132056    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c6abc92_6390_431d_a869_a937ed5365e9.slice/crio-ca3c55b7a173b61dad5708a339694deee243b7de1ea1fe4910c956366f31e795 WatchSource:0}: Error finding container ca3c55b7a173b61dad5708a339694deee243b7de1ea1fe4910c956366f31e795: Status 404 returned error can't find the container with id ca3c55b7a173b61dad5708a339694deee243b7de1ea1fe4910c956366f31e795
Jul 06 17:40:37.148373 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:37.148348    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fbd867d4-g6fld"]
Jul 06 17:40:37.151828 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:40:37.151799    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb29bee9f_8b6d_4b5c_866e_00a755cecac8.slice/crio-bb92a535ffaed665c1e1386a91431df84ec8f1901b74d217e4e4394c34deb58b WatchSource:0}: Error finding container bb92a535ffaed665c1e1386a91431df84ec8f1901b74d217e4e4394c34deb58b: Status 404 returned error can't find the container with id bb92a535ffaed665c1e1386a91431df84ec8f1901b74d217e4e4394c34deb58b
Jul 06 17:40:37.178906 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:37.178882    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8"]
Jul 06 17:40:37.561420 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:37.561385    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fbd867d4-g6fld" event={"ID":"b29bee9f-8b6d-4b5c-866e-00a755cecac8","Type":"ContainerStarted","Data":"bb92a535ffaed665c1e1386a91431df84ec8f1901b74d217e4e4394c34deb58b"}
Jul 06 17:40:37.562487 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:37.562459    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-4hwlm" event={"ID":"4c6abc92-6390-431d-a869-a937ed5365e9","Type":"ContainerStarted","Data":"ca3c55b7a173b61dad5708a339694deee243b7de1ea1fe4910c956366f31e795"}
Jul 06 17:40:37.563436 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:37.563414    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f899r" event={"ID":"d6a988e7-d4c4-4517-9f16-2d597b9a67ed","Type":"ContainerStarted","Data":"e78a94b4f70c10e00e7dc631560d3847258d72f77ef75e43bb4a636a9903f68b"}
Jul 06 17:40:37.564282 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:37.564263    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8" event={"ID":"acbb464c-22e3-4ceb-818d-3667917f1b3a","Type":"ContainerStarted","Data":"c6b9eefe5e712c5649ed6e7a2b896bb0a71ea9dda55bc57bb4e3111507dc8aa5"}
Jul 06 17:40:38.040918 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:38.040882    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:38.041391 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:38.041361    2570 scope.go:117] "RemoveContainer" containerID="8df51170e8e93962e732ed40aab4c2acb55532ff8f4682e6a905a33f0cb37e1a"
Jul 06 17:40:38.041596 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:38.041564    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-b7j6m_openshift-console-operator(01de017a-3d89-4c44-9ed4-c7ea05a9a84e)\"" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m" podUID="01de017a-3d89-4c44-9ed4-c7ea05a9a84e"
Jul 06 17:40:38.041982 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:38.041920    2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:38.569719 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:38.569504    2570 scope.go:117] "RemoveContainer" containerID="8df51170e8e93962e732ed40aab4c2acb55532ff8f4682e6a905a33f0cb37e1a"
Jul 06 17:40:38.570000 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:40:38.569948    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-b7j6m_openshift-console-operator(01de017a-3d89-4c44-9ed4-c7ea05a9a84e)\"" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m" podUID="01de017a-3d89-4c44-9ed4-c7ea05a9a84e"
Jul 06 17:40:39.574373 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:39.574335    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-4hwlm" event={"ID":"4c6abc92-6390-431d-a869-a937ed5365e9","Type":"ContainerStarted","Data":"87debe4abd3a27de29d94fba2dee8b279a728c63fac0ac7ec8bc269e041592fc"}
Jul 06 17:40:39.591576 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:39.591518    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-4hwlm" podStartSLOduration=1.85838377 podStartE2EDuration="3.591495621s" totalImagesPullingTime="1.733111851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:39.590207646 +0000 UTC m=+126.168408511" watchObservedRunningTime="2026-07-06 17:40:39.591495621 +0000 UTC m=+126.169696460"
Jul 06 17:40:42.703245 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:42.703203    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs\") pod \"network-metrics-daemon-4kzvg\" (UID: \"c33ba8f0-913e-48a7-a455-54c14e022b74\") " pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:40:42.705960 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:42.705934    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c33ba8f0-913e-48a7-a455-54c14e022b74-metrics-certs\") pod \"network-metrics-daemon-4kzvg\" (UID: \"c33ba8f0-913e-48a7-a455-54c14e022b74\") " pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:40:42.881304 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:42.881273    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wwzt2\""
Jul 06 17:40:42.889684 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:42.889659    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4kzvg"
Jul 06 17:40:43.976502 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:43.976412    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4kzvg"]
Jul 06 17:40:44.596003 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:44.595947    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fbd867d4-g6fld" event={"ID":"b29bee9f-8b6d-4b5c-866e-00a755cecac8","Type":"ContainerStarted","Data":"17d874b9da550690a08dfb67caf59150114be2a46d70db0f187dfbfa0978a8e0"}
Jul 06 17:40:44.597779 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:44.597710    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f899r" event={"ID":"d6a988e7-d4c4-4517-9f16-2d597b9a67ed","Type":"ContainerStarted","Data":"007c3a846a54d1409f2474e8d8917454dc722e44be36ffc9243e2e7cc4671722"}
Jul 06 17:40:44.600167 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:44.600136    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8" event={"ID":"acbb464c-22e3-4ceb-818d-3667917f1b3a","Type":"ContainerStarted","Data":"9d3bbd1f1dce84a2372d535f7ef18b96d3331c5140522073c4ae13aec095667c"}
Jul 06 17:40:44.600293 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:44.600172    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8" event={"ID":"acbb464c-22e3-4ceb-818d-3667917f1b3a","Type":"ContainerStarted","Data":"ce36e8236e34ff6b499cc21fa0fea4bd692e2a71f14353bdc840ea0c8b688a65"}
Jul 06 17:40:44.600293 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:44.600190    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8" event={"ID":"acbb464c-22e3-4ceb-818d-3667917f1b3a","Type":"ContainerStarted","Data":"ca5f3b967336123d8debf87ae924728074b0a79399ef6d15449c794ca2995d44"}
Jul 06 17:40:44.602021 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:44.601982    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4kzvg" event={"ID":"c33ba8f0-913e-48a7-a455-54c14e022b74","Type":"ContainerStarted","Data":"70ae76f832608521961819a9313c90b708e4dd10cd337c0d44095ca704543fd6"}
Jul 06 17:40:44.612240 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:44.612191    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59fbd867d4-g6fld" podStartSLOduration=1.928977605 podStartE2EDuration="8.612170797s" totalImagesPullingTime="6.683193192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:44.610945025 +0000 UTC m=+131.189145860" watchObservedRunningTime="2026-07-06 17:40:44.612170797 +0000 UTC m=+131.190371634"
Jul 06 17:40:44.646077 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:44.646022    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54d677ff7d-rgss8" podStartSLOduration=1.994502079 podStartE2EDuration="8.646005075s" totalImagesPullingTime="6.651502996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:44.644524453 +0000 UTC m=+131.222725314" watchObservedRunningTime="2026-07-06 17:40:44.646005075 +0000 UTC m=+131.224205914"
Jul 06 17:40:45.607509 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:45.607463    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f899r" event={"ID":"d6a988e7-d4c4-4517-9f16-2d597b9a67ed","Type":"ContainerStarted","Data":"22925b9f2990593402c05a24d5b7f84a5a8e5a532b6a72d75305201acc20b364"}
Jul 06 17:40:45.609466 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:45.609374    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4kzvg" event={"ID":"c33ba8f0-913e-48a7-a455-54c14e022b74","Type":"ContainerStarted","Data":"e5c70d280f5ba068d092ff9a1d6d7bece9ace453b2ea8925c175146026fa27b9"}
Jul 06 17:40:45.609466 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:45.609422    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4kzvg" event={"ID":"c33ba8f0-913e-48a7-a455-54c14e022b74","Type":"ContainerStarted","Data":"c93b22692ae52dca1f9e5e5db993c053266a54f403e2791db5fce3600c3411bd"}
Jul 06 17:40:45.628894 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:45.628835    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4kzvg" podStartSLOduration=130.54120589 podStartE2EDuration="2m11.628819528s" totalImagesPullingTime="1.087613638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:45.627895621 +0000 UTC m=+132.206096470" watchObservedRunningTime="2026-07-06 17:40:45.628819528 +0000 UTC m=+132.207020365"
Jul 06 17:40:47.111314 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.111278    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n955n"]
Jul 06 17:40:47.232624 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.232591    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.235657 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.235625    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8fxcc\""
Jul 06 17:40:47.235797 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.235707    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 17:40:47.235797 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.235712    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 17:40:47.235797 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.235762    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 17:40:47.236929 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.236909    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 17:40:47.237041 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.236971    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 17:40:47.237041 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.236988    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 17:40:47.338538 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.338499    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-node-exporter-tls\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.338720 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.338574    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.338720 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.338603    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-sys\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.338720 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.338620    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-root\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.338720 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.338634    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr9kk\" (UniqueName: \"kubernetes.io/projected/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-kube-api-access-sr9kk\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.338720 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.338668    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-node-exporter-textfile\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.338994 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.338744    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-node-exporter-accelerators-collector-config\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.338994 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.338793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-node-exporter-wtmp\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.338994 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.338818    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-metrics-client-ca\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.439581 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.439547    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-node-exporter-tls\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.439686 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.439611    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.439686 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.439650    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-sys\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.439686 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.439676    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-root\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.439861 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.439745    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-root\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.439861 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.439759    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-sys\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.439861 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.439819    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr9kk\" (UniqueName: \"kubernetes.io/projected/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-kube-api-access-sr9kk\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.440012 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.439888    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-node-exporter-textfile\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.440012 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.439916    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-node-exporter-accelerators-collector-config\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.440012 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.439953    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-node-exporter-wtmp\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.440012 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.439977    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-metrics-client-ca\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.440246 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.440225    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-node-exporter-textfile\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.440320 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.440302    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-node-exporter-wtmp\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.440602 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.440581    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-metrics-client-ca\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.440675 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.440653    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-node-exporter-accelerators-collector-config\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.441967 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.441947    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-node-exporter-tls\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.442156 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.442139    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.448084 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.448063    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr9kk\" (UniqueName: \"kubernetes.io/projected/50ff71d8-0a3b-4a12-8b65-c82cc7f263df-kube-api-access-sr9kk\") pod \"node-exporter-n955n\" (UID: \"50ff71d8-0a3b-4a12-8b65-c82cc7f263df\") " pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.541057 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.541033    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n955n"
Jul 06 17:40:47.549853 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:40:47.549829    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ff71d8_0a3b_4a12_8b65_c82cc7f263df.slice/crio-0b0ef38c916b54e216daa9d7557592c78f891a2589ecf8d6d0db0ecd80665a86 WatchSource:0}: Error finding container 0b0ef38c916b54e216daa9d7557592c78f891a2589ecf8d6d0db0ecd80665a86: Status 404 returned error can't find the container with id 0b0ef38c916b54e216daa9d7557592c78f891a2589ecf8d6d0db0ecd80665a86
Jul 06 17:40:47.618301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.618267    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f899r" event={"ID":"d6a988e7-d4c4-4517-9f16-2d597b9a67ed","Type":"ContainerStarted","Data":"58f0c646581059b19807c900fe598f51bfc4ae68e9b3b8016cbd938b16c03d75"}
Jul 06 17:40:47.619330 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.619309    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n955n" event={"ID":"50ff71d8-0a3b-4a12-8b65-c82cc7f263df","Type":"ContainerStarted","Data":"0b0ef38c916b54e216daa9d7557592c78f891a2589ecf8d6d0db0ecd80665a86"}
Jul 06 17:40:47.639342 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:47.639261    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f899r" podStartSLOduration=33.50478801 podStartE2EDuration="43.639247207s" totalImagesPullingTime="10.134459197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:40:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:47.637806215 +0000 UTC m=+134.216007051" watchObservedRunningTime="2026-07-06 17:40:47.639247207 +0000 UTC m=+134.217448042"
Jul 06 17:40:48.625782 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:48.625739    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n955n" event={"ID":"50ff71d8-0a3b-4a12-8b65-c82cc7f263df","Type":"ContainerStarted","Data":"0ccfb5ef2f9564b8c6a5dcd57f63e5dbe70fe18c38309adb0ae6f0c9fefff964"}
Jul 06 17:40:49.630026 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:49.629990    2570 generic.go:356] "Generic (PLEG): container finished" podID="50ff71d8-0a3b-4a12-8b65-c82cc7f263df" containerID="0ccfb5ef2f9564b8c6a5dcd57f63e5dbe70fe18c38309adb0ae6f0c9fefff964" exitCode=0
Jul 06 17:40:49.630026 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:49.630028    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n955n" event={"ID":"50ff71d8-0a3b-4a12-8b65-c82cc7f263df","Type":"ContainerDied","Data":"0ccfb5ef2f9564b8c6a5dcd57f63e5dbe70fe18c38309adb0ae6f0c9fefff964"}
Jul 06 17:40:50.635122 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:50.635086    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n955n" event={"ID":"50ff71d8-0a3b-4a12-8b65-c82cc7f263df","Type":"ContainerStarted","Data":"f771195c48c72778ec298487ff9f014cd7a1d286772cbfb5c2e148cec14165be"}
Jul 06 17:40:50.635479 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:50.635141    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n955n" event={"ID":"50ff71d8-0a3b-4a12-8b65-c82cc7f263df","Type":"ContainerStarted","Data":"00cd9608d930d154ebc08d209dcca005f1787ffedaa0bb5a830b383c3de199fc"}
Jul 06 17:40:50.655504 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:50.655459    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n955n" podStartSLOduration=2.619079476 podStartE2EDuration="3.655445479s" totalImagesPullingTime="972.605379ms" totalInitContainerRuntime="63.760624ms" isStatefulPod=true podCreationTimestamp="2026-07-06 17:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:50.655059259 +0000 UTC m=+137.233260095" watchObservedRunningTime="2026-07-06 17:40:50.655445479 +0000 UTC m=+137.233646314"
Jul 06 17:40:50.969080 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:50.969058    2570 scope.go:117] "RemoveContainer" containerID="8df51170e8e93962e732ed40aab4c2acb55532ff8f4682e6a905a33f0cb37e1a"
Jul 06 17:40:51.641345 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:51.641320    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 17:40:51.641683 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:51.641441    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m" event={"ID":"01de017a-3d89-4c44-9ed4-c7ea05a9a84e","Type":"ContainerStarted","Data":"5bedd44c68d29fd90418d2c0b258a71ac0658fe2ed37e1163066c2253f1e9bf2"}
Jul 06 17:40:51.641986 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:51.641958    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:51.646640 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:51.646618    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m"
Jul 06 17:40:51.664704 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:40:51.664642    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-b7j6m" podStartSLOduration=42.579495964 podStartE2EDuration="44.66462787s" totalImagesPullingTime="2.085131906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:51.662946926 +0000 UTC m=+138.241147763" watchObservedRunningTime="2026-07-06 17:40:51.66462787 +0000 UTC m=+138.242828711"
Jul 06 17:41:13.851924 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:41:13.851876    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5wj5t" podUID="3030c401-885a-4d9b-b58f-159282dee0ea"
Jul 06 17:41:14.715567 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:14.715535    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:41:18.780310 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:18.780272    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:41:18.782643 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:18.782609    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3030c401-885a-4d9b-b58f-159282dee0ea-metrics-tls\") pod \"dns-default-5wj5t\" (UID: \"3030c401-885a-4d9b-b58f-159282dee0ea\") " pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:41:18.918473 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:18.918442    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-75j6z\""
Jul 06 17:41:18.926678 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:18.926648    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:41:19.252842 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:19.252819    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5wj5t"]
Jul 06 17:41:19.255348 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:41:19.255322    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3030c401_885a_4d9b_b58f_159282dee0ea.slice/crio-0900b960a52ccd3531046297c2fe60c185c0bf0902764fafdb38280cc9fb6c03 WatchSource:0}: Error finding container 0900b960a52ccd3531046297c2fe60c185c0bf0902764fafdb38280cc9fb6c03: Status 404 returned error can't find the container with id 0900b960a52ccd3531046297c2fe60c185c0bf0902764fafdb38280cc9fb6c03
Jul 06 17:41:19.737466 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:19.737409    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5wj5t" event={"ID":"3030c401-885a-4d9b-b58f-159282dee0ea","Type":"ContainerStarted","Data":"0900b960a52ccd3531046297c2fe60c185c0bf0902764fafdb38280cc9fb6c03"}
Jul 06 17:41:21.746284 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:21.746245    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5wj5t" event={"ID":"3030c401-885a-4d9b-b58f-159282dee0ea","Type":"ContainerStarted","Data":"ccb0e0cc3be374d4ec0b12709771e8851af438aee0b82a7445dfa41441eeca52"}
Jul 06 17:41:21.746731 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:21.746302    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5wj5t" event={"ID":"3030c401-885a-4d9b-b58f-159282dee0ea","Type":"ContainerStarted","Data":"0e25466ef6fe2d8d1a426030cb34ea1025a8a32a04596d94a96d4bcd315afff7"}
Jul 06 17:41:21.746731 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:21.746398    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:41:21.767461 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:21.767406    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5wj5t" podStartSLOduration=129.976954297 podStartE2EDuration="2m11.767389879s" totalImagesPullingTime="1.790435582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:41:21.765307503 +0000 UTC m=+168.343508343" watchObservedRunningTime="2026-07-06 17:41:21.767389879 +0000 UTC m=+168.345590715"
Jul 06 17:41:29.774929 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:29.774896    2570 generic.go:356] "Generic (PLEG): container finished" podID="25433e62-4542-4b17-bd00-2b522d351fd1" containerID="5d4bde314cfbe0900f6fb1a5f595eb35596fe390056dca2170c976c8fa2d45c5" exitCode=0
Jul 06 17:41:29.775331 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:29.774970    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj" event={"ID":"25433e62-4542-4b17-bd00-2b522d351fd1","Type":"ContainerDied","Data":"5d4bde314cfbe0900f6fb1a5f595eb35596fe390056dca2170c976c8fa2d45c5"}
Jul 06 17:41:29.775331 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:29.775255    2570 scope.go:117] "RemoveContainer" containerID="5d4bde314cfbe0900f6fb1a5f595eb35596fe390056dca2170c976c8fa2d45c5"
Jul 06 17:41:30.779689 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:30.779656    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-95rjj" event={"ID":"25433e62-4542-4b17-bd00-2b522d351fd1","Type":"ContainerStarted","Data":"76d262acf89539ff05384e11b1c677064072a01848b54996a6147b55bd2e6be9"}
Jul 06 17:41:31.751405 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:31.751374    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5wj5t"
Jul 06 17:41:34.797955 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:34.797910    2570 generic.go:356] "Generic (PLEG): container finished" podID="235b3c7e-5ad8-4006-9424-31d2f85b9b72" containerID="194e075a6d43e32a37d96cd37e42d196e3990d5a6294d97a2da6367aae7afe74" exitCode=0
Jul 06 17:41:34.798556 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:34.798531    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh" event={"ID":"235b3c7e-5ad8-4006-9424-31d2f85b9b72","Type":"ContainerDied","Data":"194e075a6d43e32a37d96cd37e42d196e3990d5a6294d97a2da6367aae7afe74"}
Jul 06 17:41:34.799464 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:34.799442    2570 scope.go:117] "RemoveContainer" containerID="194e075a6d43e32a37d96cd37e42d196e3990d5a6294d97a2da6367aae7afe74"
Jul 06 17:41:35.803620 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:35.803588    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-n9knh" event={"ID":"235b3c7e-5ad8-4006-9424-31d2f85b9b72","Type":"ContainerStarted","Data":"edfdb6d1fd9b325d21df0be94714ac44296b9856b2f3943761606de19d7697bd"}
Jul 06 17:41:39.819238 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:39.819205    2570 generic.go:356] "Generic (PLEG): container finished" podID="6a82af56-16d0-456d-a04f-b82f288688c8" containerID="ac5b4704f5cc6fa59156c26c61c32bf2034953d301b2f8b832466b6d884576ce" exitCode=0
Jul 06 17:41:39.819605 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:39.819281    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp" event={"ID":"6a82af56-16d0-456d-a04f-b82f288688c8","Type":"ContainerDied","Data":"ac5b4704f5cc6fa59156c26c61c32bf2034953d301b2f8b832466b6d884576ce"}
Jul 06 17:41:39.819646 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:39.819612    2570 scope.go:117] "RemoveContainer" containerID="ac5b4704f5cc6fa59156c26c61c32bf2034953d301b2f8b832466b6d884576ce"
Jul 06 17:41:40.824402 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:41:40.824369    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-k5ghp" event={"ID":"6a82af56-16d0-456d-a04f-b82f288688c8","Type":"ContainerStarted","Data":"74c7c6acc3983c060923d62494f40f2719fe77a25e403abf9ff7b88cc9d7e88b"}
Jul 06 17:43:33.801028 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:43:33.801000    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 17:43:33.809986 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:43:33.809961    2570 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 17:43:33.822935 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:43:33.822908    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 17:44:14.875927 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:14.875892    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tkbkl"]
Jul 06 17:44:14.878804 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:14.878787    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tkbkl"
Jul 06 17:44:14.881257 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:14.881237    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 17:44:14.881364 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:14.881273    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2gfkn\""
Jul 06 17:44:14.882496 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:14.882482    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 17:44:14.887861 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:14.887840    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tkbkl"]
Jul 06 17:44:14.953103 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:14.953067    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df947048-36d1-48cc-b658-5d2d96faa280-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tkbkl\" (UID: \"df947048-36d1-48cc-b658-5d2d96faa280\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tkbkl"
Jul 06 17:44:14.953103 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:14.953100    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44lvn\" (UniqueName: \"kubernetes.io/projected/df947048-36d1-48cc-b658-5d2d96faa280-kube-api-access-44lvn\") pod \"cert-manager-cainjector-559cdd8c87-tkbkl\" (UID: \"df947048-36d1-48cc-b658-5d2d96faa280\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tkbkl"
Jul 06 17:44:15.053560 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:15.053526    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df947048-36d1-48cc-b658-5d2d96faa280-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tkbkl\" (UID: \"df947048-36d1-48cc-b658-5d2d96faa280\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tkbkl"
Jul 06 17:44:15.053560 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:15.053561    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44lvn\" (UniqueName: \"kubernetes.io/projected/df947048-36d1-48cc-b658-5d2d96faa280-kube-api-access-44lvn\") pod \"cert-manager-cainjector-559cdd8c87-tkbkl\" (UID: \"df947048-36d1-48cc-b658-5d2d96faa280\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tkbkl"
Jul 06 17:44:15.061931 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:15.061904    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/df947048-36d1-48cc-b658-5d2d96faa280-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tkbkl\" (UID: \"df947048-36d1-48cc-b658-5d2d96faa280\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tkbkl"
Jul 06 17:44:15.062067 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:15.062049    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44lvn\" (UniqueName: \"kubernetes.io/projected/df947048-36d1-48cc-b658-5d2d96faa280-kube-api-access-44lvn\") pod \"cert-manager-cainjector-559cdd8c87-tkbkl\" (UID: \"df947048-36d1-48cc-b658-5d2d96faa280\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tkbkl"
Jul 06 17:44:15.188242 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:15.188210    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tkbkl"
Jul 06 17:44:15.314368 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:15.314335    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tkbkl"]
Jul 06 17:44:15.318088 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:44:15.318060    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf947048_36d1_48cc_b658_5d2d96faa280.slice/crio-846574ca9da0f09007a0e52bf63cf7f526d45847025ee9c462a326c0a80394e4 WatchSource:0}: Error finding container 846574ca9da0f09007a0e52bf63cf7f526d45847025ee9c462a326c0a80394e4: Status 404 returned error can't find the container with id 846574ca9da0f09007a0e52bf63cf7f526d45847025ee9c462a326c0a80394e4
Jul 06 17:44:15.320005 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:15.319987    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 17:44:15.352735 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:15.352680    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tkbkl" event={"ID":"df947048-36d1-48cc-b658-5d2d96faa280","Type":"ContainerStarted","Data":"846574ca9da0f09007a0e52bf63cf7f526d45847025ee9c462a326c0a80394e4"}
Jul 06 17:44:23.385940 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:23.385907    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tkbkl" event={"ID":"df947048-36d1-48cc-b658-5d2d96faa280","Type":"ContainerStarted","Data":"d229dc08145f206a36f4c591597f00146a0ad8eedde5521e449b72798b76a361"}
Jul 06 17:44:23.402960 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:23.402901    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tkbkl" podStartSLOduration=1.419698162 podStartE2EDuration="9.402879003s" totalImagesPullingTime="7.983180841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:44:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:44:23.400732962 +0000 UTC m=+349.978933824" watchObservedRunningTime="2026-07-06 17:44:23.402879003 +0000 UTC m=+349.981079840"
Jul 06 17:44:59.268682 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.268607    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"]
Jul 06 17:44:59.270722 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.270684    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.273679 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.273653    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 17:44:59.273679 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.273671    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bk52m\""
Jul 06 17:44:59.273881 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.273660    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 17:44:59.273881 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.273748    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 17:44:59.273881 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.273764    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 17:44:59.289200 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.289171    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"]
Jul 06 17:44:59.298954 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.298929    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rn2p\" (UniqueName: \"kubernetes.io/projected/f0806ed5-6d5e-4a47-9d08-2013a58f526e-kube-api-access-6rn2p\") pod \"opendatahub-operator-controller-manager-597bcb8998-7s2dk\" (UID: \"f0806ed5-6d5e-4a47-9d08-2013a58f526e\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.299058 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.298982    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f0806ed5-6d5e-4a47-9d08-2013a58f526e-manifests\") pod \"opendatahub-operator-controller-manager-597bcb8998-7s2dk\" (UID: \"f0806ed5-6d5e-4a47-9d08-2013a58f526e\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.299058 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.299018    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f0806ed5-6d5e-4a47-9d08-2013a58f526e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-597bcb8998-7s2dk\" (UID: \"f0806ed5-6d5e-4a47-9d08-2013a58f526e\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.299058 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.299042    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0806ed5-6d5e-4a47-9d08-2013a58f526e-webhook-cert\") pod \"opendatahub-operator-controller-manager-597bcb8998-7s2dk\" (UID: \"f0806ed5-6d5e-4a47-9d08-2013a58f526e\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.299159 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.299084    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0806ed5-6d5e-4a47-9d08-2013a58f526e-tmp\") pod \"opendatahub-operator-controller-manager-597bcb8998-7s2dk\" (UID: \"f0806ed5-6d5e-4a47-9d08-2013a58f526e\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.400157 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.400119    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f0806ed5-6d5e-4a47-9d08-2013a58f526e-manifests\") pod \"opendatahub-operator-controller-manager-597bcb8998-7s2dk\" (UID: \"f0806ed5-6d5e-4a47-9d08-2013a58f526e\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.400157 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.400157    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f0806ed5-6d5e-4a47-9d08-2013a58f526e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-597bcb8998-7s2dk\" (UID: \"f0806ed5-6d5e-4a47-9d08-2013a58f526e\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.400364 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.400173    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0806ed5-6d5e-4a47-9d08-2013a58f526e-webhook-cert\") pod \"opendatahub-operator-controller-manager-597bcb8998-7s2dk\" (UID: \"f0806ed5-6d5e-4a47-9d08-2013a58f526e\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.400364 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.400194    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0806ed5-6d5e-4a47-9d08-2013a58f526e-tmp\") pod \"opendatahub-operator-controller-manager-597bcb8998-7s2dk\" (UID: \"f0806ed5-6d5e-4a47-9d08-2013a58f526e\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.400364 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.400255    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rn2p\" (UniqueName: \"kubernetes.io/projected/f0806ed5-6d5e-4a47-9d08-2013a58f526e-kube-api-access-6rn2p\") pod \"opendatahub-operator-controller-manager-597bcb8998-7s2dk\" (UID: \"f0806ed5-6d5e-4a47-9d08-2013a58f526e\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.400613 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.400582    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f0806ed5-6d5e-4a47-9d08-2013a58f526e-manifests\") pod \"opendatahub-operator-controller-manager-597bcb8998-7s2dk\" (UID: \"f0806ed5-6d5e-4a47-9d08-2013a58f526e\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.402600 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.402569    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0806ed5-6d5e-4a47-9d08-2013a58f526e-tmp\") pod \"opendatahub-operator-controller-manager-597bcb8998-7s2dk\" (UID: \"f0806ed5-6d5e-4a47-9d08-2013a58f526e\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.402741 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.402643    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f0806ed5-6d5e-4a47-9d08-2013a58f526e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-597bcb8998-7s2dk\" (UID: \"f0806ed5-6d5e-4a47-9d08-2013a58f526e\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.402741 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.402673    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0806ed5-6d5e-4a47-9d08-2013a58f526e-webhook-cert\") pod \"opendatahub-operator-controller-manager-597bcb8998-7s2dk\" (UID: \"f0806ed5-6d5e-4a47-9d08-2013a58f526e\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.433309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.433280    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rn2p\" (UniqueName: \"kubernetes.io/projected/f0806ed5-6d5e-4a47-9d08-2013a58f526e-kube-api-access-6rn2p\") pod \"opendatahub-operator-controller-manager-597bcb8998-7s2dk\" (UID: \"f0806ed5-6d5e-4a47-9d08-2013a58f526e\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.581378 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.581288    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:44:59.711763 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:44:59.711740    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"]
Jul 06 17:44:59.714404 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:44:59.714380    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0806ed5_6d5e_4a47_9d08_2013a58f526e.slice/crio-45933a35621907728108231700a0f4a887e97d6d665487ab5a4b6210d6f87739 WatchSource:0}: Error finding container 45933a35621907728108231700a0f4a887e97d6d665487ab5a4b6210d6f87739: Status 404 returned error can't find the container with id 45933a35621907728108231700a0f4a887e97d6d665487ab5a4b6210d6f87739
Jul 06 17:45:00.520674 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:00.520635    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk" event={"ID":"f0806ed5-6d5e-4a47-9d08-2013a58f526e","Type":"ContainerStarted","Data":"45933a35621907728108231700a0f4a887e97d6d665487ab5a4b6210d6f87739"}
Jul 06 17:45:03.537116 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:03.537074    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk" event={"ID":"f0806ed5-6d5e-4a47-9d08-2013a58f526e","Type":"ContainerStarted","Data":"3b974a8acc8171545dfdc547c3c4cbf149bc2c90a1f75f5ffe7dff613730a256"}
Jul 06 17:45:04.541689 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:04.541651    2570 generic.go:356] "Generic (PLEG): container finished" podID="f0806ed5-6d5e-4a47-9d08-2013a58f526e" containerID="3b974a8acc8171545dfdc547c3c4cbf149bc2c90a1f75f5ffe7dff613730a256" exitCode=0
Jul 06 17:45:04.542178 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:04.541737    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk" event={"ID":"f0806ed5-6d5e-4a47-9d08-2013a58f526e","Type":"ContainerDied","Data":"3b974a8acc8171545dfdc547c3c4cbf149bc2c90a1f75f5ffe7dff613730a256"}
Jul 06 17:45:05.547092 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:05.547002    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk" event={"ID":"f0806ed5-6d5e-4a47-9d08-2013a58f526e","Type":"ContainerStarted","Data":"ce6d6765b6e4dd24eb875f9e3ebdea6b556a9b97bb03c89f99b4ecc1e10c4ae2"}
Jul 06 17:45:05.547479 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:05.547157    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:45:05.570078 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:05.570022    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk" podStartSLOduration=2.046832462 podStartE2EDuration="6.570004179s" totalImagesPullingTime="3.479605425s" totalInitContainerRuntime="1.043566292s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:44:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:05.568816281 +0000 UTC m=+392.147017128" watchObservedRunningTime="2026-07-06 17:45:05.570004179 +0000 UTC m=+392.148205015"
Jul 06 17:45:16.552747 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:16.552718    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-7s2dk"
Jul 06 17:45:18.915742 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:18.915686    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs"]
Jul 06 17:45:18.924532 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:18.924506    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs"
Jul 06 17:45:18.929216 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:18.929191    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 17:45:18.929363 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:18.929230    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 17:45:18.929363 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:18.929230    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g7nsn\""
Jul 06 17:45:18.929487 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:18.929238    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 17:45:18.929487 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:18.929262    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 17:45:18.931513 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:18.931364    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs"]
Jul 06 17:45:19.054841 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.054807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs5zz\" (UniqueName: \"kubernetes.io/projected/d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5-kube-api-access-cs5zz\") pod \"kube-auth-proxy-6cf85c8449-g6gvs\" (UID: \"d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5\") " pod="openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs"
Jul 06 17:45:19.055046 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.054859    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5-tmp\") pod \"kube-auth-proxy-6cf85c8449-g6gvs\" (UID: \"d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5\") " pod="openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs"
Jul 06 17:45:19.055119 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.055049    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5-tls-certs\") pod \"kube-auth-proxy-6cf85c8449-g6gvs\" (UID: \"d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5\") " pod="openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs"
Jul 06 17:45:19.156307 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.156274    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5-tls-certs\") pod \"kube-auth-proxy-6cf85c8449-g6gvs\" (UID: \"d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5\") " pod="openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs"
Jul 06 17:45:19.156485 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.156316    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs5zz\" (UniqueName: \"kubernetes.io/projected/d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5-kube-api-access-cs5zz\") pod \"kube-auth-proxy-6cf85c8449-g6gvs\" (UID: \"d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5\") " pod="openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs"
Jul 06 17:45:19.156485 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.156357    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5-tmp\") pod \"kube-auth-proxy-6cf85c8449-g6gvs\" (UID: \"d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5\") " pod="openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs"
Jul 06 17:45:19.158521 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.158497    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5-tmp\") pod \"kube-auth-proxy-6cf85c8449-g6gvs\" (UID: \"d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5\") " pod="openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs"
Jul 06 17:45:19.158789 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.158769    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5-tls-certs\") pod \"kube-auth-proxy-6cf85c8449-g6gvs\" (UID: \"d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5\") " pod="openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs"
Jul 06 17:45:19.165102 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.165080    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs5zz\" (UniqueName: \"kubernetes.io/projected/d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5-kube-api-access-cs5zz\") pod \"kube-auth-proxy-6cf85c8449-g6gvs\" (UID: \"d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5\") " pod="openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs"
Jul 06 17:45:19.235179 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.235148    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs"
Jul 06 17:45:19.263736 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.263705    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lmcq8"]
Jul 06 17:45:19.265943 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.265927    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lmcq8"
Jul 06 17:45:19.268825 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.268802    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 17:45:19.268947 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.268882    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-v7lvk\""
Jul 06 17:45:19.279018 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.278994    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lmcq8"]
Jul 06 17:45:19.358533 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.358500    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc5360bc-160c-44c3-bcfc-164d085ec2e8-cert\") pod \"odh-model-controller-7998c67dc4-lmcq8\" (UID: \"fc5360bc-160c-44c3-bcfc-164d085ec2e8\") " pod="opendatahub/odh-model-controller-7998c67dc4-lmcq8"
Jul 06 17:45:19.358533 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.358537    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h7d6\" (UniqueName: \"kubernetes.io/projected/fc5360bc-160c-44c3-bcfc-164d085ec2e8-kube-api-access-8h7d6\") pod \"odh-model-controller-7998c67dc4-lmcq8\" (UID: \"fc5360bc-160c-44c3-bcfc-164d085ec2e8\") " pod="opendatahub/odh-model-controller-7998c67dc4-lmcq8"
Jul 06 17:45:19.369792 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.369764    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs"]
Jul 06 17:45:19.373522 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:45:19.373498    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd76e88a7_0b12_4bc9_b611_8a5d0e39e2c5.slice/crio-07fa44946db06217907771cdcd5e4ff87ae31a61c8ac16df52145955116d92fb WatchSource:0}: Error finding container 07fa44946db06217907771cdcd5e4ff87ae31a61c8ac16df52145955116d92fb: Status 404 returned error can't find the container with id 07fa44946db06217907771cdcd5e4ff87ae31a61c8ac16df52145955116d92fb
Jul 06 17:45:19.459941 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.459906    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc5360bc-160c-44c3-bcfc-164d085ec2e8-cert\") pod \"odh-model-controller-7998c67dc4-lmcq8\" (UID: \"fc5360bc-160c-44c3-bcfc-164d085ec2e8\") " pod="opendatahub/odh-model-controller-7998c67dc4-lmcq8"
Jul 06 17:45:19.459941 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.459944    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h7d6\" (UniqueName: \"kubernetes.io/projected/fc5360bc-160c-44c3-bcfc-164d085ec2e8-kube-api-access-8h7d6\") pod \"odh-model-controller-7998c67dc4-lmcq8\" (UID: \"fc5360bc-160c-44c3-bcfc-164d085ec2e8\") " pod="opendatahub/odh-model-controller-7998c67dc4-lmcq8"
Jul 06 17:45:19.460154 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:45:19.460055    2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 17:45:19.460154 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:45:19.460117    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc5360bc-160c-44c3-bcfc-164d085ec2e8-cert podName:fc5360bc-160c-44c3-bcfc-164d085ec2e8 nodeName:}" failed. No retries permitted until 2026-07-06 17:45:19.960101628 +0000 UTC m=+406.538302445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fc5360bc-160c-44c3-bcfc-164d085ec2e8-cert") pod "odh-model-controller-7998c67dc4-lmcq8" (UID: "fc5360bc-160c-44c3-bcfc-164d085ec2e8") : secret "odh-model-controller-webhook-cert" not found
Jul 06 17:45:19.478574 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.478550    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h7d6\" (UniqueName: \"kubernetes.io/projected/fc5360bc-160c-44c3-bcfc-164d085ec2e8-kube-api-access-8h7d6\") pod \"odh-model-controller-7998c67dc4-lmcq8\" (UID: \"fc5360bc-160c-44c3-bcfc-164d085ec2e8\") " pod="opendatahub/odh-model-controller-7998c67dc4-lmcq8"
Jul 06 17:45:19.604423 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.604344    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs" event={"ID":"d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5","Type":"ContainerStarted","Data":"07fa44946db06217907771cdcd5e4ff87ae31a61c8ac16df52145955116d92fb"}
Jul 06 17:45:19.963914 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.963884    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc5360bc-160c-44c3-bcfc-164d085ec2e8-cert\") pod \"odh-model-controller-7998c67dc4-lmcq8\" (UID: \"fc5360bc-160c-44c3-bcfc-164d085ec2e8\") " pod="opendatahub/odh-model-controller-7998c67dc4-lmcq8"
Jul 06 17:45:19.966203 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:19.966185    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc5360bc-160c-44c3-bcfc-164d085ec2e8-cert\") pod \"odh-model-controller-7998c67dc4-lmcq8\" (UID: \"fc5360bc-160c-44c3-bcfc-164d085ec2e8\") " pod="opendatahub/odh-model-controller-7998c67dc4-lmcq8"
Jul 06 17:45:20.149266 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.149224    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tpv8f"]
Jul 06 17:45:20.152002 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.151983    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tpv8f"
Jul 06 17:45:20.155370 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.155332    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 17:45:20.158208 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.158190    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hk5ph\""
Jul 06 17:45:20.166862 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.166809    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tpv8f"]
Jul 06 17:45:20.178969 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.178944    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lmcq8"
Jul 06 17:45:20.266886 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.266852    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f44d6ec7-ea98-4c49-a3b1-5eb124914b93-tls-certs\") pod \"model-serving-api-54d89bd5fc-tpv8f\" (UID: \"f44d6ec7-ea98-4c49-a3b1-5eb124914b93\") " pod="opendatahub/model-serving-api-54d89bd5fc-tpv8f"
Jul 06 17:45:20.267043 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.266973    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-462mw\" (UniqueName: \"kubernetes.io/projected/f44d6ec7-ea98-4c49-a3b1-5eb124914b93-kube-api-access-462mw\") pod \"model-serving-api-54d89bd5fc-tpv8f\" (UID: \"f44d6ec7-ea98-4c49-a3b1-5eb124914b93\") " pod="opendatahub/model-serving-api-54d89bd5fc-tpv8f"
Jul 06 17:45:20.323927 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.323896    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lmcq8"]
Jul 06 17:45:20.327517 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:45:20.327493    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc5360bc_160c_44c3_bcfc_164d085ec2e8.slice/crio-28eab2ca757425f78b3d881d32346c1f9e485c2c6a767a3e0fb6bab97c514e4b WatchSource:0}: Error finding container 28eab2ca757425f78b3d881d32346c1f9e485c2c6a767a3e0fb6bab97c514e4b: Status 404 returned error can't find the container with id 28eab2ca757425f78b3d881d32346c1f9e485c2c6a767a3e0fb6bab97c514e4b
Jul 06 17:45:20.351143 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.351117    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"]
Jul 06 17:45:20.354810 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.354794    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.357515 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.357492    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 17:45:20.357620 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.357566    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 17:45:20.357620 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.357605    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 17:45:20.357755 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.357624    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 17:45:20.357755 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.357624    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pqnqn\""
Jul 06 17:45:20.367345 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.367322    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-462mw\" (UniqueName: \"kubernetes.io/projected/f44d6ec7-ea98-4c49-a3b1-5eb124914b93-kube-api-access-462mw\") pod \"model-serving-api-54d89bd5fc-tpv8f\" (UID: \"f44d6ec7-ea98-4c49-a3b1-5eb124914b93\") " pod="opendatahub/model-serving-api-54d89bd5fc-tpv8f"
Jul 06 17:45:20.367453 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.367372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f44d6ec7-ea98-4c49-a3b1-5eb124914b93-tls-certs\") pod \"model-serving-api-54d89bd5fc-tpv8f\" (UID: \"f44d6ec7-ea98-4c49-a3b1-5eb124914b93\") " pod="opendatahub/model-serving-api-54d89bd5fc-tpv8f"
Jul 06 17:45:20.368978 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.368957    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"]
Jul 06 17:45:20.370041 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.370024    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f44d6ec7-ea98-4c49-a3b1-5eb124914b93-tls-certs\") pod \"model-serving-api-54d89bd5fc-tpv8f\" (UID: \"f44d6ec7-ea98-4c49-a3b1-5eb124914b93\") " pod="opendatahub/model-serving-api-54d89bd5fc-tpv8f"
Jul 06 17:45:20.379042 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.379018    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-462mw\" (UniqueName: \"kubernetes.io/projected/f44d6ec7-ea98-4c49-a3b1-5eb124914b93-kube-api-access-462mw\") pod \"model-serving-api-54d89bd5fc-tpv8f\" (UID: \"f44d6ec7-ea98-4c49-a3b1-5eb124914b93\") " pod="opendatahub/model-serving-api-54d89bd5fc-tpv8f"
Jul 06 17:45:20.467943 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.467906    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szvgc\" (UniqueName: \"kubernetes.io/projected/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-kube-api-access-szvgc\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.468106 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.467961    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.468106 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.468025    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-local-certs\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.468106 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.468043    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-token\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.468106 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.468061    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.468106 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.468102    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-cacerts\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.468271 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.468133    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.475871 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.475845    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tpv8f"
Jul 06 17:45:20.569484 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.569451    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.569646 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.569527    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-local-certs\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.569646 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.569554    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-token\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.569646 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.569577    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.569646 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.569602    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-cacerts\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.569646 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.569628    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.569918 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.569669    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szvgc\" (UniqueName: \"kubernetes.io/projected/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-kube-api-access-szvgc\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.570783 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.570714    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.572247 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.572176    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.572343 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.572300    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-local-certs\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.572404 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.572376    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-cacerts\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.572463 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.572444    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.578931 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.578883    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-token\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.578931 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.578883    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szvgc\" (UniqueName: \"kubernetes.io/projected/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-kube-api-access-szvgc\") pod \"istiod-openshift-gateway-7574459656-7m6fv\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.614908 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.614877    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lmcq8" event={"ID":"fc5360bc-160c-44c3-bcfc-164d085ec2e8","Type":"ContainerStarted","Data":"28eab2ca757425f78b3d881d32346c1f9e485c2c6a767a3e0fb6bab97c514e4b"}
Jul 06 17:45:20.626527 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.626499    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tpv8f"]
Jul 06 17:45:20.630530 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:45:20.630509    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf44d6ec7_ea98_4c49_a3b1_5eb124914b93.slice/crio-bb22649a9f9f7b2ba2f148aabdafd402101c9165a8901fa50306cee1f8d6a7a9 WatchSource:0}: Error finding container bb22649a9f9f7b2ba2f148aabdafd402101c9165a8901fa50306cee1f8d6a7a9: Status 404 returned error can't find the container with id bb22649a9f9f7b2ba2f148aabdafd402101c9165a8901fa50306cee1f8d6a7a9
Jul 06 17:45:20.664338 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.664320    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:20.803518 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:20.803484    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"]
Jul 06 17:45:20.806403 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:45:20.806368    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa875b3_0e35_4b9b_864b_6c1c7fc1d412.slice/crio-37d37180ab0348b010b186a82a4fa528ff183e957a76b848e4bf263676d8fc33 WatchSource:0}: Error finding container 37d37180ab0348b010b186a82a4fa528ff183e957a76b848e4bf263676d8fc33: Status 404 returned error can't find the container with id 37d37180ab0348b010b186a82a4fa528ff183e957a76b848e4bf263676d8fc33
Jul 06 17:45:21.622203 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:21.622141    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv" event={"ID":"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412","Type":"ContainerStarted","Data":"37d37180ab0348b010b186a82a4fa528ff183e957a76b848e4bf263676d8fc33"}
Jul 06 17:45:21.623785 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:21.623675    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tpv8f" event={"ID":"f44d6ec7-ea98-4c49-a3b1-5eb124914b93","Type":"ContainerStarted","Data":"bb22649a9f9f7b2ba2f148aabdafd402101c9165a8901fa50306cee1f8d6a7a9"}
Jul 06 17:45:25.402441 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:25.402411    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 17:45:25.402754 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:25.402470    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 06 17:45:25.645031 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:25.644950    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lmcq8" event={"ID":"fc5360bc-160c-44c3-bcfc-164d085ec2e8","Type":"ContainerStarted","Data":"a5fa917cc14648c5ba4c32733f24e9f4f1b08b122621416d13555df37a30dcbc"}
Jul 06 17:45:25.645181 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:25.645075    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-lmcq8"
Jul 06 17:45:25.646599 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:25.646572    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs" event={"ID":"d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5","Type":"ContainerStarted","Data":"7de1e688034616e81c7cec4ca827d48cfece83920480cd4e2c8f6b7da3f5b57e"}
Jul 06 17:45:25.648229 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:25.648209    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv" event={"ID":"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412","Type":"ContainerStarted","Data":"6e7fd9d0c7c699d13a0e4ed47d83d863c1fbfe2e9fd6d0a65ebd3315f4e002e8"}
Jul 06 17:45:25.648334 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:25.648310    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:25.649766 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:25.649747    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tpv8f" event={"ID":"f44d6ec7-ea98-4c49-a3b1-5eb124914b93","Type":"ContainerStarted","Data":"11489d149e28a6eae63fcde6a889a388a86fdff04585414f2883a7344ff7e486"}
Jul 06 17:45:25.649900 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:25.649881    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tpv8f"
Jul 06 17:45:25.665552 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:25.665506    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-lmcq8" podStartSLOduration=1.5842978250000002 podStartE2EDuration="6.665490784s" totalImagesPullingTime="5.081192959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:25.664382612 +0000 UTC m=+412.242583449" watchObservedRunningTime="2026-07-06 17:45:25.665490784 +0000 UTC m=+412.243691621"
Jul 06 17:45:25.684351 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:25.684299    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv" podStartSLOduration=1.090377496 podStartE2EDuration="5.684283719s" totalImagesPullingTime="4.593906223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:25.683557715 +0000 UTC m=+412.261758543" watchObservedRunningTime="2026-07-06 17:45:25.684283719 +0000 UTC m=+412.262484554"
Jul 06 17:45:25.699603 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:25.699547    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6cf85c8449-g6gvs" podStartSLOduration=1.6746647380000002 podStartE2EDuration="7.699532452s" totalImagesPullingTime="6.024867714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:25.698885558 +0000 UTC m=+412.277086394" watchObservedRunningTime="2026-07-06 17:45:25.699532452 +0000 UTC m=+412.277733288"
Jul 06 17:45:25.714618 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:25.714568    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tpv8f" podStartSLOduration=0.947032919 podStartE2EDuration="5.714547214s" totalImagesPullingTime="4.767514295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:25.713333025 +0000 UTC m=+412.291533864" watchObservedRunningTime="2026-07-06 17:45:25.714547214 +0000 UTC m=+412.292748051"
Jul 06 17:45:26.656190 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:26.656158    2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-7m6fv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 17:45:26.656529 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:26.656220    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv" podUID="aaa875b3-0e35-4b9b-864b-6c1c7fc1d412" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 17:45:29.634067 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.634029    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7fm26"]
Jul 06 17:45:29.637223 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.637203    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7fm26"
Jul 06 17:45:29.640168 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.640140    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 17:45:29.640326 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.640306    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-smm9k\""
Jul 06 17:45:29.642964 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.642941    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc"]
Jul 06 17:45:29.646172 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.646156    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc"
Jul 06 17:45:29.648717 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.648683    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dr8qh\""
Jul 06 17:45:29.648952 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.648932    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 17:45:29.650686 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.650665    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7fm26"]
Jul 06 17:45:29.654903 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.654879    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:29.660092 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.660069    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc"]
Jul 06 17:45:29.746058 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.746028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f5923d5-44a2-460c-bee0-f5e1911f7875-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-p7hgc\" (UID: \"0f5923d5-44a2-460c-bee0-f5e1911f7875\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc"
Jul 06 17:45:29.746205 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.746091    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa251531-ca54-4aad-838c-aeb7f6a6e2fb-cert\") pod \"kserve-controller-manager-d6f4b65b8-7fm26\" (UID: \"fa251531-ca54-4aad-838c-aeb7f6a6e2fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7fm26"
Jul 06 17:45:29.746247 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.746201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mxwx\" (UniqueName: \"kubernetes.io/projected/0f5923d5-44a2-460c-bee0-f5e1911f7875-kube-api-access-9mxwx\") pod \"llmisvc-controller-manager-777c6bd7d5-p7hgc\" (UID: \"0f5923d5-44a2-460c-bee0-f5e1911f7875\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc"
Jul 06 17:45:29.746247 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.746240    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcsdm\" (UniqueName: \"kubernetes.io/projected/fa251531-ca54-4aad-838c-aeb7f6a6e2fb-kube-api-access-rcsdm\") pod \"kserve-controller-manager-d6f4b65b8-7fm26\" (UID: \"fa251531-ca54-4aad-838c-aeb7f6a6e2fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7fm26"
Jul 06 17:45:29.847399 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.847368    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa251531-ca54-4aad-838c-aeb7f6a6e2fb-cert\") pod \"kserve-controller-manager-d6f4b65b8-7fm26\" (UID: \"fa251531-ca54-4aad-838c-aeb7f6a6e2fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7fm26"
Jul 06 17:45:29.847554 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.847422    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mxwx\" (UniqueName: \"kubernetes.io/projected/0f5923d5-44a2-460c-bee0-f5e1911f7875-kube-api-access-9mxwx\") pod \"llmisvc-controller-manager-777c6bd7d5-p7hgc\" (UID: \"0f5923d5-44a2-460c-bee0-f5e1911f7875\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc"
Jul 06 17:45:29.847554 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.847534    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcsdm\" (UniqueName: \"kubernetes.io/projected/fa251531-ca54-4aad-838c-aeb7f6a6e2fb-kube-api-access-rcsdm\") pod \"kserve-controller-manager-d6f4b65b8-7fm26\" (UID: \"fa251531-ca54-4aad-838c-aeb7f6a6e2fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7fm26"
Jul 06 17:45:29.847657 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.847636    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f5923d5-44a2-460c-bee0-f5e1911f7875-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-p7hgc\" (UID: \"0f5923d5-44a2-460c-bee0-f5e1911f7875\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc"
Jul 06 17:45:29.847786 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:45:29.847772    2570 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 06 17:45:29.847830 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:45:29.847821    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f5923d5-44a2-460c-bee0-f5e1911f7875-cert podName:0f5923d5-44a2-460c-bee0-f5e1911f7875 nodeName:}" failed. No retries permitted until 2026-07-06 17:45:30.347807034 +0000 UTC m=+416.926007849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0f5923d5-44a2-460c-bee0-f5e1911f7875-cert") pod "llmisvc-controller-manager-777c6bd7d5-p7hgc" (UID: "0f5923d5-44a2-460c-bee0-f5e1911f7875") : secret "llmisvc-webhook-server-cert" not found
Jul 06 17:45:29.849722 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.849689    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa251531-ca54-4aad-838c-aeb7f6a6e2fb-cert\") pod \"kserve-controller-manager-d6f4b65b8-7fm26\" (UID: \"fa251531-ca54-4aad-838c-aeb7f6a6e2fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7fm26"
Jul 06 17:45:29.860631 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.860605    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mxwx\" (UniqueName: \"kubernetes.io/projected/0f5923d5-44a2-460c-bee0-f5e1911f7875-kube-api-access-9mxwx\") pod \"llmisvc-controller-manager-777c6bd7d5-p7hgc\" (UID: \"0f5923d5-44a2-460c-bee0-f5e1911f7875\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc"
Jul 06 17:45:29.864374 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.864349    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcsdm\" (UniqueName: \"kubernetes.io/projected/fa251531-ca54-4aad-838c-aeb7f6a6e2fb-kube-api-access-rcsdm\") pod \"kserve-controller-manager-d6f4b65b8-7fm26\" (UID: \"fa251531-ca54-4aad-838c-aeb7f6a6e2fb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7fm26"
Jul 06 17:45:29.947529 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:29.947499    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7fm26"
Jul 06 17:45:30.089881 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:30.089858    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7fm26"]
Jul 06 17:45:30.092073 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:45:30.092045    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa251531_ca54_4aad_838c_aeb7f6a6e2fb.slice/crio-fd765fbeda7350c00236739d49e20aa1b5d4d3421f8979959bf50c61908c3d75 WatchSource:0}: Error finding container fd765fbeda7350c00236739d49e20aa1b5d4d3421f8979959bf50c61908c3d75: Status 404 returned error can't find the container with id fd765fbeda7350c00236739d49e20aa1b5d4d3421f8979959bf50c61908c3d75
Jul 06 17:45:30.352380 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:30.352286    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f5923d5-44a2-460c-bee0-f5e1911f7875-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-p7hgc\" (UID: \"0f5923d5-44a2-460c-bee0-f5e1911f7875\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc"
Jul 06 17:45:30.354742 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:30.354714    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f5923d5-44a2-460c-bee0-f5e1911f7875-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-p7hgc\" (UID: \"0f5923d5-44a2-460c-bee0-f5e1911f7875\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc"
Jul 06 17:45:30.556341 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:30.556310    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc"
Jul 06 17:45:30.672141 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:30.672104    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7fm26" event={"ID":"fa251531-ca54-4aad-838c-aeb7f6a6e2fb","Type":"ContainerStarted","Data":"fd765fbeda7350c00236739d49e20aa1b5d4d3421f8979959bf50c61908c3d75"}
Jul 06 17:45:30.685982 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:30.685935    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc"]
Jul 06 17:45:30.688398 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:45:30.688366    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0f5923d5_44a2_460c_bee0_f5e1911f7875.slice/crio-78449946b841efc12264e18b6a3246e8dd1d0e3a0a8677c7e1699b71931f7e4c WatchSource:0}: Error finding container 78449946b841efc12264e18b6a3246e8dd1d0e3a0a8677c7e1699b71931f7e4c: Status 404 returned error can't find the container with id 78449946b841efc12264e18b6a3246e8dd1d0e3a0a8677c7e1699b71931f7e4c
Jul 06 17:45:31.678479 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:31.678436    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc" event={"ID":"0f5923d5-44a2-460c-bee0-f5e1911f7875","Type":"ContainerStarted","Data":"78449946b841efc12264e18b6a3246e8dd1d0e3a0a8677c7e1699b71931f7e4c"}
Jul 06 17:45:32.151771 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.151734    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"]
Jul 06 17:45:32.152029 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.151995    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv" podUID="aaa875b3-0e35-4b9b-864b-6c1c7fc1d412" containerName="discovery" containerID="cri-o://6e7fd9d0c7c699d13a0e4ed47d83d863c1fbfe2e9fd6d0a65ebd3315f4e002e8" gracePeriod=30
Jul 06 17:45:32.396359 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.396336    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:32.474297 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.474266    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-csr-dns-cert\") pod \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") "
Jul 06 17:45:32.474472 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.474310    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-local-certs\") pod \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") "
Jul 06 17:45:32.474472 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.474392    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-cacerts\") pod \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") "
Jul 06 17:45:32.474472 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.474420    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szvgc\" (UniqueName: \"kubernetes.io/projected/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-kube-api-access-szvgc\") pod \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") "
Jul 06 17:45:32.474472 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.474453    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-token\") pod \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") "
Jul 06 17:45:32.474750 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.474492    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-kubeconfig\") pod \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") "
Jul 06 17:45:32.474750 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.474519    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-csr-ca-configmap\") pod \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\" (UID: \"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412\") "
Jul 06 17:45:32.475147 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.475092    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "aaa875b3-0e35-4b9b-864b-6c1c7fc1d412" (UID: "aaa875b3-0e35-4b9b-864b-6c1c7fc1d412"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 17:45:32.477144 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.477115    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-local-certs" (OuterVolumeSpecName: "local-certs") pod "aaa875b3-0e35-4b9b-864b-6c1c7fc1d412" (UID: "aaa875b3-0e35-4b9b-864b-6c1c7fc1d412"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:45:32.477267 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.477196    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-cacerts" (OuterVolumeSpecName: "cacerts") pod "aaa875b3-0e35-4b9b-864b-6c1c7fc1d412" (UID: "aaa875b3-0e35-4b9b-864b-6c1c7fc1d412"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 17:45:32.477331 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.477292    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-token" (OuterVolumeSpecName: "istio-token") pod "aaa875b3-0e35-4b9b-864b-6c1c7fc1d412" (UID: "aaa875b3-0e35-4b9b-864b-6c1c7fc1d412"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:45:32.477551 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.477427    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "aaa875b3-0e35-4b9b-864b-6c1c7fc1d412" (UID: "aaa875b3-0e35-4b9b-864b-6c1c7fc1d412"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 17:45:32.477551 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.477455    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-kube-api-access-szvgc" (OuterVolumeSpecName: "kube-api-access-szvgc") pod "aaa875b3-0e35-4b9b-864b-6c1c7fc1d412" (UID: "aaa875b3-0e35-4b9b-864b-6c1c7fc1d412"). InnerVolumeSpecName "kube-api-access-szvgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:45:32.477551 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.477516    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "aaa875b3-0e35-4b9b-864b-6c1c7fc1d412" (UID: "aaa875b3-0e35-4b9b-864b-6c1c7fc1d412"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 17:45:32.575779 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.575739    2570 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-kubeconfig\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:45:32.575779 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.575777    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-csr-ca-configmap\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:45:32.576010 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.575794    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-csr-dns-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:45:32.576010 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.575807    2570 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-local-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:45:32.576010 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.575820    2570 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-cacerts\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:45:32.576010 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.575832    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szvgc\" (UniqueName: \"kubernetes.io/projected/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-kube-api-access-szvgc\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:45:32.576010 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.575847    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:45:32.684032 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.683999    2570 generic.go:356] "Generic (PLEG): container finished" podID="aaa875b3-0e35-4b9b-864b-6c1c7fc1d412" containerID="6e7fd9d0c7c699d13a0e4ed47d83d863c1fbfe2e9fd6d0a65ebd3315f4e002e8" exitCode=0
Jul 06 17:45:32.684415 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.684041    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"
Jul 06 17:45:32.684415 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.684048    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv" event={"ID":"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412","Type":"ContainerDied","Data":"6e7fd9d0c7c699d13a0e4ed47d83d863c1fbfe2e9fd6d0a65ebd3315f4e002e8"}
Jul 06 17:45:32.684415 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.684088    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv" event={"ID":"aaa875b3-0e35-4b9b-864b-6c1c7fc1d412","Type":"ContainerDied","Data":"37d37180ab0348b010b186a82a4fa528ff183e957a76b848e4bf263676d8fc33"}
Jul 06 17:45:32.684415 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.684108    2570 scope.go:117] "RemoveContainer" containerID="6e7fd9d0c7c699d13a0e4ed47d83d863c1fbfe2e9fd6d0a65ebd3315f4e002e8"
Jul 06 17:45:32.692506 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.692490    2570 scope.go:117] "RemoveContainer" containerID="6e7fd9d0c7c699d13a0e4ed47d83d863c1fbfe2e9fd6d0a65ebd3315f4e002e8"
Jul 06 17:45:32.692759 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:45:32.692737    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e7fd9d0c7c699d13a0e4ed47d83d863c1fbfe2e9fd6d0a65ebd3315f4e002e8\": container with ID starting with 6e7fd9d0c7c699d13a0e4ed47d83d863c1fbfe2e9fd6d0a65ebd3315f4e002e8 not found: ID does not exist" containerID="6e7fd9d0c7c699d13a0e4ed47d83d863c1fbfe2e9fd6d0a65ebd3315f4e002e8"
Jul 06 17:45:32.692810 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.692768    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e7fd9d0c7c699d13a0e4ed47d83d863c1fbfe2e9fd6d0a65ebd3315f4e002e8"} err="failed to get container status \"6e7fd9d0c7c699d13a0e4ed47d83d863c1fbfe2e9fd6d0a65ebd3315f4e002e8\": rpc error: code = NotFound desc = could not find container \"6e7fd9d0c7c699d13a0e4ed47d83d863c1fbfe2e9fd6d0a65ebd3315f4e002e8\": container with ID starting with 6e7fd9d0c7c699d13a0e4ed47d83d863c1fbfe2e9fd6d0a65ebd3315f4e002e8 not found: ID does not exist"
Jul 06 17:45:32.705700 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.705676    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"]
Jul 06 17:45:32.710880 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:32.710860    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7m6fv"]
Jul 06 17:45:33.974940 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:33.974906    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaa875b3-0e35-4b9b-864b-6c1c7fc1d412" path="/var/lib/kubelet/pods/aaa875b3-0e35-4b9b-864b-6c1c7fc1d412/volumes"
Jul 06 17:45:34.696177 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:34.696141    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7fm26" event={"ID":"fa251531-ca54-4aad-838c-aeb7f6a6e2fb","Type":"ContainerStarted","Data":"cfbee840254ead91f582f0131c031ed08ebfcb0a0c9a54227e89d49ae9bbcb8e"}
Jul 06 17:45:34.696335 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:34.696208    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7fm26"
Jul 06 17:45:34.697604 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:34.697575    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc" event={"ID":"0f5923d5-44a2-460c-bee0-f5e1911f7875","Type":"ContainerStarted","Data":"e9e2cfbabbd8099b41b0e6dbfce0bf69f6fb615c29488e54d31e4d5274e1fd79"}
Jul 06 17:45:34.697747 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:34.697729    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc"
Jul 06 17:45:34.715506 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:34.715460    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7fm26" podStartSLOduration=1.536176778 podStartE2EDuration="5.715443971s" totalImagesPullingTime="4.179267193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:34.713770786 +0000 UTC m=+421.291971616" watchObservedRunningTime="2026-07-06 17:45:34.715443971 +0000 UTC m=+421.293644806"
Jul 06 17:45:34.731380 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:34.731339    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc" podStartSLOduration=2.100424136 podStartE2EDuration="5.73132389s" totalImagesPullingTime="3.630899754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:34.730267284 +0000 UTC m=+421.308468121" watchObservedRunningTime="2026-07-06 17:45:34.73132389 +0000 UTC m=+421.309524726"
Jul 06 17:45:36.656709 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:36.656664    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-lmcq8"
Jul 06 17:45:36.658404 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:45:36.658383    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tpv8f"
Jul 06 17:46:05.703932 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:05.703897    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-p7hgc"
Jul 06 17:46:05.707137 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:05.707110    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7fm26"
Jul 06 17:46:20.207507 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.207469    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wh2vt"]
Jul 06 17:46:20.207917 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.207817    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa875b3-0e35-4b9b-864b-6c1c7fc1d412" containerName="discovery"
Jul 06 17:46:20.207917 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.207828    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa875b3-0e35-4b9b-864b-6c1c7fc1d412" containerName="discovery"
Jul 06 17:46:20.207917 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.207880    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaa875b3-0e35-4b9b-864b-6c1c7fc1d412" containerName="discovery"
Jul 06 17:46:20.212158 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.212139    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wh2vt"
Jul 06 17:46:20.215198 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.215170    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 17:46:20.216025 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.216001    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc8g4\" (UniqueName: \"kubernetes.io/projected/bcaa5ab8-d120-4111-b1dd-a72d2997586b-kube-api-access-sc8g4\") pod \"kuadrant-operator-catalog-wh2vt\" (UID: \"bcaa5ab8-d120-4111-b1dd-a72d2997586b\") " pod="kuadrant-system/kuadrant-operator-catalog-wh2vt"
Jul 06 17:46:20.216189 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.216166    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5sljr\""
Jul 06 17:46:20.216306 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.216199    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 17:46:20.222137 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.222108    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wh2vt"]
Jul 06 17:46:20.317083 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.317041    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc8g4\" (UniqueName: \"kubernetes.io/projected/bcaa5ab8-d120-4111-b1dd-a72d2997586b-kube-api-access-sc8g4\") pod \"kuadrant-operator-catalog-wh2vt\" (UID: \"bcaa5ab8-d120-4111-b1dd-a72d2997586b\") " pod="kuadrant-system/kuadrant-operator-catalog-wh2vt"
Jul 06 17:46:20.325300 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.325277    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc8g4\" (UniqueName: \"kubernetes.io/projected/bcaa5ab8-d120-4111-b1dd-a72d2997586b-kube-api-access-sc8g4\") pod \"kuadrant-operator-catalog-wh2vt\" (UID: \"bcaa5ab8-d120-4111-b1dd-a72d2997586b\") " pod="kuadrant-system/kuadrant-operator-catalog-wh2vt"
Jul 06 17:46:20.523253 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.523164    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wh2vt"
Jul 06 17:46:20.573258 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.573214    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wh2vt"]
Jul 06 17:46:20.655447 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.655420    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wh2vt"]
Jul 06 17:46:20.657825 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:46:20.657799    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcaa5ab8_d120_4111_b1dd_a72d2997586b.slice/crio-2483814c7590e5796343a0cbf45fef9223973b2d9cc9012ed6a6197f4f40baff WatchSource:0}: Error finding container 2483814c7590e5796343a0cbf45fef9223973b2d9cc9012ed6a6197f4f40baff: Status 404 returned error can't find the container with id 2483814c7590e5796343a0cbf45fef9223973b2d9cc9012ed6a6197f4f40baff
Jul 06 17:46:20.783277 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.783201    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pflsd"]
Jul 06 17:46:20.785830 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.785813    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pflsd"
Jul 06 17:46:20.794040 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.794011    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pflsd"]
Jul 06 17:46:20.821028 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.820995    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m26wn\" (UniqueName: \"kubernetes.io/projected/2e6b7dae-17ad-4e4e-88c1-b7df790919c1-kube-api-access-m26wn\") pod \"kuadrant-operator-catalog-pflsd\" (UID: \"2e6b7dae-17ad-4e4e-88c1-b7df790919c1\") " pod="kuadrant-system/kuadrant-operator-catalog-pflsd"
Jul 06 17:46:20.885367 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.885325    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wh2vt" event={"ID":"bcaa5ab8-d120-4111-b1dd-a72d2997586b","Type":"ContainerStarted","Data":"2483814c7590e5796343a0cbf45fef9223973b2d9cc9012ed6a6197f4f40baff"}
Jul 06 17:46:20.921755 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.921720    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m26wn\" (UniqueName: \"kubernetes.io/projected/2e6b7dae-17ad-4e4e-88c1-b7df790919c1-kube-api-access-m26wn\") pod \"kuadrant-operator-catalog-pflsd\" (UID: \"2e6b7dae-17ad-4e4e-88c1-b7df790919c1\") " pod="kuadrant-system/kuadrant-operator-catalog-pflsd"
Jul 06 17:46:20.930445 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:20.930421    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m26wn\" (UniqueName: \"kubernetes.io/projected/2e6b7dae-17ad-4e4e-88c1-b7df790919c1-kube-api-access-m26wn\") pod \"kuadrant-operator-catalog-pflsd\" (UID: \"2e6b7dae-17ad-4e4e-88c1-b7df790919c1\") " pod="kuadrant-system/kuadrant-operator-catalog-pflsd"
Jul 06 17:46:21.095531 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:21.095419    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pflsd"
Jul 06 17:46:21.228776 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:21.228727    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pflsd"]
Jul 06 17:46:21.231435 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:46:21.231410    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6b7dae_17ad_4e4e_88c1_b7df790919c1.slice/crio-9a4082096abcfeac8c9262544cc36c0d0c6018257ac62a9019eb6536d86eedf5 WatchSource:0}: Error finding container 9a4082096abcfeac8c9262544cc36c0d0c6018257ac62a9019eb6536d86eedf5: Status 404 returned error can't find the container with id 9a4082096abcfeac8c9262544cc36c0d0c6018257ac62a9019eb6536d86eedf5
Jul 06 17:46:21.891173 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:21.891137    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pflsd" event={"ID":"2e6b7dae-17ad-4e4e-88c1-b7df790919c1","Type":"ContainerStarted","Data":"9a4082096abcfeac8c9262544cc36c0d0c6018257ac62a9019eb6536d86eedf5"}
Jul 06 17:46:23.900617 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:23.900580    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wh2vt" event={"ID":"bcaa5ab8-d120-4111-b1dd-a72d2997586b","Type":"ContainerStarted","Data":"e1b8ffe35b743e9fb2936cfde9fd5827826890a99d7b3047430eb11dab0e4a56"}
Jul 06 17:46:23.901113 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:23.900635    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wh2vt" podUID="bcaa5ab8-d120-4111-b1dd-a72d2997586b" containerName="registry-server" containerID="cri-o://e1b8ffe35b743e9fb2936cfde9fd5827826890a99d7b3047430eb11dab0e4a56" gracePeriod=2
Jul 06 17:46:23.902108 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:23.902080    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pflsd" event={"ID":"2e6b7dae-17ad-4e4e-88c1-b7df790919c1","Type":"ContainerStarted","Data":"5a34a64d1cc9525cfaf39d7dc5ae47a867425aa6e8edeb449cfbc9e0c550ea8d"}
Jul 06 17:46:23.933946 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:23.933885    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wh2vt" podStartSLOduration=1.6399834229999999 podStartE2EDuration="3.933868054s" totalImagesPullingTime="2.293884631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:46:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:46:23.933178181 +0000 UTC m=+470.511379019" watchObservedRunningTime="2026-07-06 17:46:23.933868054 +0000 UTC m=+470.512068915"
Jul 06 17:46:23.967195 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:23.967148    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pflsd" podStartSLOduration=2.244122423 podStartE2EDuration="3.967131657s" totalImagesPullingTime="1.723009234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:46:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:46:23.965646439 +0000 UTC m=+470.543852076" watchObservedRunningTime="2026-07-06 17:46:23.967131657 +0000 UTC m=+470.545332493"
Jul 06 17:46:24.141982 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:24.141955    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wh2vt"
Jul 06 17:46:24.157313 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:24.157247    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc8g4\" (UniqueName: \"kubernetes.io/projected/bcaa5ab8-d120-4111-b1dd-a72d2997586b-kube-api-access-sc8g4\") pod \"bcaa5ab8-d120-4111-b1dd-a72d2997586b\" (UID: \"bcaa5ab8-d120-4111-b1dd-a72d2997586b\") "
Jul 06 17:46:24.159852 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:24.159824    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcaa5ab8-d120-4111-b1dd-a72d2997586b-kube-api-access-sc8g4" (OuterVolumeSpecName: "kube-api-access-sc8g4") pod "bcaa5ab8-d120-4111-b1dd-a72d2997586b" (UID: "bcaa5ab8-d120-4111-b1dd-a72d2997586b"). InnerVolumeSpecName "kube-api-access-sc8g4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:46:24.258579 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:24.258542    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc8g4\" (UniqueName: \"kubernetes.io/projected/bcaa5ab8-d120-4111-b1dd-a72d2997586b-kube-api-access-sc8g4\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:46:24.907687 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:24.907651    2570 generic.go:356] "Generic (PLEG): container finished" podID="bcaa5ab8-d120-4111-b1dd-a72d2997586b" containerID="e1b8ffe35b743e9fb2936cfde9fd5827826890a99d7b3047430eb11dab0e4a56" exitCode=0
Jul 06 17:46:24.908156 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:24.907715    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wh2vt"
Jul 06 17:46:24.908156 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:24.907725    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wh2vt" event={"ID":"bcaa5ab8-d120-4111-b1dd-a72d2997586b","Type":"ContainerDied","Data":"e1b8ffe35b743e9fb2936cfde9fd5827826890a99d7b3047430eb11dab0e4a56"}
Jul 06 17:46:24.908156 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:24.907802    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wh2vt" event={"ID":"bcaa5ab8-d120-4111-b1dd-a72d2997586b","Type":"ContainerDied","Data":"2483814c7590e5796343a0cbf45fef9223973b2d9cc9012ed6a6197f4f40baff"}
Jul 06 17:46:24.908156 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:24.907822    2570 scope.go:117] "RemoveContainer" containerID="e1b8ffe35b743e9fb2936cfde9fd5827826890a99d7b3047430eb11dab0e4a56"
Jul 06 17:46:24.917660 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:24.917641    2570 scope.go:117] "RemoveContainer" containerID="e1b8ffe35b743e9fb2936cfde9fd5827826890a99d7b3047430eb11dab0e4a56"
Jul 06 17:46:24.917950 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:46:24.917930    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1b8ffe35b743e9fb2936cfde9fd5827826890a99d7b3047430eb11dab0e4a56\": container with ID starting with e1b8ffe35b743e9fb2936cfde9fd5827826890a99d7b3047430eb11dab0e4a56 not found: ID does not exist" containerID="e1b8ffe35b743e9fb2936cfde9fd5827826890a99d7b3047430eb11dab0e4a56"
Jul 06 17:46:24.918005 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:24.917960    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1b8ffe35b743e9fb2936cfde9fd5827826890a99d7b3047430eb11dab0e4a56"} err="failed to get container status \"e1b8ffe35b743e9fb2936cfde9fd5827826890a99d7b3047430eb11dab0e4a56\": rpc error: code = NotFound desc = could not find container \"e1b8ffe35b743e9fb2936cfde9fd5827826890a99d7b3047430eb11dab0e4a56\": container with ID starting with e1b8ffe35b743e9fb2936cfde9fd5827826890a99d7b3047430eb11dab0e4a56 not found: ID does not exist"
Jul 06 17:46:24.929707 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:24.929674    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wh2vt"]
Jul 06 17:46:24.933563 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:24.933541    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wh2vt"]
Jul 06 17:46:25.973339 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:25.973294    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcaa5ab8-d120-4111-b1dd-a72d2997586b" path="/var/lib/kubelet/pods/bcaa5ab8-d120-4111-b1dd-a72d2997586b/volumes"
Jul 06 17:46:31.095781 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:31.095747    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-pflsd"
Jul 06 17:46:31.096186 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:31.095807    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-pflsd"
Jul 06 17:46:31.118482 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:31.118456    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-pflsd"
Jul 06 17:46:31.964778 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:31.964747    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-pflsd"
Jul 06 17:46:52.028301 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:52.028265    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kj9hd"]
Jul 06 17:46:52.028821 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:52.028543    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcaa5ab8-d120-4111-b1dd-a72d2997586b" containerName="registry-server"
Jul 06 17:46:52.028821 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:52.028554    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcaa5ab8-d120-4111-b1dd-a72d2997586b" containerName="registry-server"
Jul 06 17:46:52.028821 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:52.028635    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcaa5ab8-d120-4111-b1dd-a72d2997586b" containerName="registry-server"
Jul 06 17:46:52.036589 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:52.036559    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kj9hd"
Jul 06 17:46:52.040585 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:52.040560    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-blv5s\""
Jul 06 17:46:52.040718 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:52.040560    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 17:46:52.045292 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:52.045269    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kj9hd"]
Jul 06 17:46:52.194769 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:52.194735    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4bwc\" (UniqueName: \"kubernetes.io/projected/82ad259e-7475-4458-879e-ba2549a98951-kube-api-access-n4bwc\") pod \"dns-operator-controller-manager-864dd78c4c-kj9hd\" (UID: \"82ad259e-7475-4458-879e-ba2549a98951\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kj9hd"
Jul 06 17:46:52.295284 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:52.295193    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4bwc\" (UniqueName: \"kubernetes.io/projected/82ad259e-7475-4458-879e-ba2549a98951-kube-api-access-n4bwc\") pod \"dns-operator-controller-manager-864dd78c4c-kj9hd\" (UID: \"82ad259e-7475-4458-879e-ba2549a98951\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kj9hd"
Jul 06 17:46:52.306659 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:52.306629    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4bwc\" (UniqueName: \"kubernetes.io/projected/82ad259e-7475-4458-879e-ba2549a98951-kube-api-access-n4bwc\") pod \"dns-operator-controller-manager-864dd78c4c-kj9hd\" (UID: \"82ad259e-7475-4458-879e-ba2549a98951\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kj9hd"
Jul 06 17:46:52.347339 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:52.347308    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kj9hd"
Jul 06 17:46:52.485417 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:52.485383    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kj9hd"]
Jul 06 17:46:52.488966 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:46:52.488938    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ad259e_7475_4458_879e_ba2549a98951.slice/crio-ddb490f0d69749ffd7237f7bb6c1a8dac25c1793d72147558d8db1caa0835c7d WatchSource:0}: Error finding container ddb490f0d69749ffd7237f7bb6c1a8dac25c1793d72147558d8db1caa0835c7d: Status 404 returned error can't find the container with id ddb490f0d69749ffd7237f7bb6c1a8dac25c1793d72147558d8db1caa0835c7d
Jul 06 17:46:53.025436 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:53.025401    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kj9hd" event={"ID":"82ad259e-7475-4458-879e-ba2549a98951","Type":"ContainerStarted","Data":"ddb490f0d69749ffd7237f7bb6c1a8dac25c1793d72147558d8db1caa0835c7d"}
Jul 06 17:46:55.035031 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:55.034997    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kj9hd" event={"ID":"82ad259e-7475-4458-879e-ba2549a98951","Type":"ContainerStarted","Data":"95d1d96f2d3505229930f43ab89fce4a2b99f8b0a57bfbd620850242195aba42"}
Jul 06 17:46:55.035405 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:55.035138    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kj9hd"
Jul 06 17:46:55.053962 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:55.053919    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kj9hd" podStartSLOduration=1.021842692 podStartE2EDuration="3.053905345s" totalImagesPullingTime="2.032062653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:46:55.051938913 +0000 UTC m=+501.630139749" watchObservedRunningTime="2026-07-06 17:46:55.053905345 +0000 UTC m=+501.632106181"
Jul 06 17:46:55.504619 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:55.504578    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"]
Jul 06 17:46:55.507977 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:55.507954    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:46:55.510643 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:55.510617    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rd8v9\""
Jul 06 17:46:55.517606 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:55.517580    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"]
Jul 06 17:46:55.625241 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:55.625211    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgckm\" (UniqueName: \"kubernetes.io/projected/5303cb60-89ac-4b3e-937e-30824785a55b-kube-api-access-mgckm\") pod \"limitador-operator-controller-manager-859d7b78bd-rw8xp\" (UID: \"5303cb60-89ac-4b3e-937e-30824785a55b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:46:55.726222 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:55.726186    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgckm\" (UniqueName: \"kubernetes.io/projected/5303cb60-89ac-4b3e-937e-30824785a55b-kube-api-access-mgckm\") pod \"limitador-operator-controller-manager-859d7b78bd-rw8xp\" (UID: \"5303cb60-89ac-4b3e-937e-30824785a55b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:46:55.734737 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:55.734717    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgckm\" (UniqueName: \"kubernetes.io/projected/5303cb60-89ac-4b3e-937e-30824785a55b-kube-api-access-mgckm\") pod \"limitador-operator-controller-manager-859d7b78bd-rw8xp\" (UID: \"5303cb60-89ac-4b3e-937e-30824785a55b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:46:55.818407 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:55.818321    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:46:55.946812 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:55.946789    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"]
Jul 06 17:46:55.949391 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:46:55.949363    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5303cb60_89ac_4b3e_937e_30824785a55b.slice/crio-3d65695d64e436ac9ec714959d0c80b51ea2600d5a7687ba14f4dcbc61956bee WatchSource:0}: Error finding container 3d65695d64e436ac9ec714959d0c80b51ea2600d5a7687ba14f4dcbc61956bee: Status 404 returned error can't find the container with id 3d65695d64e436ac9ec714959d0c80b51ea2600d5a7687ba14f4dcbc61956bee
Jul 06 17:46:56.040093 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:56.040063    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp" event={"ID":"5303cb60-89ac-4b3e-937e-30824785a55b","Type":"ContainerStarted","Data":"3d65695d64e436ac9ec714959d0c80b51ea2600d5a7687ba14f4dcbc61956bee"}
Jul 06 17:46:58.052083 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:58.052044    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp" event={"ID":"5303cb60-89ac-4b3e-937e-30824785a55b","Type":"ContainerStarted","Data":"90d49793db0a95196252b3c592ffbda7fa691d237774d19d53ca4a3ed33ac442"}
Jul 06 17:46:58.052534 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:58.052150    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:46:58.071932 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:46:58.071851    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp" podStartSLOduration=1.179907801 podStartE2EDuration="3.071834972s" totalImagesPullingTime="1.891927171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:46:58.070285403 +0000 UTC m=+504.648486257" watchObservedRunningTime="2026-07-06 17:46:58.071834972 +0000 UTC m=+504.650035805"
Jul 06 17:47:00.280580 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:00.280548    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"]
Jul 06 17:47:00.283826 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:00.283809    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:00.286610 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:00.286588    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-82b8x\""
Jul 06 17:47:00.299140 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:00.299111    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"]
Jul 06 17:47:00.465385 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:00.465344    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7026ea37-85e4-4b9f-8a26-332b48df90f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2wsjc\" (UID: \"7026ea37-85e4-4b9f-8a26-332b48df90f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:00.465569 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:00.465468    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc79m\" (UniqueName: \"kubernetes.io/projected/7026ea37-85e4-4b9f-8a26-332b48df90f6-kube-api-access-zc79m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2wsjc\" (UID: \"7026ea37-85e4-4b9f-8a26-332b48df90f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:00.566402 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:00.566324    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7026ea37-85e4-4b9f-8a26-332b48df90f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2wsjc\" (UID: \"7026ea37-85e4-4b9f-8a26-332b48df90f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:00.566402 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:00.566395    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc79m\" (UniqueName: \"kubernetes.io/projected/7026ea37-85e4-4b9f-8a26-332b48df90f6-kube-api-access-zc79m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2wsjc\" (UID: \"7026ea37-85e4-4b9f-8a26-332b48df90f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:00.566784 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:00.566767    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7026ea37-85e4-4b9f-8a26-332b48df90f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2wsjc\" (UID: \"7026ea37-85e4-4b9f-8a26-332b48df90f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:00.577519 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:00.577500    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc79m\" (UniqueName: \"kubernetes.io/projected/7026ea37-85e4-4b9f-8a26-332b48df90f6-kube-api-access-zc79m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2wsjc\" (UID: \"7026ea37-85e4-4b9f-8a26-332b48df90f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:00.593513 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:00.593488    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:00.728653 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:00.728577    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"]
Jul 06 17:47:00.730848 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:47:00.730807    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7026ea37_85e4_4b9f_8a26_332b48df90f6.slice/crio-0611996824cbb2ea5bac32313d97bf21e6c3a415fdf66a78ea8536984b8f0ace WatchSource:0}: Error finding container 0611996824cbb2ea5bac32313d97bf21e6c3a415fdf66a78ea8536984b8f0ace: Status 404 returned error can't find the container with id 0611996824cbb2ea5bac32313d97bf21e6c3a415fdf66a78ea8536984b8f0ace
Jul 06 17:47:01.066621 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:01.066581    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc" event={"ID":"7026ea37-85e4-4b9f-8a26-332b48df90f6","Type":"ContainerStarted","Data":"0611996824cbb2ea5bac32313d97bf21e6c3a415fdf66a78ea8536984b8f0ace"}
Jul 06 17:47:03.595525 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:03.595490    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wlz98"]
Jul 06 17:47:03.599086 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:03.599050    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wlz98"
Jul 06 17:47:03.601980 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:03.601957    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-t9st4\""
Jul 06 17:47:03.608801 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:03.608764    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wlz98"]
Jul 06 17:47:03.693008 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:03.692967    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rkzm\" (UniqueName: \"kubernetes.io/projected/e14869ad-13b2-4504-86d2-36ceaf54023a-kube-api-access-9rkzm\") pod \"authorino-operator-75cc8d5cb7-wlz98\" (UID: \"e14869ad-13b2-4504-86d2-36ceaf54023a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wlz98"
Jul 06 17:47:03.793990 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:03.793929    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rkzm\" (UniqueName: \"kubernetes.io/projected/e14869ad-13b2-4504-86d2-36ceaf54023a-kube-api-access-9rkzm\") pod \"authorino-operator-75cc8d5cb7-wlz98\" (UID: \"e14869ad-13b2-4504-86d2-36ceaf54023a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wlz98"
Jul 06 17:47:03.808069 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:03.808033    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rkzm\" (UniqueName: \"kubernetes.io/projected/e14869ad-13b2-4504-86d2-36ceaf54023a-kube-api-access-9rkzm\") pod \"authorino-operator-75cc8d5cb7-wlz98\" (UID: \"e14869ad-13b2-4504-86d2-36ceaf54023a\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wlz98"
Jul 06 17:47:03.912666 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:03.912574    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wlz98"
Jul 06 17:47:04.058784 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:04.058756    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wlz98"]
Jul 06 17:47:04.061562 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:47:04.061534    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14869ad_13b2_4504_86d2_36ceaf54023a.slice/crio-44cf32d1fecc76f7e7f50e54c03df6b4b3aaec0100ec7b412174a3ae1f8ea898 WatchSource:0}: Error finding container 44cf32d1fecc76f7e7f50e54c03df6b4b3aaec0100ec7b412174a3ae1f8ea898: Status 404 returned error can't find the container with id 44cf32d1fecc76f7e7f50e54c03df6b4b3aaec0100ec7b412174a3ae1f8ea898
Jul 06 17:47:04.082036 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:04.082006    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wlz98" event={"ID":"e14869ad-13b2-4504-86d2-36ceaf54023a","Type":"ContainerStarted","Data":"44cf32d1fecc76f7e7f50e54c03df6b4b3aaec0100ec7b412174a3ae1f8ea898"}
Jul 06 17:47:06.042599 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:06.042562    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kj9hd"
Jul 06 17:47:08.105874 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:08.105838    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc" event={"ID":"7026ea37-85e4-4b9f-8a26-332b48df90f6","Type":"ContainerStarted","Data":"a465b8e43a74dce230b91953b30301960b503b6b78780ebaaa8bf4e7e25ae083"}
Jul 06 17:47:08.106331 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:08.105936    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:08.107324 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:08.107303    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wlz98" event={"ID":"e14869ad-13b2-4504-86d2-36ceaf54023a","Type":"ContainerStarted","Data":"1164c9bf5d0ee3b08aa7ead2e4a875d9ba7e9d002b9366c298ddf91cf9ab2d32"}
Jul 06 17:47:08.107444 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:08.107429    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wlz98"
Jul 06 17:47:08.151006 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:08.150950    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc" podStartSLOduration=1.424629138 podStartE2EDuration="8.150933859s" totalImagesPullingTime="6.726304721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:47:08.149940567 +0000 UTC m=+514.728141403" watchObservedRunningTime="2026-07-06 17:47:08.150933859 +0000 UTC m=+514.729134694"
Jul 06 17:47:08.185126 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:08.185082    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wlz98" podStartSLOduration=1.792402069 podStartE2EDuration="5.185065492s" totalImagesPullingTime="3.392663423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:47:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:47:08.184032221 +0000 UTC m=+514.762233068" watchObservedRunningTime="2026-07-06 17:47:08.185065492 +0000 UTC m=+514.763266327"
Jul 06 17:47:09.059110 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:09.059076    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:47:19.114736 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:19.114706    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wlz98"
Jul 06 17:47:19.115095 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:19.114780    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:20.847482 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.847440    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"]
Jul 06 17:47:20.847914 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.847649    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc" podUID="7026ea37-85e4-4b9f-8a26-332b48df90f6" containerName="manager" containerID="cri-o://a465b8e43a74dce230b91953b30301960b503b6b78780ebaaa8bf4e7e25ae083" gracePeriod=2
Jul 06 17:47:20.849152 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.849131    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"]
Jul 06 17:47:20.852755 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.852736    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"
Jul 06 17:47:20.856932 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.856758    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"]
Jul 06 17:47:20.856932 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:20.856809    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2wsjc\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="7026ea37-85e4-4b9f-8a26-332b48df90f6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:20.862482 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.862455    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"]
Jul 06 17:47:20.873856 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.873829    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"]
Jul 06 17:47:20.874185 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.874172    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7026ea37-85e4-4b9f-8a26-332b48df90f6" containerName="manager"
Jul 06 17:47:20.874185 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.874186    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7026ea37-85e4-4b9f-8a26-332b48df90f6" containerName="manager"
Jul 06 17:47:20.874311 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.874247    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7026ea37-85e4-4b9f-8a26-332b48df90f6" containerName="manager"
Jul 06 17:47:20.877253 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.877233    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"]
Jul 06 17:47:20.877404 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.877382    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"
Jul 06 17:47:20.877464 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.877395    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp" podUID="5303cb60-89ac-4b3e-937e-30824785a55b" containerName="manager" containerID="cri-o://90d49793db0a95196252b3c592ffbda7fa691d237774d19d53ca4a3ed33ac442" gracePeriod=2
Jul 06 17:47:20.880496 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:20.880460    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2wsjc\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="7026ea37-85e4-4b9f-8a26-332b48df90f6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:20.890287 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.890254    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"]
Jul 06 17:47:20.893177 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.893147    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"]
Jul 06 17:47:20.907376 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.907350    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x64vs"]
Jul 06 17:47:20.907894 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.907876    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5303cb60-89ac-4b3e-937e-30824785a55b" containerName="manager"
Jul 06 17:47:20.907951 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.907897    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5303cb60-89ac-4b3e-937e-30824785a55b" containerName="manager"
Jul 06 17:47:20.908020 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.908008    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5303cb60-89ac-4b3e-937e-30824785a55b" containerName="manager"
Jul 06 17:47:20.911322 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.911305    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x64vs"
Jul 06 17:47:20.919767 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:20.919709    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rw8xp\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="5303cb60-89ac-4b3e-937e-30824785a55b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:47:20.922095 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:20.922066    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2wsjc\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="7026ea37-85e4-4b9f-8a26-332b48df90f6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:20.922221 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.922196    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x64vs"]
Jul 06 17:47:20.930365 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.930342    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9px7\" (UniqueName: \"kubernetes.io/projected/7b003837-9151-4a16-af41-1d91e0a95d6a-kube-api-access-p9px7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rrcz2\" (UID: \"7b003837-9151-4a16-af41-1d91e0a95d6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"
Jul 06 17:47:20.930458 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.930396    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn468\" (UniqueName: \"kubernetes.io/projected/179c65c6-fbc5-4c1e-bb65-0e446418eeac-kube-api-access-bn468\") pod \"limitador-operator-controller-manager-859d7b78bd-x64vs\" (UID: \"179c65c6-fbc5-4c1e-bb65-0e446418eeac\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x64vs"
Jul 06 17:47:20.930458 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.930423    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77b2dd33-f34b-4c8b-962d-099babc6c120-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lt79w\" (UID: \"77b2dd33-f34b-4c8b-962d-099babc6c120\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"
Jul 06 17:47:20.930458 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.930453    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4tm7\" (UniqueName: \"kubernetes.io/projected/77b2dd33-f34b-4c8b-962d-099babc6c120-kube-api-access-x4tm7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lt79w\" (UID: \"77b2dd33-f34b-4c8b-962d-099babc6c120\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"
Jul 06 17:47:20.930601 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:20.930477    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b003837-9151-4a16-af41-1d91e0a95d6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rrcz2\" (UID: \"7b003837-9151-4a16-af41-1d91e0a95d6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"
Jul 06 17:47:21.031547 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.031232    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9px7\" (UniqueName: \"kubernetes.io/projected/7b003837-9151-4a16-af41-1d91e0a95d6a-kube-api-access-p9px7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rrcz2\" (UID: \"7b003837-9151-4a16-af41-1d91e0a95d6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"
Jul 06 17:47:21.031547 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.031294    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn468\" (UniqueName: \"kubernetes.io/projected/179c65c6-fbc5-4c1e-bb65-0e446418eeac-kube-api-access-bn468\") pod \"limitador-operator-controller-manager-859d7b78bd-x64vs\" (UID: \"179c65c6-fbc5-4c1e-bb65-0e446418eeac\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x64vs"
Jul 06 17:47:21.031547 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.031322    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77b2dd33-f34b-4c8b-962d-099babc6c120-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lt79w\" (UID: \"77b2dd33-f34b-4c8b-962d-099babc6c120\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"
Jul 06 17:47:21.031547 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.031350    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4tm7\" (UniqueName: \"kubernetes.io/projected/77b2dd33-f34b-4c8b-962d-099babc6c120-kube-api-access-x4tm7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lt79w\" (UID: \"77b2dd33-f34b-4c8b-962d-099babc6c120\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"
Jul 06 17:47:21.031547 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.031376    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b003837-9151-4a16-af41-1d91e0a95d6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rrcz2\" (UID: \"7b003837-9151-4a16-af41-1d91e0a95d6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"
Jul 06 17:47:21.031959 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.031780    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b003837-9151-4a16-af41-1d91e0a95d6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rrcz2\" (UID: \"7b003837-9151-4a16-af41-1d91e0a95d6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"
Jul 06 17:47:21.031959 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.031829    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77b2dd33-f34b-4c8b-962d-099babc6c120-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lt79w\" (UID: \"77b2dd33-f34b-4c8b-962d-099babc6c120\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"
Jul 06 17:47:21.042508 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.042469    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9px7\" (UniqueName: \"kubernetes.io/projected/7b003837-9151-4a16-af41-1d91e0a95d6a-kube-api-access-p9px7\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rrcz2\" (UID: \"7b003837-9151-4a16-af41-1d91e0a95d6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"
Jul 06 17:47:21.042641 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.042477    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4tm7\" (UniqueName: \"kubernetes.io/projected/77b2dd33-f34b-4c8b-962d-099babc6c120-kube-api-access-x4tm7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lt79w\" (UID: \"77b2dd33-f34b-4c8b-962d-099babc6c120\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"
Jul 06 17:47:21.042641 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.042558    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn468\" (UniqueName: \"kubernetes.io/projected/179c65c6-fbc5-4c1e-bb65-0e446418eeac-kube-api-access-bn468\") pod \"limitador-operator-controller-manager-859d7b78bd-x64vs\" (UID: \"179c65c6-fbc5-4c1e-bb65-0e446418eeac\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x64vs"
Jul 06 17:47:21.119977 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.119951    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:21.121962 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.121940    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:47:21.122354 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:21.122319    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rw8xp\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="5303cb60-89ac-4b3e-937e-30824785a55b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:47:21.124531 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:21.124504    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2wsjc\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="7026ea37-85e4-4b9f-8a26-332b48df90f6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:21.126457 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:21.126432    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rw8xp\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="5303cb60-89ac-4b3e-937e-30824785a55b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:47:21.128508 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:21.128483    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2wsjc\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="7026ea37-85e4-4b9f-8a26-332b48df90f6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:21.131749 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.131733    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7026ea37-85e4-4b9f-8a26-332b48df90f6-extensions-socket-volume\") pod \"7026ea37-85e4-4b9f-8a26-332b48df90f6\" (UID: \"7026ea37-85e4-4b9f-8a26-332b48df90f6\") "
Jul 06 17:47:21.131842 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.131831    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc79m\" (UniqueName: \"kubernetes.io/projected/7026ea37-85e4-4b9f-8a26-332b48df90f6-kube-api-access-zc79m\") pod \"7026ea37-85e4-4b9f-8a26-332b48df90f6\" (UID: \"7026ea37-85e4-4b9f-8a26-332b48df90f6\") "
Jul 06 17:47:21.132176 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.132147    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7026ea37-85e4-4b9f-8a26-332b48df90f6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7026ea37-85e4-4b9f-8a26-332b48df90f6" (UID: "7026ea37-85e4-4b9f-8a26-332b48df90f6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:47:21.133709 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.133676    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7026ea37-85e4-4b9f-8a26-332b48df90f6-kube-api-access-zc79m" (OuterVolumeSpecName: "kube-api-access-zc79m") pod "7026ea37-85e4-4b9f-8a26-332b48df90f6" (UID: "7026ea37-85e4-4b9f-8a26-332b48df90f6"). InnerVolumeSpecName "kube-api-access-zc79m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:47:21.168024 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.167987    2570 generic.go:356] "Generic (PLEG): container finished" podID="5303cb60-89ac-4b3e-937e-30824785a55b" containerID="90d49793db0a95196252b3c592ffbda7fa691d237774d19d53ca4a3ed33ac442" exitCode=0
Jul 06 17:47:21.168191 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.168031    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:47:21.168191 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.168075    2570 scope.go:117] "RemoveContainer" containerID="90d49793db0a95196252b3c592ffbda7fa691d237774d19d53ca4a3ed33ac442"
Jul 06 17:47:21.169448 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.169428    2570 generic.go:356] "Generic (PLEG): container finished" podID="7026ea37-85e4-4b9f-8a26-332b48df90f6" containerID="a465b8e43a74dce230b91953b30301960b503b6b78780ebaaa8bf4e7e25ae083" exitCode=0
Jul 06 17:47:21.169546 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.169477    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:21.170522 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:21.170502    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rw8xp\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="5303cb60-89ac-4b3e-937e-30824785a55b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:47:21.174470 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:21.174446    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2wsjc\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="7026ea37-85e4-4b9f-8a26-332b48df90f6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:21.176687 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:21.176665    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rw8xp\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="5303cb60-89ac-4b3e-937e-30824785a55b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:47:21.178743 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:21.178718    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2wsjc\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="7026ea37-85e4-4b9f-8a26-332b48df90f6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:21.179000 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.178987    2570 scope.go:117] "RemoveContainer" containerID="90d49793db0a95196252b3c592ffbda7fa691d237774d19d53ca4a3ed33ac442"
Jul 06 17:47:21.179302 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:21.179283    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90d49793db0a95196252b3c592ffbda7fa691d237774d19d53ca4a3ed33ac442\": container with ID starting with 90d49793db0a95196252b3c592ffbda7fa691d237774d19d53ca4a3ed33ac442 not found: ID does not exist" containerID="90d49793db0a95196252b3c592ffbda7fa691d237774d19d53ca4a3ed33ac442"
Jul 06 17:47:21.179400 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.179309    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90d49793db0a95196252b3c592ffbda7fa691d237774d19d53ca4a3ed33ac442"} err="failed to get container status \"90d49793db0a95196252b3c592ffbda7fa691d237774d19d53ca4a3ed33ac442\": rpc error: code = NotFound desc = could not find container \"90d49793db0a95196252b3c592ffbda7fa691d237774d19d53ca4a3ed33ac442\": container with ID starting with 90d49793db0a95196252b3c592ffbda7fa691d237774d19d53ca4a3ed33ac442 not found: ID does not exist"
Jul 06 17:47:21.179400 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.179331    2570 scope.go:117] "RemoveContainer" containerID="a465b8e43a74dce230b91953b30301960b503b6b78780ebaaa8bf4e7e25ae083"
Jul 06 17:47:21.182577 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:21.182555    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rw8xp\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="5303cb60-89ac-4b3e-937e-30824785a55b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:47:21.184646 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:21.184622    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2wsjc\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="7026ea37-85e4-4b9f-8a26-332b48df90f6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:21.187449 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.187433    2570 scope.go:117] "RemoveContainer" containerID="a465b8e43a74dce230b91953b30301960b503b6b78780ebaaa8bf4e7e25ae083"
Jul 06 17:47:21.187751 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:21.187730    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a465b8e43a74dce230b91953b30301960b503b6b78780ebaaa8bf4e7e25ae083\": container with ID starting with a465b8e43a74dce230b91953b30301960b503b6b78780ebaaa8bf4e7e25ae083 not found: ID does not exist" containerID="a465b8e43a74dce230b91953b30301960b503b6b78780ebaaa8bf4e7e25ae083"
Jul 06 17:47:21.187806 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.187759    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a465b8e43a74dce230b91953b30301960b503b6b78780ebaaa8bf4e7e25ae083"} err="failed to get container status \"a465b8e43a74dce230b91953b30301960b503b6b78780ebaaa8bf4e7e25ae083\": rpc error: code = NotFound desc = could not find container \"a465b8e43a74dce230b91953b30301960b503b6b78780ebaaa8bf4e7e25ae083\": container with ID starting with a465b8e43a74dce230b91953b30301960b503b6b78780ebaaa8bf4e7e25ae083 not found: ID does not exist"
Jul 06 17:47:21.232212 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.232178    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgckm\" (UniqueName: \"kubernetes.io/projected/5303cb60-89ac-4b3e-937e-30824785a55b-kube-api-access-mgckm\") pod \"5303cb60-89ac-4b3e-937e-30824785a55b\" (UID: \"5303cb60-89ac-4b3e-937e-30824785a55b\") "
Jul 06 17:47:21.232390 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.232377    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc79m\" (UniqueName: \"kubernetes.io/projected/7026ea37-85e4-4b9f-8a26-332b48df90f6-kube-api-access-zc79m\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:47:21.232460 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.232391    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7026ea37-85e4-4b9f-8a26-332b48df90f6-extensions-socket-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:47:21.234244 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.234217    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5303cb60-89ac-4b3e-937e-30824785a55b-kube-api-access-mgckm" (OuterVolumeSpecName: "kube-api-access-mgckm") pod "5303cb60-89ac-4b3e-937e-30824785a55b" (UID: "5303cb60-89ac-4b3e-937e-30824785a55b"). InnerVolumeSpecName "kube-api-access-mgckm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:47:21.290630 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.290589    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"
Jul 06 17:47:21.298180 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.298162    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"
Jul 06 17:47:21.306131 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.306102    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x64vs"
Jul 06 17:47:21.333638 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.333600    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgckm\" (UniqueName: \"kubernetes.io/projected/5303cb60-89ac-4b3e-937e-30824785a55b-kube-api-access-mgckm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:47:21.454190 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.454156    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"]
Jul 06 17:47:21.458406 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:47:21.458379    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b003837_9151_4a16_af41_1d91e0a95d6a.slice/crio-fac3a28f7681cc1d1529214d6be857265208d9d2e0d9d9432e554865e0ce0ffc WatchSource:0}: Error finding container fac3a28f7681cc1d1529214d6be857265208d9d2e0d9d9432e554865e0ce0ffc: Status 404 returned error can't find the container with id fac3a28f7681cc1d1529214d6be857265208d9d2e0d9d9432e554865e0ce0ffc
Jul 06 17:47:21.471382 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.471357    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"]
Jul 06 17:47:21.477338 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:47:21.477207    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b2dd33_f34b_4c8b_962d_099babc6c120.slice/crio-fd97575bf81df1ac71809415130a43df89aa51fad26e8035090ca28d91166570 WatchSource:0}: Error finding container fd97575bf81df1ac71809415130a43df89aa51fad26e8035090ca28d91166570: Status 404 returned error can't find the container with id fd97575bf81df1ac71809415130a43df89aa51fad26e8035090ca28d91166570
Jul 06 17:47:21.480632 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:21.480598    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2wsjc\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="7026ea37-85e4-4b9f-8a26-332b48df90f6" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsjc"
Jul 06 17:47:21.482856 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:21.482832    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rw8xp\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="5303cb60-89ac-4b3e-937e-30824785a55b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rw8xp"
Jul 06 17:47:21.487048 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.487023    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x64vs"]
Jul 06 17:47:21.499538 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:47:21.499511    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod179c65c6_fbc5_4c1e_bb65_0e446418eeac.slice/crio-962db5b9b183530bb404d193e3ccbb183dba9ceb6723b92112229d776db80d15 WatchSource:0}: Error finding container 962db5b9b183530bb404d193e3ccbb183dba9ceb6723b92112229d776db80d15: Status 404 returned error can't find the container with id 962db5b9b183530bb404d193e3ccbb183dba9ceb6723b92112229d776db80d15
Jul 06 17:47:21.973654 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.973614    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5303cb60-89ac-4b3e-937e-30824785a55b" path="/var/lib/kubelet/pods/5303cb60-89ac-4b3e-937e-30824785a55b/volumes"
Jul 06 17:47:21.974200 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:21.974179    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7026ea37-85e4-4b9f-8a26-332b48df90f6" path="/var/lib/kubelet/pods/7026ea37-85e4-4b9f-8a26-332b48df90f6/volumes"
Jul 06 17:47:22.178049 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:22.177959    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x64vs" event={"ID":"179c65c6-fbc5-4c1e-bb65-0e446418eeac","Type":"ContainerStarted","Data":"ea2cdb674c89fd9279acd96f5f1ffbf8053da4031eaec547f09c54852bdf68a5"}
Jul 06 17:47:22.178049 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:22.178013    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x64vs" event={"ID":"179c65c6-fbc5-4c1e-bb65-0e446418eeac","Type":"ContainerStarted","Data":"962db5b9b183530bb404d193e3ccbb183dba9ceb6723b92112229d776db80d15"}
Jul 06 17:47:22.178273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:22.178096    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x64vs"
Jul 06 17:47:22.179685 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:22.179663    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2" event={"ID":"7b003837-9151-4a16-af41-1d91e0a95d6a","Type":"ContainerStarted","Data":"9fc15ed0267b2f75ced4a9aa5e985e437f475a3c0d56cd50c3df9a4c58d93742"}
Jul 06 17:47:22.179851 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:22.179711    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2" event={"ID":"7b003837-9151-4a16-af41-1d91e0a95d6a","Type":"ContainerStarted","Data":"fac3a28f7681cc1d1529214d6be857265208d9d2e0d9d9432e554865e0ce0ffc"}
Jul 06 17:47:22.179851 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:22.179775    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"
Jul 06 17:47:22.181271 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:22.181251    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w" event={"ID":"77b2dd33-f34b-4c8b-962d-099babc6c120","Type":"ContainerStarted","Data":"1dccd1505a557d74a10c037d018277d269ebc36a10fbfc77c0dfa6787382e7f0"}
Jul 06 17:47:22.181389 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:22.181283    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w" event={"ID":"77b2dd33-f34b-4c8b-962d-099babc6c120","Type":"ContainerStarted","Data":"fd97575bf81df1ac71809415130a43df89aa51fad26e8035090ca28d91166570"}
Jul 06 17:47:22.181389 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:22.181361    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"
Jul 06 17:47:22.195516 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:22.195460    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x64vs" podStartSLOduration=2.195443057 podStartE2EDuration="2.195443057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:47:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:47:22.194905466 +0000 UTC m=+528.773106307" watchObservedRunningTime="2026-07-06 17:47:22.195443057 +0000 UTC m=+528.773643885"
Jul 06 17:47:22.219668 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:22.219612    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2" podStartSLOduration=2.219596057 podStartE2EDuration="2.219596057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:47:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:47:22.218385886 +0000 UTC m=+528.796586732" watchObservedRunningTime="2026-07-06 17:47:22.219596057 +0000 UTC m=+528.797796892"
Jul 06 17:47:22.236645 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:22.236588    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w" podStartSLOduration=2.236571897 podStartE2EDuration="2.236571897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:47:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:47:22.235785954 +0000 UTC m=+528.813986790" watchObservedRunningTime="2026-07-06 17:47:22.236571897 +0000 UTC m=+528.814772732"
Jul 06 17:47:33.188718 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:33.188626    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-x64vs"
Jul 06 17:47:33.189134 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:33.188822    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"
Jul 06 17:47:33.189134 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:33.188880    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"
Jul 06 17:47:33.277502 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:33.277469    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"]
Jul 06 17:47:33.277754 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:33.277731    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w" podUID="77b2dd33-f34b-4c8b-962d-099babc6c120" containerName="manager" containerID="cri-o://1dccd1505a557d74a10c037d018277d269ebc36a10fbfc77c0dfa6787382e7f0" gracePeriod=10
Jul 06 17:47:33.519222 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:33.519196    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"
Jul 06 17:47:33.635280 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:33.635248    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77b2dd33-f34b-4c8b-962d-099babc6c120-extensions-socket-volume\") pod \"77b2dd33-f34b-4c8b-962d-099babc6c120\" (UID: \"77b2dd33-f34b-4c8b-962d-099babc6c120\") "
Jul 06 17:47:33.635456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:33.635332    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4tm7\" (UniqueName: \"kubernetes.io/projected/77b2dd33-f34b-4c8b-962d-099babc6c120-kube-api-access-x4tm7\") pod \"77b2dd33-f34b-4c8b-962d-099babc6c120\" (UID: \"77b2dd33-f34b-4c8b-962d-099babc6c120\") "
Jul 06 17:47:33.635675 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:33.635648    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b2dd33-f34b-4c8b-962d-099babc6c120-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "77b2dd33-f34b-4c8b-962d-099babc6c120" (UID: "77b2dd33-f34b-4c8b-962d-099babc6c120"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:47:33.637287 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:33.637268    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b2dd33-f34b-4c8b-962d-099babc6c120-kube-api-access-x4tm7" (OuterVolumeSpecName: "kube-api-access-x4tm7") pod "77b2dd33-f34b-4c8b-962d-099babc6c120" (UID: "77b2dd33-f34b-4c8b-962d-099babc6c120"). InnerVolumeSpecName "kube-api-access-x4tm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:47:33.735989 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:33.735898    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77b2dd33-f34b-4c8b-962d-099babc6c120-extensions-socket-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:47:33.735989 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:33.735938    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4tm7\" (UniqueName: \"kubernetes.io/projected/77b2dd33-f34b-4c8b-962d-099babc6c120-kube-api-access-x4tm7\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:47:34.236847 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:34.236811    2570 generic.go:356] "Generic (PLEG): container finished" podID="77b2dd33-f34b-4c8b-962d-099babc6c120" containerID="1dccd1505a557d74a10c037d018277d269ebc36a10fbfc77c0dfa6787382e7f0" exitCode=0
Jul 06 17:47:34.237282 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:34.236857    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"
Jul 06 17:47:34.237282 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:34.236858    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w" event={"ID":"77b2dd33-f34b-4c8b-962d-099babc6c120","Type":"ContainerDied","Data":"1dccd1505a557d74a10c037d018277d269ebc36a10fbfc77c0dfa6787382e7f0"}
Jul 06 17:47:34.237282 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:34.236911    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w" event={"ID":"77b2dd33-f34b-4c8b-962d-099babc6c120","Type":"ContainerDied","Data":"fd97575bf81df1ac71809415130a43df89aa51fad26e8035090ca28d91166570"}
Jul 06 17:47:34.237282 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:34.236940    2570 scope.go:117] "RemoveContainer" containerID="1dccd1505a557d74a10c037d018277d269ebc36a10fbfc77c0dfa6787382e7f0"
Jul 06 17:47:34.245244 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:34.245223    2570 scope.go:117] "RemoveContainer" containerID="1dccd1505a557d74a10c037d018277d269ebc36a10fbfc77c0dfa6787382e7f0"
Jul 06 17:47:34.245513 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:34.245495    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dccd1505a557d74a10c037d018277d269ebc36a10fbfc77c0dfa6787382e7f0\": container with ID starting with 1dccd1505a557d74a10c037d018277d269ebc36a10fbfc77c0dfa6787382e7f0 not found: ID does not exist" containerID="1dccd1505a557d74a10c037d018277d269ebc36a10fbfc77c0dfa6787382e7f0"
Jul 06 17:47:34.245560 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:34.245521    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dccd1505a557d74a10c037d018277d269ebc36a10fbfc77c0dfa6787382e7f0"} err="failed to get container status \"1dccd1505a557d74a10c037d018277d269ebc36a10fbfc77c0dfa6787382e7f0\": rpc error: code = NotFound desc = could not find container \"1dccd1505a557d74a10c037d018277d269ebc36a10fbfc77c0dfa6787382e7f0\": container with ID starting with 1dccd1505a557d74a10c037d018277d269ebc36a10fbfc77c0dfa6787382e7f0 not found: ID does not exist"
Jul 06 17:47:34.279169 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:34.279138    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"]
Jul 06 17:47:34.294931 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:34.294906    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lt79w"]
Jul 06 17:47:35.974330 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:35.974291    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77b2dd33-f34b-4c8b-962d-099babc6c120" path="/var/lib/kubelet/pods/77b2dd33-f34b-4c8b-962d-099babc6c120/volumes"
Jul 06 17:47:51.319810 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:51.319778    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"]
Jul 06 17:47:51.320290 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:51.320000    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2" podUID="7b003837-9151-4a16-af41-1d91e0a95d6a" containerName="manager" containerID="cri-o://9fc15ed0267b2f75ced4a9aa5e985e437f475a3c0d56cd50c3df9a4c58d93742" gracePeriod=10
Jul 06 17:47:51.566107 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:51.566076    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"
Jul 06 17:47:51.686122 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:51.686095    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b003837-9151-4a16-af41-1d91e0a95d6a-extensions-socket-volume\") pod \"7b003837-9151-4a16-af41-1d91e0a95d6a\" (UID: \"7b003837-9151-4a16-af41-1d91e0a95d6a\") "
Jul 06 17:47:51.686277 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:51.686170    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9px7\" (UniqueName: \"kubernetes.io/projected/7b003837-9151-4a16-af41-1d91e0a95d6a-kube-api-access-p9px7\") pod \"7b003837-9151-4a16-af41-1d91e0a95d6a\" (UID: \"7b003837-9151-4a16-af41-1d91e0a95d6a\") "
Jul 06 17:47:51.686498 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:51.686476    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b003837-9151-4a16-af41-1d91e0a95d6a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7b003837-9151-4a16-af41-1d91e0a95d6a" (UID: "7b003837-9151-4a16-af41-1d91e0a95d6a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 17:47:51.688150 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:51.688128    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b003837-9151-4a16-af41-1d91e0a95d6a-kube-api-access-p9px7" (OuterVolumeSpecName: "kube-api-access-p9px7") pod "7b003837-9151-4a16-af41-1d91e0a95d6a" (UID: "7b003837-9151-4a16-af41-1d91e0a95d6a"). InnerVolumeSpecName "kube-api-access-p9px7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:47:51.787110 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:51.787080    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b003837-9151-4a16-af41-1d91e0a95d6a-extensions-socket-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:47:51.787110 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:51.787106    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9px7\" (UniqueName: \"kubernetes.io/projected/7b003837-9151-4a16-af41-1d91e0a95d6a-kube-api-access-p9px7\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:47:52.320549 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:52.320457    2570 generic.go:356] "Generic (PLEG): container finished" podID="7b003837-9151-4a16-af41-1d91e0a95d6a" containerID="9fc15ed0267b2f75ced4a9aa5e985e437f475a3c0d56cd50c3df9a4c58d93742" exitCode=0
Jul 06 17:47:52.320549 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:52.320496    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2" event={"ID":"7b003837-9151-4a16-af41-1d91e0a95d6a","Type":"ContainerDied","Data":"9fc15ed0267b2f75ced4a9aa5e985e437f475a3c0d56cd50c3df9a4c58d93742"}
Jul 06 17:47:52.320549 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:52.320504    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"
Jul 06 17:47:52.320549 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:52.320540    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2" event={"ID":"7b003837-9151-4a16-af41-1d91e0a95d6a","Type":"ContainerDied","Data":"fac3a28f7681cc1d1529214d6be857265208d9d2e0d9d9432e554865e0ce0ffc"}
Jul 06 17:47:52.321167 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:52.320565    2570 scope.go:117] "RemoveContainer" containerID="9fc15ed0267b2f75ced4a9aa5e985e437f475a3c0d56cd50c3df9a4c58d93742"
Jul 06 17:47:52.329034 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:52.329015    2570 scope.go:117] "RemoveContainer" containerID="9fc15ed0267b2f75ced4a9aa5e985e437f475a3c0d56cd50c3df9a4c58d93742"
Jul 06 17:47:52.329294 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:47:52.329267    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fc15ed0267b2f75ced4a9aa5e985e437f475a3c0d56cd50c3df9a4c58d93742\": container with ID starting with 9fc15ed0267b2f75ced4a9aa5e985e437f475a3c0d56cd50c3df9a4c58d93742 not found: ID does not exist" containerID="9fc15ed0267b2f75ced4a9aa5e985e437f475a3c0d56cd50c3df9a4c58d93742"
Jul 06 17:47:52.329394 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:52.329295    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fc15ed0267b2f75ced4a9aa5e985e437f475a3c0d56cd50c3df9a4c58d93742"} err="failed to get container status \"9fc15ed0267b2f75ced4a9aa5e985e437f475a3c0d56cd50c3df9a4c58d93742\": rpc error: code = NotFound desc = could not find container \"9fc15ed0267b2f75ced4a9aa5e985e437f475a3c0d56cd50c3df9a4c58d93742\": container with ID starting with 9fc15ed0267b2f75ced4a9aa5e985e437f475a3c0d56cd50c3df9a4c58d93742 not found: ID does not exist"
Jul 06 17:47:52.339058 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:52.339034    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"]
Jul 06 17:47:52.349290 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:52.349269    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rrcz2"]
Jul 06 17:47:53.973867 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:47:53.973833    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b003837-9151-4a16-af41-1d91e0a95d6a" path="/var/lib/kubelet/pods/7b003837-9151-4a16-af41-1d91e0a95d6a/volumes"
Jul 06 17:48:09.110396 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.110359    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z44lw"]
Jul 06 17:48:09.110853 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.110720    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77b2dd33-f34b-4c8b-962d-099babc6c120" containerName="manager"
Jul 06 17:48:09.110853 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.110735    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b2dd33-f34b-4c8b-962d-099babc6c120" containerName="manager"
Jul 06 17:48:09.110853 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.110752    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b003837-9151-4a16-af41-1d91e0a95d6a" containerName="manager"
Jul 06 17:48:09.110853 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.110758    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b003837-9151-4a16-af41-1d91e0a95d6a" containerName="manager"
Jul 06 17:48:09.110853 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.110805    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b003837-9151-4a16-af41-1d91e0a95d6a" containerName="manager"
Jul 06 17:48:09.110853 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.110814    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="77b2dd33-f34b-4c8b-962d-099babc6c120" containerName="manager"
Jul 06 17:48:09.113801 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.113778    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw"
Jul 06 17:48:09.116520 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.116501    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 17:48:09.116625 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.116527    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lp5dx\""
Jul 06 17:48:09.123838 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.123816    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z44lw"]
Jul 06 17:48:09.131786 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.131764    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c468aa7-bc1e-4708-98e3-1775c4b6b70c-config-file\") pod \"limitador-limitador-64c94fd64f-z44lw\" (UID: \"5c468aa7-bc1e-4708-98e3-1775c4b6b70c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw"
Jul 06 17:48:09.131875 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.131806    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb25f\" (UniqueName: \"kubernetes.io/projected/5c468aa7-bc1e-4708-98e3-1775c4b6b70c-kube-api-access-xb25f\") pod \"limitador-limitador-64c94fd64f-z44lw\" (UID: \"5c468aa7-bc1e-4708-98e3-1775c4b6b70c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw"
Jul 06 17:48:09.203857 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.203824    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z44lw"]
Jul 06 17:48:09.232830 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.232796    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c468aa7-bc1e-4708-98e3-1775c4b6b70c-config-file\") pod \"limitador-limitador-64c94fd64f-z44lw\" (UID: \"5c468aa7-bc1e-4708-98e3-1775c4b6b70c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw"
Jul 06 17:48:09.232993 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.232849    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb25f\" (UniqueName: \"kubernetes.io/projected/5c468aa7-bc1e-4708-98e3-1775c4b6b70c-kube-api-access-xb25f\") pod \"limitador-limitador-64c94fd64f-z44lw\" (UID: \"5c468aa7-bc1e-4708-98e3-1775c4b6b70c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw"
Jul 06 17:48:09.233469 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.233450    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c468aa7-bc1e-4708-98e3-1775c4b6b70c-config-file\") pod \"limitador-limitador-64c94fd64f-z44lw\" (UID: \"5c468aa7-bc1e-4708-98e3-1775c4b6b70c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw"
Jul 06 17:48:09.241386 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.241360    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb25f\" (UniqueName: \"kubernetes.io/projected/5c468aa7-bc1e-4708-98e3-1775c4b6b70c-kube-api-access-xb25f\") pod \"limitador-limitador-64c94fd64f-z44lw\" (UID: \"5c468aa7-bc1e-4708-98e3-1775c4b6b70c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw"
Jul 06 17:48:09.418643 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.418565    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:48:09.422294 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.422273    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"
Jul 06 17:48:09.424416 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.424398    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw"
Jul 06 17:48:09.432667 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.432647    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:48:09.434997 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.434977    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gshnr\" (UniqueName: \"kubernetes.io/projected/4d77f544-1cef-46bb-8cfd-971dcebaac80-kube-api-access-gshnr\") pod \"limitador-limitador-54d6d988d5-pcxrg\" (UID: \"4d77f544-1cef-46bb-8cfd-971dcebaac80\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"
Jul 06 17:48:09.435095 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.435050    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d77f544-1cef-46bb-8cfd-971dcebaac80-config-file\") pod \"limitador-limitador-54d6d988d5-pcxrg\" (UID: \"4d77f544-1cef-46bb-8cfd-971dcebaac80\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"
Jul 06 17:48:09.446223 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.446202    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:48:09.536277 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.536246    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d77f544-1cef-46bb-8cfd-971dcebaac80-config-file\") pod \"limitador-limitador-54d6d988d5-pcxrg\" (UID: \"4d77f544-1cef-46bb-8cfd-971dcebaac80\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"
Jul 06 17:48:09.536429 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.536353    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gshnr\" (UniqueName: \"kubernetes.io/projected/4d77f544-1cef-46bb-8cfd-971dcebaac80-kube-api-access-gshnr\") pod \"limitador-limitador-54d6d988d5-pcxrg\" (UID: \"4d77f544-1cef-46bb-8cfd-971dcebaac80\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"
Jul 06 17:48:09.536857 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.536836    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d77f544-1cef-46bb-8cfd-971dcebaac80-config-file\") pod \"limitador-limitador-54d6d988d5-pcxrg\" (UID: \"4d77f544-1cef-46bb-8cfd-971dcebaac80\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"
Jul 06 17:48:09.545284 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.545262    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gshnr\" (UniqueName: \"kubernetes.io/projected/4d77f544-1cef-46bb-8cfd-971dcebaac80-kube-api-access-gshnr\") pod \"limitador-limitador-54d6d988d5-pcxrg\" (UID: \"4d77f544-1cef-46bb-8cfd-971dcebaac80\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"
Jul 06 17:48:09.572261 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.572220    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z44lw"]
Jul 06 17:48:09.574925 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:48:09.574895    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c468aa7_bc1e_4708_98e3_1775c4b6b70c.slice/crio-5891ae98a27b692779959e5098905ac1122dd845f21a59fe06412e64f5cef52b WatchSource:0}: Error finding container 5891ae98a27b692779959e5098905ac1122dd845f21a59fe06412e64f5cef52b: Status 404 returned error can't find the container with id 5891ae98a27b692779959e5098905ac1122dd845f21a59fe06412e64f5cef52b
Jul 06 17:48:09.733344 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.733317    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"
Jul 06 17:48:09.863046 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.862988    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:48:09.865262 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:48:09.865221    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d77f544_1cef_46bb_8cfd_971dcebaac80.slice/crio-8b0edd307afc68f48a164a5e2eef2ad317411245897f94a3b552506d6d0d7d5c WatchSource:0}: Error finding container 8b0edd307afc68f48a164a5e2eef2ad317411245897f94a3b552506d6d0d7d5c: Status 404 returned error can't find the container with id 8b0edd307afc68f48a164a5e2eef2ad317411245897f94a3b552506d6d0d7d5c
Jul 06 17:48:09.896709 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.896663    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-rbgps"]
Jul 06 17:48:09.901055 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.901030    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rbgps"
Jul 06 17:48:09.903480 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.903459    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-294km\""
Jul 06 17:48:09.906935 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.906917    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rbgps"]
Jul 06 17:48:09.940267 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:09.940233    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqjpp\" (UniqueName: \"kubernetes.io/projected/ad0b7bfb-604e-4ad4-8a84-627796d9b4bf-kube-api-access-fqjpp\") pod \"authorino-58cd955675-rbgps\" (UID: \"ad0b7bfb-604e-4ad4-8a84-627796d9b4bf\") " pod="kuadrant-system/authorino-58cd955675-rbgps"
Jul 06 17:48:10.041612 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:10.041535    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqjpp\" (UniqueName: \"kubernetes.io/projected/ad0b7bfb-604e-4ad4-8a84-627796d9b4bf-kube-api-access-fqjpp\") pod \"authorino-58cd955675-rbgps\" (UID: \"ad0b7bfb-604e-4ad4-8a84-627796d9b4bf\") " pod="kuadrant-system/authorino-58cd955675-rbgps"
Jul 06 17:48:10.050172 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:10.050148    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqjpp\" (UniqueName: \"kubernetes.io/projected/ad0b7bfb-604e-4ad4-8a84-627796d9b4bf-kube-api-access-fqjpp\") pod \"authorino-58cd955675-rbgps\" (UID: \"ad0b7bfb-604e-4ad4-8a84-627796d9b4bf\") " pod="kuadrant-system/authorino-58cd955675-rbgps"
Jul 06 17:48:10.211740 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:10.211685    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rbgps"
Jul 06 17:48:10.390130 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:10.390089    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rbgps"]
Jul 06 17:48:10.395379 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:48:10.395331    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad0b7bfb_604e_4ad4_8a84_627796d9b4bf.slice/crio-56f776c7fe2df62f7510897763db815129c213101bee342ef2235dcd7253694a WatchSource:0}: Error finding container 56f776c7fe2df62f7510897763db815129c213101bee342ef2235dcd7253694a: Status 404 returned error can't find the container with id 56f776c7fe2df62f7510897763db815129c213101bee342ef2235dcd7253694a
Jul 06 17:48:10.409988 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:10.409880    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pcxrg" event={"ID":"4d77f544-1cef-46bb-8cfd-971dcebaac80","Type":"ContainerStarted","Data":"8b0edd307afc68f48a164a5e2eef2ad317411245897f94a3b552506d6d0d7d5c"}
Jul 06 17:48:10.413194 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:10.413127    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw" event={"ID":"5c468aa7-bc1e-4708-98e3-1775c4b6b70c","Type":"ContainerStarted","Data":"5891ae98a27b692779959e5098905ac1122dd845f21a59fe06412e64f5cef52b"}
Jul 06 17:48:11.420120 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:11.420082    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rbgps" event={"ID":"ad0b7bfb-604e-4ad4-8a84-627796d9b4bf","Type":"ContainerStarted","Data":"56f776c7fe2df62f7510897763db815129c213101bee342ef2235dcd7253694a"}
Jul 06 17:48:14.461990 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:14.461959    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rbgps"]
Jul 06 17:48:15.444155 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:15.444120    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw" event={"ID":"5c468aa7-bc1e-4708-98e3-1775c4b6b70c","Type":"ContainerStarted","Data":"43ab5e8f0928e7075f5ad2e78a36b2e2ef8c63eb1810b80b70a80841bcf87616"}
Jul 06 17:48:15.444338 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:15.444219    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw"
Jul 06 17:48:15.445687 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:15.445660    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pcxrg" event={"ID":"4d77f544-1cef-46bb-8cfd-971dcebaac80","Type":"ContainerStarted","Data":"672fef2087f3609f15a97f42ba7e8934e1e358eca169d42041f6e5177425dd7d"}
Jul 06 17:48:15.445830 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:15.445714    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"
Jul 06 17:48:15.447088 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:15.447072    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rbgps" event={"ID":"ad0b7bfb-604e-4ad4-8a84-627796d9b4bf","Type":"ContainerStarted","Data":"70f462bad7fd04fe1c7f1b388e92454347a984289302a1c2f4432fdcec9a74b4"}
Jul 06 17:48:15.447174 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:15.447152    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-rbgps" podUID="ad0b7bfb-604e-4ad4-8a84-627796d9b4bf" containerName="authorino" containerID="cri-o://70f462bad7fd04fe1c7f1b388e92454347a984289302a1c2f4432fdcec9a74b4" gracePeriod=30
Jul 06 17:48:15.459535 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:15.459494    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw" podStartSLOduration=1.6725176419999999 podStartE2EDuration="6.45947732s" totalImagesPullingTime="4.786959678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:48:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:48:15.458671452 +0000 UTC m=+582.036872299" watchObservedRunningTime="2026-07-06 17:48:15.45947732 +0000 UTC m=+582.037678155"
Jul 06 17:48:15.476126 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:15.476084    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-pcxrg" podStartSLOduration=1.9801536419999999 podStartE2EDuration="6.476070849s" totalImagesPullingTime="4.495917207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:48:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:48:15.474050854 +0000 UTC m=+582.052251689" watchObservedRunningTime="2026-07-06 17:48:15.476070849 +0000 UTC m=+582.054271684"
Jul 06 17:48:15.488646 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:15.488607    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-rbgps" podStartSLOduration=2.458764447 podStartE2EDuration="6.488593783s" totalImagesPullingTime="4.029829336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:48:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:48:15.487175786 +0000 UTC m=+582.065376621" watchObservedRunningTime="2026-07-06 17:48:15.488593783 +0000 UTC m=+582.066794618"
Jul 06 17:48:15.696841 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:15.696785    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rbgps"
Jul 06 17:48:15.793326 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:15.793295    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqjpp\" (UniqueName: \"kubernetes.io/projected/ad0b7bfb-604e-4ad4-8a84-627796d9b4bf-kube-api-access-fqjpp\") pod \"ad0b7bfb-604e-4ad4-8a84-627796d9b4bf\" (UID: \"ad0b7bfb-604e-4ad4-8a84-627796d9b4bf\") "
Jul 06 17:48:15.795340 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:15.795317    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0b7bfb-604e-4ad4-8a84-627796d9b4bf-kube-api-access-fqjpp" (OuterVolumeSpecName: "kube-api-access-fqjpp") pod "ad0b7bfb-604e-4ad4-8a84-627796d9b4bf" (UID: "ad0b7bfb-604e-4ad4-8a84-627796d9b4bf"). InnerVolumeSpecName "kube-api-access-fqjpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:48:15.894238 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:15.894198    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqjpp\" (UniqueName: \"kubernetes.io/projected/ad0b7bfb-604e-4ad4-8a84-627796d9b4bf-kube-api-access-fqjpp\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:48:16.452317 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:16.452284    2570 generic.go:356] "Generic (PLEG): container finished" podID="ad0b7bfb-604e-4ad4-8a84-627796d9b4bf" containerID="70f462bad7fd04fe1c7f1b388e92454347a984289302a1c2f4432fdcec9a74b4" exitCode=0
Jul 06 17:48:16.452504 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:16.452328    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rbgps"
Jul 06 17:48:16.452504 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:16.452370    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rbgps" event={"ID":"ad0b7bfb-604e-4ad4-8a84-627796d9b4bf","Type":"ContainerDied","Data":"70f462bad7fd04fe1c7f1b388e92454347a984289302a1c2f4432fdcec9a74b4"}
Jul 06 17:48:16.452504 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:16.452418    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rbgps" event={"ID":"ad0b7bfb-604e-4ad4-8a84-627796d9b4bf","Type":"ContainerDied","Data":"56f776c7fe2df62f7510897763db815129c213101bee342ef2235dcd7253694a"}
Jul 06 17:48:16.452504 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:16.452440    2570 scope.go:117] "RemoveContainer" containerID="70f462bad7fd04fe1c7f1b388e92454347a984289302a1c2f4432fdcec9a74b4"
Jul 06 17:48:16.460936 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:16.460919    2570 scope.go:117] "RemoveContainer" containerID="70f462bad7fd04fe1c7f1b388e92454347a984289302a1c2f4432fdcec9a74b4"
Jul 06 17:48:16.461213 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:48:16.461194    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f462bad7fd04fe1c7f1b388e92454347a984289302a1c2f4432fdcec9a74b4\": container with ID starting with 70f462bad7fd04fe1c7f1b388e92454347a984289302a1c2f4432fdcec9a74b4 not found: ID does not exist" containerID="70f462bad7fd04fe1c7f1b388e92454347a984289302a1c2f4432fdcec9a74b4"
Jul 06 17:48:16.461264 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:16.461222    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f462bad7fd04fe1c7f1b388e92454347a984289302a1c2f4432fdcec9a74b4"} err="failed to get container status \"70f462bad7fd04fe1c7f1b388e92454347a984289302a1c2f4432fdcec9a74b4\": rpc error: code = NotFound desc = could not find container \"70f462bad7fd04fe1c7f1b388e92454347a984289302a1c2f4432fdcec9a74b4\": container with ID starting with 70f462bad7fd04fe1c7f1b388e92454347a984289302a1c2f4432fdcec9a74b4 not found: ID does not exist"
Jul 06 17:48:16.469998 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:16.469972    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rbgps"]
Jul 06 17:48:16.473273 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:16.473247    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-rbgps"]
Jul 06 17:48:17.974419 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:17.974385    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad0b7bfb-604e-4ad4-8a84-627796d9b4bf" path="/var/lib/kubelet/pods/ad0b7bfb-604e-4ad4-8a84-627796d9b4bf/volumes"
Jul 06 17:48:26.453664 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:26.453633    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"
Jul 06 17:48:26.454094 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:26.453823    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw"
Jul 06 17:48:26.508490 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:26.508458    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z44lw"]
Jul 06 17:48:26.508665 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:26.508626    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw" podUID="5c468aa7-bc1e-4708-98e3-1775c4b6b70c" containerName="limitador" containerID="cri-o://43ab5e8f0928e7075f5ad2e78a36b2e2ef8c63eb1810b80b70a80841bcf87616" gracePeriod=30
Jul 06 17:48:27.051854 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.051834    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw"
Jul 06 17:48:27.084975 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.084900    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c468aa7-bc1e-4708-98e3-1775c4b6b70c-config-file\") pod \"5c468aa7-bc1e-4708-98e3-1775c4b6b70c\" (UID: \"5c468aa7-bc1e-4708-98e3-1775c4b6b70c\") "
Jul 06 17:48:27.084975 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.084964    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xb25f\" (UniqueName: \"kubernetes.io/projected/5c468aa7-bc1e-4708-98e3-1775c4b6b70c-kube-api-access-xb25f\") pod \"5c468aa7-bc1e-4708-98e3-1775c4b6b70c\" (UID: \"5c468aa7-bc1e-4708-98e3-1775c4b6b70c\") "
Jul 06 17:48:27.085248 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.085226    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c468aa7-bc1e-4708-98e3-1775c4b6b70c-config-file" (OuterVolumeSpecName: "config-file") pod "5c468aa7-bc1e-4708-98e3-1775c4b6b70c" (UID: "5c468aa7-bc1e-4708-98e3-1775c4b6b70c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 17:48:27.085356 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.085330    2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5c468aa7-bc1e-4708-98e3-1775c4b6b70c-config-file\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:48:27.086929 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.086905    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c468aa7-bc1e-4708-98e3-1775c4b6b70c-kube-api-access-xb25f" (OuterVolumeSpecName: "kube-api-access-xb25f") pod "5c468aa7-bc1e-4708-98e3-1775c4b6b70c" (UID: "5c468aa7-bc1e-4708-98e3-1775c4b6b70c"). InnerVolumeSpecName "kube-api-access-xb25f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:48:27.186052 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.186011    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb25f\" (UniqueName: \"kubernetes.io/projected/5c468aa7-bc1e-4708-98e3-1775c4b6b70c-kube-api-access-xb25f\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:48:27.504491 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.504459    2570 generic.go:356] "Generic (PLEG): container finished" podID="5c468aa7-bc1e-4708-98e3-1775c4b6b70c" containerID="43ab5e8f0928e7075f5ad2e78a36b2e2ef8c63eb1810b80b70a80841bcf87616" exitCode=0
Jul 06 17:48:27.504884 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.504504    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw"
Jul 06 17:48:27.504884 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.504550    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw" event={"ID":"5c468aa7-bc1e-4708-98e3-1775c4b6b70c","Type":"ContainerDied","Data":"43ab5e8f0928e7075f5ad2e78a36b2e2ef8c63eb1810b80b70a80841bcf87616"}
Jul 06 17:48:27.504884 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.504596    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z44lw" event={"ID":"5c468aa7-bc1e-4708-98e3-1775c4b6b70c","Type":"ContainerDied","Data":"5891ae98a27b692779959e5098905ac1122dd845f21a59fe06412e64f5cef52b"}
Jul 06 17:48:27.504884 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.504618    2570 scope.go:117] "RemoveContainer" containerID="43ab5e8f0928e7075f5ad2e78a36b2e2ef8c63eb1810b80b70a80841bcf87616"
Jul 06 17:48:27.512988 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.512787    2570 scope.go:117] "RemoveContainer" containerID="43ab5e8f0928e7075f5ad2e78a36b2e2ef8c63eb1810b80b70a80841bcf87616"
Jul 06 17:48:27.513056 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:48:27.513043    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43ab5e8f0928e7075f5ad2e78a36b2e2ef8c63eb1810b80b70a80841bcf87616\": container with ID starting with 43ab5e8f0928e7075f5ad2e78a36b2e2ef8c63eb1810b80b70a80841bcf87616 not found: ID does not exist" containerID="43ab5e8f0928e7075f5ad2e78a36b2e2ef8c63eb1810b80b70a80841bcf87616"
Jul 06 17:48:27.513094 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.513067    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43ab5e8f0928e7075f5ad2e78a36b2e2ef8c63eb1810b80b70a80841bcf87616"} err="failed to get container status \"43ab5e8f0928e7075f5ad2e78a36b2e2ef8c63eb1810b80b70a80841bcf87616\": rpc error: code = NotFound desc = could not find container \"43ab5e8f0928e7075f5ad2e78a36b2e2ef8c63eb1810b80b70a80841bcf87616\": container with ID starting with 43ab5e8f0928e7075f5ad2e78a36b2e2ef8c63eb1810b80b70a80841bcf87616 not found: ID does not exist"
Jul 06 17:48:27.524772 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.524752    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z44lw"]
Jul 06 17:48:27.528231 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.528211    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z44lw"]
Jul 06 17:48:27.974316 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:27.974288    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c468aa7-bc1e-4708-98e3-1775c4b6b70c" path="/var/lib/kubelet/pods/5c468aa7-bc1e-4708-98e3-1775c4b6b70c/volumes"
Jul 06 17:48:28.726741 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.726706    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-62kdr"]
Jul 06 17:48:28.727204 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.727072    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c468aa7-bc1e-4708-98e3-1775c4b6b70c" containerName="limitador"
Jul 06 17:48:28.727204 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.727089    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c468aa7-bc1e-4708-98e3-1775c4b6b70c" containerName="limitador"
Jul 06 17:48:28.727204 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.727099    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0b7bfb-604e-4ad4-8a84-627796d9b4bf" containerName="authorino"
Jul 06 17:48:28.727204 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.727105    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0b7bfb-604e-4ad4-8a84-627796d9b4bf" containerName="authorino"
Jul 06 17:48:28.727204 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.727179    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c468aa7-bc1e-4708-98e3-1775c4b6b70c" containerName="limitador"
Jul 06 17:48:28.727204 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.727186    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad0b7bfb-604e-4ad4-8a84-627796d9b4bf" containerName="authorino"
Jul 06 17:48:28.730191 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.730167    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-62kdr"
Jul 06 17:48:28.732754 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.732733    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-h7h7w\""
Jul 06 17:48:28.732866 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.732741    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 06 17:48:28.737333 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.737274    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-62kdr"]
Jul 06 17:48:28.799489 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.799458    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c586af24-98f1-4c00-aab4-d430d5589e3e-data\") pod \"postgres-69fb4594cf-62kdr\" (UID: \"c586af24-98f1-4c00-aab4-d430d5589e3e\") " pod="opendatahub/postgres-69fb4594cf-62kdr"
Jul 06 17:48:28.799489 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.799490    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6984\" (UniqueName: \"kubernetes.io/projected/c586af24-98f1-4c00-aab4-d430d5589e3e-kube-api-access-g6984\") pod \"postgres-69fb4594cf-62kdr\" (UID: \"c586af24-98f1-4c00-aab4-d430d5589e3e\") " pod="opendatahub/postgres-69fb4594cf-62kdr"
Jul 06 17:48:28.900126 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.900094    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c586af24-98f1-4c00-aab4-d430d5589e3e-data\") pod \"postgres-69fb4594cf-62kdr\" (UID: \"c586af24-98f1-4c00-aab4-d430d5589e3e\") " pod="opendatahub/postgres-69fb4594cf-62kdr"
Jul 06 17:48:28.900126 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.900130    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6984\" (UniqueName: \"kubernetes.io/projected/c586af24-98f1-4c00-aab4-d430d5589e3e-kube-api-access-g6984\") pod \"postgres-69fb4594cf-62kdr\" (UID: \"c586af24-98f1-4c00-aab4-d430d5589e3e\") " pod="opendatahub/postgres-69fb4594cf-62kdr"
Jul 06 17:48:28.900545 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.900525    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c586af24-98f1-4c00-aab4-d430d5589e3e-data\") pod \"postgres-69fb4594cf-62kdr\" (UID: \"c586af24-98f1-4c00-aab4-d430d5589e3e\") " pod="opendatahub/postgres-69fb4594cf-62kdr"
Jul 06 17:48:28.908161 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:28.908137    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6984\" (UniqueName: \"kubernetes.io/projected/c586af24-98f1-4c00-aab4-d430d5589e3e-kube-api-access-g6984\") pod \"postgres-69fb4594cf-62kdr\" (UID: \"c586af24-98f1-4c00-aab4-d430d5589e3e\") " pod="opendatahub/postgres-69fb4594cf-62kdr"
Jul 06 17:48:29.042450 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:29.042370    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-62kdr"
Jul 06 17:48:29.173773 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:29.173746    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-62kdr"]
Jul 06 17:48:29.175366 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:48:29.175340    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc586af24_98f1_4c00_aab4_d430d5589e3e.slice/crio-b20a8bcbfb108b4acef900ad5de05eebf33f7cc1e158e9ebd4e70a3ba11219a6 WatchSource:0}: Error finding container b20a8bcbfb108b4acef900ad5de05eebf33f7cc1e158e9ebd4e70a3ba11219a6: Status 404 returned error can't find the container with id b20a8bcbfb108b4acef900ad5de05eebf33f7cc1e158e9ebd4e70a3ba11219a6
Jul 06 17:48:29.515116 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:29.515078    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-62kdr" event={"ID":"c586af24-98f1-4c00-aab4-d430d5589e3e","Type":"ContainerStarted","Data":"b20a8bcbfb108b4acef900ad5de05eebf33f7cc1e158e9ebd4e70a3ba11219a6"}
Jul 06 17:48:33.859760 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:33.859728    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 17:48:33.860189 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:33.860172    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 17:48:33.917456 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:33.917434    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 06 17:48:34.545363 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:34.545329    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-62kdr" event={"ID":"c586af24-98f1-4c00-aab4-d430d5589e3e","Type":"ContainerStarted","Data":"aa27f3fb0b290e45e22838426143efdecf9f752d82b1b1ad9f39abf1f584cecc"}
Jul 06 17:48:34.545555 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:34.545435    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-62kdr"
Jul 06 17:48:34.561730 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:34.561615    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-62kdr" podStartSLOduration=1.824233453 podStartE2EDuration="6.561599361s" totalImagesPullingTime="4.737365908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:48:34.560226556 +0000 UTC m=+601.138427392" watchObservedRunningTime="2026-07-06 17:48:34.561599361 +0000 UTC m=+601.139800244"
Jul 06 17:48:40.579785 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:40.579740    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-62kdr"
Jul 06 17:48:41.127783 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.127744    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-shqrc"]
Jul 06 17:48:41.132975 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.132944    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-shqrc"
Jul 06 17:48:41.135750 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.135679    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-294km\""
Jul 06 17:48:41.139609 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.139586    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-shqrc"]
Jul 06 17:48:41.208894 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.208868    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp6t8\" (UniqueName: \"kubernetes.io/projected/e2abb4c4-ed38-49cd-9a94-26dff3dbfef2-kube-api-access-wp6t8\") pod \"authorino-5d4b67c446-shqrc\" (UID: \"e2abb4c4-ed38-49cd-9a94-26dff3dbfef2\") " pod="kuadrant-system/authorino-5d4b67c446-shqrc"
Jul 06 17:48:41.310365 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.310338    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp6t8\" (UniqueName: \"kubernetes.io/projected/e2abb4c4-ed38-49cd-9a94-26dff3dbfef2-kube-api-access-wp6t8\") pod \"authorino-5d4b67c446-shqrc\" (UID: \"e2abb4c4-ed38-49cd-9a94-26dff3dbfef2\") " pod="kuadrant-system/authorino-5d4b67c446-shqrc"
Jul 06 17:48:41.318439 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.318413    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp6t8\" (UniqueName: \"kubernetes.io/projected/e2abb4c4-ed38-49cd-9a94-26dff3dbfef2-kube-api-access-wp6t8\") pod \"authorino-5d4b67c446-shqrc\" (UID: \"e2abb4c4-ed38-49cd-9a94-26dff3dbfef2\") " pod="kuadrant-system/authorino-5d4b67c446-shqrc"
Jul 06 17:48:41.379714 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.379621    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-shqrc"]
Jul 06 17:48:41.379869 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.379857    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-shqrc"
Jul 06 17:48:41.405844 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.405814    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57b46f5fd5-hpptq"]
Jul 06 17:48:41.410367 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.410345    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b46f5fd5-hpptq"
Jul 06 17:48:41.413330 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.413307    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 17:48:41.419604 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.419581    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57b46f5fd5-hpptq"]
Jul 06 17:48:41.511938 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.511909    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzznw\" (UniqueName: \"kubernetes.io/projected/ea141b19-7397-4fb9-9727-790dba9008b6-kube-api-access-mzznw\") pod \"authorino-57b46f5fd5-hpptq\" (UID: \"ea141b19-7397-4fb9-9727-790dba9008b6\") " pod="kuadrant-system/authorino-57b46f5fd5-hpptq"
Jul 06 17:48:41.512095 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.511990    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea141b19-7397-4fb9-9727-790dba9008b6-tls-cert\") pod \"authorino-57b46f5fd5-hpptq\" (UID: \"ea141b19-7397-4fb9-9727-790dba9008b6\") " pod="kuadrant-system/authorino-57b46f5fd5-hpptq"
Jul 06 17:48:41.516721 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.516680    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-shqrc"]
Jul 06 17:48:41.519765 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:48:41.519734    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2abb4c4_ed38_49cd_9a94_26dff3dbfef2.slice/crio-024319b3c33c7fd625435ac9cb28f98307c6afd84d3ee7ee47d0557212d8ae13 WatchSource:0}: Error finding container 024319b3c33c7fd625435ac9cb28f98307c6afd84d3ee7ee47d0557212d8ae13: Status 404 returned error can't find the container with id 024319b3c33c7fd625435ac9cb28f98307c6afd84d3ee7ee47d0557212d8ae13
Jul 06 17:48:41.578802 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.578768    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-shqrc" event={"ID":"e2abb4c4-ed38-49cd-9a94-26dff3dbfef2","Type":"ContainerStarted","Data":"024319b3c33c7fd625435ac9cb28f98307c6afd84d3ee7ee47d0557212d8ae13"}
Jul 06 17:48:41.612910 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.612884    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea141b19-7397-4fb9-9727-790dba9008b6-tls-cert\") pod \"authorino-57b46f5fd5-hpptq\" (UID: \"ea141b19-7397-4fb9-9727-790dba9008b6\") " pod="kuadrant-system/authorino-57b46f5fd5-hpptq"
Jul 06 17:48:41.613210 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.612944    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzznw\" (UniqueName: \"kubernetes.io/projected/ea141b19-7397-4fb9-9727-790dba9008b6-kube-api-access-mzznw\") pod \"authorino-57b46f5fd5-hpptq\" (UID: \"ea141b19-7397-4fb9-9727-790dba9008b6\") " pod="kuadrant-system/authorino-57b46f5fd5-hpptq"
Jul 06 17:48:41.615230 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.615206    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea141b19-7397-4fb9-9727-790dba9008b6-tls-cert\") pod \"authorino-57b46f5fd5-hpptq\" (UID: \"ea141b19-7397-4fb9-9727-790dba9008b6\") " pod="kuadrant-system/authorino-57b46f5fd5-hpptq"
Jul 06 17:48:41.620284 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.620263    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzznw\" (UniqueName: \"kubernetes.io/projected/ea141b19-7397-4fb9-9727-790dba9008b6-kube-api-access-mzznw\") pod \"authorino-57b46f5fd5-hpptq\" (UID: \"ea141b19-7397-4fb9-9727-790dba9008b6\") " pod="kuadrant-system/authorino-57b46f5fd5-hpptq"
Jul 06 17:48:41.722879 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.722847    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b46f5fd5-hpptq"
Jul 06 17:48:41.850365 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:41.850218    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57b46f5fd5-hpptq"]
Jul 06 17:48:41.852945 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:48:41.852916    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea141b19_7397_4fb9_9727_790dba9008b6.slice/crio-24f5c1c5f6dc24d18651ec8065272a72102f86811c39e3564d6919028a4f5d8b WatchSource:0}: Error finding container 24f5c1c5f6dc24d18651ec8065272a72102f86811c39e3564d6919028a4f5d8b: Status 404 returned error can't find the container with id 24f5c1c5f6dc24d18651ec8065272a72102f86811c39e3564d6919028a4f5d8b
Jul 06 17:48:42.586890 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:42.586857    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-shqrc" event={"ID":"e2abb4c4-ed38-49cd-9a94-26dff3dbfef2","Type":"ContainerStarted","Data":"c6e6c67d07dc1d371b0317240e529923fb6a20944299a11ce472ec362bc7b26b"}
Jul 06 17:48:42.586890 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:42.586881    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-shqrc" podUID="e2abb4c4-ed38-49cd-9a94-26dff3dbfef2" containerName="authorino" containerID="cri-o://c6e6c67d07dc1d371b0317240e529923fb6a20944299a11ce472ec362bc7b26b" gracePeriod=30
Jul 06 17:48:42.588380 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:42.588355    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b46f5fd5-hpptq" event={"ID":"ea141b19-7397-4fb9-9727-790dba9008b6","Type":"ContainerStarted","Data":"4da69ef9f7c81b68a8874a18dd92890e40a8efb9877111bd4a4320f14965ccb2"}
Jul 06 17:48:42.588486 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:42.588394    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b46f5fd5-hpptq" event={"ID":"ea141b19-7397-4fb9-9727-790dba9008b6","Type":"ContainerStarted","Data":"24f5c1c5f6dc24d18651ec8065272a72102f86811c39e3564d6919028a4f5d8b"}
Jul 06 17:48:42.601520 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:42.601483    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-shqrc" podStartSLOduration=1.233873837 podStartE2EDuration="1.601469901s" totalImagesPullingTime="367.596064ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:48:42.600133007 +0000 UTC m=+609.178333855" watchObservedRunningTime="2026-07-06 17:48:42.601469901 +0000 UTC m=+609.179670737"
Jul 06 17:48:42.615567 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:42.615488    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57b46f5fd5-hpptq" podStartSLOduration=1.10371124 podStartE2EDuration="1.615475517s" totalImagesPullingTime="511.764277ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:48:42.615377176 +0000 UTC m=+609.193578077" watchObservedRunningTime="2026-07-06 17:48:42.615475517 +0000 UTC m=+609.193676355"
Jul 06 17:48:42.829816 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:42.829793    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-shqrc"
Jul 06 17:48:42.923997 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:42.923930    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp6t8\" (UniqueName: \"kubernetes.io/projected/e2abb4c4-ed38-49cd-9a94-26dff3dbfef2-kube-api-access-wp6t8\") pod \"e2abb4c4-ed38-49cd-9a94-26dff3dbfef2\" (UID: \"e2abb4c4-ed38-49cd-9a94-26dff3dbfef2\") "
Jul 06 17:48:42.925850 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:42.925822    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2abb4c4-ed38-49cd-9a94-26dff3dbfef2-kube-api-access-wp6t8" (OuterVolumeSpecName: "kube-api-access-wp6t8") pod "e2abb4c4-ed38-49cd-9a94-26dff3dbfef2" (UID: "e2abb4c4-ed38-49cd-9a94-26dff3dbfef2"). InnerVolumeSpecName "kube-api-access-wp6t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:48:43.024531 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:43.024501    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp6t8\" (UniqueName: \"kubernetes.io/projected/e2abb4c4-ed38-49cd-9a94-26dff3dbfef2-kube-api-access-wp6t8\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:48:43.594400 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:43.594321    2570 generic.go:356] "Generic (PLEG): container finished" podID="e2abb4c4-ed38-49cd-9a94-26dff3dbfef2" containerID="c6e6c67d07dc1d371b0317240e529923fb6a20944299a11ce472ec362bc7b26b" exitCode=0
Jul 06 17:48:43.594400 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:43.594371    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-shqrc"
Jul 06 17:48:43.594599 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:43.594411    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-shqrc" event={"ID":"e2abb4c4-ed38-49cd-9a94-26dff3dbfef2","Type":"ContainerDied","Data":"c6e6c67d07dc1d371b0317240e529923fb6a20944299a11ce472ec362bc7b26b"}
Jul 06 17:48:43.594599 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:43.594455    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-shqrc" event={"ID":"e2abb4c4-ed38-49cd-9a94-26dff3dbfef2","Type":"ContainerDied","Data":"024319b3c33c7fd625435ac9cb28f98307c6afd84d3ee7ee47d0557212d8ae13"}
Jul 06 17:48:43.594599 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:43.594474    2570 scope.go:117] "RemoveContainer" containerID="c6e6c67d07dc1d371b0317240e529923fb6a20944299a11ce472ec362bc7b26b"
Jul 06 17:48:43.602764 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:43.602737    2570 scope.go:117] "RemoveContainer" containerID="c6e6c67d07dc1d371b0317240e529923fb6a20944299a11ce472ec362bc7b26b"
Jul 06 17:48:43.603073 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:48:43.603004    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6e6c67d07dc1d371b0317240e529923fb6a20944299a11ce472ec362bc7b26b\": container with ID starting with c6e6c67d07dc1d371b0317240e529923fb6a20944299a11ce472ec362bc7b26b not found: ID does not exist" containerID="c6e6c67d07dc1d371b0317240e529923fb6a20944299a11ce472ec362bc7b26b"
Jul 06 17:48:43.603073 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:43.603037    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e6c67d07dc1d371b0317240e529923fb6a20944299a11ce472ec362bc7b26b"} err="failed to get container status \"c6e6c67d07dc1d371b0317240e529923fb6a20944299a11ce472ec362bc7b26b\": rpc error: code = NotFound desc = could not find container \"c6e6c67d07dc1d371b0317240e529923fb6a20944299a11ce472ec362bc7b26b\": container with ID starting with c6e6c67d07dc1d371b0317240e529923fb6a20944299a11ce472ec362bc7b26b not found: ID does not exist"
Jul 06 17:48:43.615603 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:43.615573    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-shqrc"]
Jul 06 17:48:43.619207 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:43.619187    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-shqrc"]
Jul 06 17:48:43.973498 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:48:43.973469    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2abb4c4-ed38-49cd-9a94-26dff3dbfef2" path="/var/lib/kubelet/pods/e2abb4c4-ed38-49cd-9a94-26dff3dbfef2/volumes"
Jul 06 17:49:23.489977 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.489943    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-v44sf"]
Jul 06 17:49:23.491389 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.490323    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2abb4c4-ed38-49cd-9a94-26dff3dbfef2" containerName="authorino"
Jul 06 17:49:23.491389 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.490340    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2abb4c4-ed38-49cd-9a94-26dff3dbfef2" containerName="authorino"
Jul 06 17:49:23.491389 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.490407    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2abb4c4-ed38-49cd-9a94-26dff3dbfef2" containerName="authorino"
Jul 06 17:49:23.492076 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.492061    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-v44sf"
Jul 06 17:49:23.494675 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.494645    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 17:49:23.494988 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.494970    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rqk58\""
Jul 06 17:49:23.505444 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.505411    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-v44sf"]
Jul 06 17:49:23.548736 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.548687    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:49:23.561484 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.561448    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18c999ac-336d-40ed-8ad9-d17f0d9910e1-plugins-config-volume\") pod \"payload-processing-58f86c7798-v44sf\" (UID: \"18c999ac-336d-40ed-8ad9-d17f0d9910e1\") " pod="openshift-ingress/payload-processing-58f86c7798-v44sf"
Jul 06 17:49:23.561484 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.561483    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwqdh\" (UniqueName: \"kubernetes.io/projected/18c999ac-336d-40ed-8ad9-d17f0d9910e1-kube-api-access-bwqdh\") pod \"payload-processing-58f86c7798-v44sf\" (UID: \"18c999ac-336d-40ed-8ad9-d17f0d9910e1\") " pod="openshift-ingress/payload-processing-58f86c7798-v44sf"
Jul 06 17:49:23.662032 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.661999    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18c999ac-336d-40ed-8ad9-d17f0d9910e1-plugins-config-volume\") pod \"payload-processing-58f86c7798-v44sf\" (UID: \"18c999ac-336d-40ed-8ad9-d17f0d9910e1\") " pod="openshift-ingress/payload-processing-58f86c7798-v44sf"
Jul 06 17:49:23.662032 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.662033    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwqdh\" (UniqueName: \"kubernetes.io/projected/18c999ac-336d-40ed-8ad9-d17f0d9910e1-kube-api-access-bwqdh\") pod \"payload-processing-58f86c7798-v44sf\" (UID: \"18c999ac-336d-40ed-8ad9-d17f0d9910e1\") " pod="openshift-ingress/payload-processing-58f86c7798-v44sf"
Jul 06 17:49:23.662962 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.662938    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18c999ac-336d-40ed-8ad9-d17f0d9910e1-plugins-config-volume\") pod \"payload-processing-58f86c7798-v44sf\" (UID: \"18c999ac-336d-40ed-8ad9-d17f0d9910e1\") " pod="openshift-ingress/payload-processing-58f86c7798-v44sf"
Jul 06 17:49:23.670593 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.670571    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwqdh\" (UniqueName: \"kubernetes.io/projected/18c999ac-336d-40ed-8ad9-d17f0d9910e1-kube-api-access-bwqdh\") pod \"payload-processing-58f86c7798-v44sf\" (UID: \"18c999ac-336d-40ed-8ad9-d17f0d9910e1\") " pod="openshift-ingress/payload-processing-58f86c7798-v44sf"
Jul 06 17:49:23.802312 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.802219    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-v44sf"
Jul 06 17:49:23.935380 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.935357    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-v44sf"]
Jul 06 17:49:23.938034 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:49:23.938002    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c999ac_336d_40ed_8ad9_d17f0d9910e1.slice/crio-1ed1638c4ac9ba5c803d4c97e5db82561f9bcaa5b48fb1b863f9ccca0134af03 WatchSource:0}: Error finding container 1ed1638c4ac9ba5c803d4c97e5db82561f9bcaa5b48fb1b863f9ccca0134af03: Status 404 returned error can't find the container with id 1ed1638c4ac9ba5c803d4c97e5db82561f9bcaa5b48fb1b863f9ccca0134af03
Jul 06 17:49:23.940440 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:23.940419    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 17:49:24.786173 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:24.786131    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-v44sf" event={"ID":"18c999ac-336d-40ed-8ad9-d17f0d9910e1","Type":"ContainerStarted","Data":"1ed1638c4ac9ba5c803d4c97e5db82561f9bcaa5b48fb1b863f9ccca0134af03"}
Jul 06 17:49:25.792102 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:25.792068    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-v44sf" event={"ID":"18c999ac-336d-40ed-8ad9-d17f0d9910e1","Type":"ContainerStarted","Data":"6f784887190c655920a0792ec2f8ca1f277ddee55d72542f86fc79429fc25e25"}
Jul 06 17:49:25.792504 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:25.792200    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-v44sf"
Jul 06 17:49:25.809100 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:25.809055    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-v44sf" podStartSLOduration=1.483907053 podStartE2EDuration="2.809039721s" totalImagesPullingTime="1.325132668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:49:25.80719537 +0000 UTC m=+652.385396208" watchObservedRunningTime="2026-07-06 17:49:25.809039721 +0000 UTC m=+652.387240584"
Jul 06 17:49:36.799105 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:36.799074    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-v44sf"
Jul 06 17:49:44.892886 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:44.892852    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"]
Jul 06 17:49:44.898188 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:44.898167    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:44.900794 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:44.900769    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hkwh9\""
Jul 06 17:49:44.900909 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:44.900841    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 17:49:44.902309 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:44.902290    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 17:49:44.902416 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:44.902349    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 17:49:44.905377 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:44.905356    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"]
Jul 06 17:49:45.049207 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.049174    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c9b125-1ec9-4352-8ee3-30d29648346a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.049207 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.049214    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c9b125-1ec9-4352-8ee3-30d29648346a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.049428 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.049237    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c9b125-1ec9-4352-8ee3-30d29648346a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.049428 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.049325    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxmj8\" (UniqueName: \"kubernetes.io/projected/b8c9b125-1ec9-4352-8ee3-30d29648346a-kube-api-access-pxmj8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.049428 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.049348    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c9b125-1ec9-4352-8ee3-30d29648346a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.049428 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.049376    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c9b125-1ec9-4352-8ee3-30d29648346a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.149984 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.149911    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c9b125-1ec9-4352-8ee3-30d29648346a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.149984 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.149947    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c9b125-1ec9-4352-8ee3-30d29648346a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.149984 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.149978    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxmj8\" (UniqueName: \"kubernetes.io/projected/b8c9b125-1ec9-4352-8ee3-30d29648346a-kube-api-access-pxmj8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.150368 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.150001    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c9b125-1ec9-4352-8ee3-30d29648346a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.150368 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.150037    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c9b125-1ec9-4352-8ee3-30d29648346a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.150368 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.150082    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c9b125-1ec9-4352-8ee3-30d29648346a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.150488 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.150376    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c9b125-1ec9-4352-8ee3-30d29648346a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.150488 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.150412    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c9b125-1ec9-4352-8ee3-30d29648346a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.150488 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.150429    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c9b125-1ec9-4352-8ee3-30d29648346a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.152291 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.152268    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c9b125-1ec9-4352-8ee3-30d29648346a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.152401 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.152376    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c9b125-1ec9-4352-8ee3-30d29648346a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.157611 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.157589    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxmj8\" (UniqueName: \"kubernetes.io/projected/b8c9b125-1ec9-4352-8ee3-30d29648346a-kube-api-access-pxmj8\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46\" (UID: \"b8c9b125-1ec9-4352-8ee3-30d29648346a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.209656 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.209628    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:45.284647 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.284605    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:49:45.351634 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.351610    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"]
Jul 06 17:49:45.353682 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:49:45.353654    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c9b125_1ec9_4352_8ee3_30d29648346a.slice/crio-393ce27136ae9b8229cd1336114dc5422b208da890b7fe2141d63d5285fcd501 WatchSource:0}: Error finding container 393ce27136ae9b8229cd1336114dc5422b208da890b7fe2141d63d5285fcd501: Status 404 returned error can't find the container with id 393ce27136ae9b8229cd1336114dc5422b208da890b7fe2141d63d5285fcd501
Jul 06 17:49:45.895395 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:45.895300    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46" event={"ID":"b8c9b125-1ec9-4352-8ee3-30d29648346a","Type":"ContainerStarted","Data":"393ce27136ae9b8229cd1336114dc5422b208da890b7fe2141d63d5285fcd501"}
Jul 06 17:49:46.900998 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:46.900918    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46" event={"ID":"b8c9b125-1ec9-4352-8ee3-30d29648346a","Type":"ContainerStarted","Data":"f2ef1166708c1a118cfecef3bdc9a6d40037ea46e33c7442634792452900c48c"}
Jul 06 17:49:46.918469 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:46.918423    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46" podStartSLOduration=1.70051226 podStartE2EDuration="2.91840799s" totalImagesPullingTime="1.21789573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:49:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:49:46.917214028 +0000 UTC m=+673.495414890" watchObservedRunningTime="2026-07-06 17:49:46.91840799 +0000 UTC m=+673.496608825"
Jul 06 17:49:55.210299 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:55.210257    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:55.210733 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:55.210326    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:55.222935 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:55.222912    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:49:55.953234 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:49:55.953203    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46"
Jul 06 17:50:00.099316 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:00.099281    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:50:11.285917 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:11.285882    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:50:22.580746 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.580683    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"]
Jul 06 17:50:22.586995 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.586973    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.589898 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.589874    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 06 17:50:22.601741 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.601686    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"]
Jul 06 17:50:22.677941 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.677898    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.678136 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.677955    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.678136 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.678059    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.678136 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.678109    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k8zg\" (UniqueName: \"kubernetes.io/projected/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-kube-api-access-8k8zg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.678241 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.678155    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.678241 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.678203    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.778972 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.778930    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.779166 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.779009    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.779166 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.779042    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.779166 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.779073    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.779166 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.779127    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.779376 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.779170    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k8zg\" (UniqueName: \"kubernetes.io/projected/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-kube-api-access-8k8zg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.779520 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.779469    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.779520 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.779507    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.779635 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.779604    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.781396 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.781372    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.781577 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.781557    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.787407 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.787384    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k8zg\" (UniqueName: \"kubernetes.io/projected/516b5eaa-8c4c-4108-85d7-d79d7362e4dc-kube-api-access-8k8zg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf\" (UID: \"516b5eaa-8c4c-4108-85d7-d79d7362e4dc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:22.900765 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:22.900637    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:23.035712 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:23.035646    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"]
Jul 06 17:50:23.038019 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:50:23.037991    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516b5eaa_8c4c_4108_85d7_d79d7362e4dc.slice/crio-a66c4d5fa4d3e3ae9f566af64db161281400fa78cb58d2d3a5f390b87cfef012 WatchSource:0}: Error finding container a66c4d5fa4d3e3ae9f566af64db161281400fa78cb58d2d3a5f390b87cfef012: Status 404 returned error can't find the container with id a66c4d5fa4d3e3ae9f566af64db161281400fa78cb58d2d3a5f390b87cfef012
Jul 06 17:50:23.063063 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:23.063035    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf" event={"ID":"516b5eaa-8c4c-4108-85d7-d79d7362e4dc","Type":"ContainerStarted","Data":"a66c4d5fa4d3e3ae9f566af64db161281400fa78cb58d2d3a5f390b87cfef012"}
Jul 06 17:50:24.068524 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:24.068486    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf" event={"ID":"516b5eaa-8c4c-4108-85d7-d79d7362e4dc","Type":"ContainerStarted","Data":"acf4f773a99c4f31f8b337239277b2d02d45fe34345058b046ac46baca128245"}
Jul 06 17:50:24.086232 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:24.086174    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf" podStartSLOduration=1.8670719500000001 podStartE2EDuration="2.086157084s" totalImagesPullingTime="219.085134ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:50:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:50:24.084461304 +0000 UTC m=+710.662662159" watchObservedRunningTime="2026-07-06 17:50:24.086157084 +0000 UTC m=+710.664357920"
Jul 06 17:50:24.287305 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:24.287268    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:50:31.395956 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:31.395876    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:50:32.901909 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:32.901870    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:32.902377 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:32.901944    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:32.914482 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:32.914460    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:33.121543 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:33.121518    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf"
Jul 06 17:50:38.999413 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:38.999374    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"]
Jul 06 17:50:39.002962 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.002937    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.005829 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.005807    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 17:50:39.012414 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.012393    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"]
Jul 06 17:50:39.022552 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.022528    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727bce7a-49d7-4ed7-af7a-d081ad18538f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.022661 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.022608    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/727bce7a-49d7-4ed7-af7a-d081ad18538f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.022766 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.022684    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/727bce7a-49d7-4ed7-af7a-d081ad18538f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.022766 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.022734    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nvd7\" (UniqueName: \"kubernetes.io/projected/727bce7a-49d7-4ed7-af7a-d081ad18538f-kube-api-access-6nvd7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.022885 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.022763    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/727bce7a-49d7-4ed7-af7a-d081ad18538f-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.022940 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.022895    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/727bce7a-49d7-4ed7-af7a-d081ad18538f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.123888 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.123856    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/727bce7a-49d7-4ed7-af7a-d081ad18538f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.124063 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.123902    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727bce7a-49d7-4ed7-af7a-d081ad18538f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.124063 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.123922    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/727bce7a-49d7-4ed7-af7a-d081ad18538f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.124063 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.123969    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/727bce7a-49d7-4ed7-af7a-d081ad18538f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.124063 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.123999    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nvd7\" (UniqueName: \"kubernetes.io/projected/727bce7a-49d7-4ed7-af7a-d081ad18538f-kube-api-access-6nvd7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.124215 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.124119    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/727bce7a-49d7-4ed7-af7a-d081ad18538f-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.124316 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.124265    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/727bce7a-49d7-4ed7-af7a-d081ad18538f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.124359 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.124316    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/727bce7a-49d7-4ed7-af7a-d081ad18538f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.124460 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.124442    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/727bce7a-49d7-4ed7-af7a-d081ad18538f-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.126195 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.126169    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/727bce7a-49d7-4ed7-af7a-d081ad18538f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.126359 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.126342    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/727bce7a-49d7-4ed7-af7a-d081ad18538f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.132401 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.132378    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nvd7\" (UniqueName: \"kubernetes.io/projected/727bce7a-49d7-4ed7-af7a-d081ad18538f-kube-api-access-6nvd7\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4\" (UID: \"727bce7a-49d7-4ed7-af7a-d081ad18538f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.312967 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.312882    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:39.448304 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:39.448260    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"]
Jul 06 17:50:39.450705 ip-10-0-128-234 kubenswrapper[2570]: W0706 17:50:39.450663    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod727bce7a_49d7_4ed7_af7a_d081ad18538f.slice/crio-8c53fdf4cacd82330de49f25f4b884fbdedfc9d438d60a58f9de87a6582550b9 WatchSource:0}: Error finding container 8c53fdf4cacd82330de49f25f4b884fbdedfc9d438d60a58f9de87a6582550b9: Status 404 returned error can't find the container with id 8c53fdf4cacd82330de49f25f4b884fbdedfc9d438d60a58f9de87a6582550b9
Jul 06 17:50:40.143669 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:40.143624    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4" event={"ID":"727bce7a-49d7-4ed7-af7a-d081ad18538f","Type":"ContainerStarted","Data":"6f25b38e29dac86f37975a55595bc7500df7c6e2aaf26eb3705f32231f03a52d"}
Jul 06 17:50:40.144046 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:40.143675    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4" event={"ID":"727bce7a-49d7-4ed7-af7a-d081ad18538f","Type":"ContainerStarted","Data":"8c53fdf4cacd82330de49f25f4b884fbdedfc9d438d60a58f9de87a6582550b9"}
Jul 06 17:50:40.161378 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:40.161334    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4" podStartSLOduration=1.9944185970000001 podStartE2EDuration="2.161319343s" totalImagesPullingTime="166.900746ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:50:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:50:40.160463422 +0000 UTC m=+726.738664325" watchObservedRunningTime="2026-07-06 17:50:40.161319343 +0000 UTC m=+726.739520178"
Jul 06 17:50:41.381823 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:41.381792    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:50:49.313507 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:49.313469    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:49.313952 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:49.313743    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:49.326305 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:49.326282    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:50:50.200564 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:50:50.200529    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4"
Jul 06 17:51:43.479799 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:43.479763    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57b46f5fd5-hpptq"]
Jul 06 17:51:43.480299 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:43.479949    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-57b46f5fd5-hpptq" podUID="ea141b19-7397-4fb9-9727-790dba9008b6" containerName="authorino" containerID="cri-o://4da69ef9f7c81b68a8874a18dd92890e40a8efb9877111bd4a4320f14965ccb2" gracePeriod=30
Jul 06 17:51:43.733215 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:43.733162    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b46f5fd5-hpptq"
Jul 06 17:51:43.819012 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:43.818986    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzznw\" (UniqueName: \"kubernetes.io/projected/ea141b19-7397-4fb9-9727-790dba9008b6-kube-api-access-mzznw\") pod \"ea141b19-7397-4fb9-9727-790dba9008b6\" (UID: \"ea141b19-7397-4fb9-9727-790dba9008b6\") "
Jul 06 17:51:43.819012 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:43.819024    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea141b19-7397-4fb9-9727-790dba9008b6-tls-cert\") pod \"ea141b19-7397-4fb9-9727-790dba9008b6\" (UID: \"ea141b19-7397-4fb9-9727-790dba9008b6\") "
Jul 06 17:51:43.821102 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:43.821065    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea141b19-7397-4fb9-9727-790dba9008b6-kube-api-access-mzznw" (OuterVolumeSpecName: "kube-api-access-mzznw") pod "ea141b19-7397-4fb9-9727-790dba9008b6" (UID: "ea141b19-7397-4fb9-9727-790dba9008b6"). InnerVolumeSpecName "kube-api-access-mzznw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 17:51:43.829540 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:43.829514    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea141b19-7397-4fb9-9727-790dba9008b6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ea141b19-7397-4fb9-9727-790dba9008b6" (UID: "ea141b19-7397-4fb9-9727-790dba9008b6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 17:51:43.919655 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:43.919624    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzznw\" (UniqueName: \"kubernetes.io/projected/ea141b19-7397-4fb9-9727-790dba9008b6-kube-api-access-mzznw\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:51:43.919655 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:43.919650    2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea141b19-7397-4fb9-9727-790dba9008b6-tls-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 17:51:44.441245 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:44.441210    2570 generic.go:356] "Generic (PLEG): container finished" podID="ea141b19-7397-4fb9-9727-790dba9008b6" containerID="4da69ef9f7c81b68a8874a18dd92890e40a8efb9877111bd4a4320f14965ccb2" exitCode=0
Jul 06 17:51:44.441430 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:44.441270    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57b46f5fd5-hpptq"
Jul 06 17:51:44.441430 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:44.441292    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b46f5fd5-hpptq" event={"ID":"ea141b19-7397-4fb9-9727-790dba9008b6","Type":"ContainerDied","Data":"4da69ef9f7c81b68a8874a18dd92890e40a8efb9877111bd4a4320f14965ccb2"}
Jul 06 17:51:44.441430 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:44.441332    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57b46f5fd5-hpptq" event={"ID":"ea141b19-7397-4fb9-9727-790dba9008b6","Type":"ContainerDied","Data":"24f5c1c5f6dc24d18651ec8065272a72102f86811c39e3564d6919028a4f5d8b"}
Jul 06 17:51:44.441430 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:44.441347    2570 scope.go:117] "RemoveContainer" containerID="4da69ef9f7c81b68a8874a18dd92890e40a8efb9877111bd4a4320f14965ccb2"
Jul 06 17:51:44.449778 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:44.449759    2570 scope.go:117] "RemoveContainer" containerID="4da69ef9f7c81b68a8874a18dd92890e40a8efb9877111bd4a4320f14965ccb2"
Jul 06 17:51:44.450043 ip-10-0-128-234 kubenswrapper[2570]: E0706 17:51:44.450020    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4da69ef9f7c81b68a8874a18dd92890e40a8efb9877111bd4a4320f14965ccb2\": container with ID starting with 4da69ef9f7c81b68a8874a18dd92890e40a8efb9877111bd4a4320f14965ccb2 not found: ID does not exist" containerID="4da69ef9f7c81b68a8874a18dd92890e40a8efb9877111bd4a4320f14965ccb2"
Jul 06 17:51:44.450115 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:44.450055    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4da69ef9f7c81b68a8874a18dd92890e40a8efb9877111bd4a4320f14965ccb2"} err="failed to get container status \"4da69ef9f7c81b68a8874a18dd92890e40a8efb9877111bd4a4320f14965ccb2\": rpc error: code = NotFound desc = could not find container \"4da69ef9f7c81b68a8874a18dd92890e40a8efb9877111bd4a4320f14965ccb2\": container with ID starting with 4da69ef9f7c81b68a8874a18dd92890e40a8efb9877111bd4a4320f14965ccb2 not found: ID does not exist"
Jul 06 17:51:44.456636 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:44.456614    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57b46f5fd5-hpptq"]
Jul 06 17:51:44.461549 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:44.461527    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57b46f5fd5-hpptq"]
Jul 06 17:51:45.974807 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:51:45.974773    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea141b19-7397-4fb9-9727-790dba9008b6" path="/var/lib/kubelet/pods/ea141b19-7397-4fb9-9727-790dba9008b6/volumes"
Jul 06 17:52:12.692244 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:52:12.692205    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:52:23.288417 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:52:23.288370    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:52:33.590756 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:52:33.590715    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:52:43.791783 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:52:43.791747    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:52:53.479450 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:52:53.479413    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:53:20.490970 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:53:20.490932    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:53:32.087100 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:53:32.087026    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:53:33.889503 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:53:33.889475    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 17:53:33.889928 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:53:33.889479    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 17:54:06.588565 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:54:06.588529    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:54:16.186531 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:54:16.186495    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:54:24.589720 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:54:24.589661    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:54:34.188800 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:54:34.188763    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:54:44.286120 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:54:44.286081    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:54:53.584177 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:54:53.584140    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:55:05.386937 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:55:05.386901    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:55:14.986282 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:55:14.986241    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:55:37.594763 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:55:37.594732    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:55:49.385378 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:55:49.385342    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:56:11.383130 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:56:11.383093    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:56:21.789791 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:56:21.789754    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:56:38.792235 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:56:38.792161    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:56:48.685335 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:56:48.685300    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:56:57.990909 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:56:57.990878    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:57:07.584311 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:57:07.584274    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:57:16.291047 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:57:16.291012    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:58:33.915159 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:58:33.915127    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 17:58:33.918662 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:58:33.918642    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 17:59:04.800998 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:59:04.800962    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:59:16.487737 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:59:16.487687    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:59:25.489574 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:59:25.489539    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:59:37.390349 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:59:37.390309    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:59:47.289188 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:59:47.289154    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 17:59:59.186901 ip-10-0-128-234 kubenswrapper[2570]: I0706 17:59:59.186866    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:00:07.581223 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:00:07.581178    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:00:18.581542 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:00:18.581511    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:00:30.890849 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:00:30.890814    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:00:38.491703 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:00:38.491652    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:00:50.292635 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:00:50.292591    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:01:13.384004 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:01:13.383962    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:01:22.385363 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:01:22.385324    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:01:31.492675 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:01:31.492638    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:01:43.898077 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:01:43.898040    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:01:58.186910 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:01:58.186872    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:02:07.693197 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:02:07.693161    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:02:17.084933 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:02:17.084898    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:02:26.690134 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:02:26.690041    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:02:35.592549 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:02:35.592515    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:02:45.386926 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:02:45.386893    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:02:58.885798 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:02:58.885764    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:03:07.886578 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:03:07.886539    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:03:17.585785 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:03:17.585746    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:03:26.587718 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:03:26.587671    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:03:33.942830 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:03:33.942800    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 18:03:33.946614 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:03:33.946591    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 18:03:40.385278 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:03:40.385243    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:03:49.292793 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:03:49.292755    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:04:02.281598 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:04:02.281560    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:04:14.080037 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:04:14.079998    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:04:24.012905 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:04:24.012866    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:04:34.981816 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:04:34.981781    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:04:47.588041 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:04:47.588008    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:05:01.087603 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:05:01.087569    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:05:11.285503 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:05:11.285466    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:05:22.192336 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:05:22.192292    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:05:41.779827 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:05:41.779790    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:05:50.191575 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:05:50.191529    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:07:10.596130 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:07:10.596100    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:07:18.087738 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:07:18.087705    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:07:26.691571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:07:26.691525    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:07:36.090950 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:07:36.090911    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:07:52.484424 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:07:52.484386    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:08:24.487878 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:24.487840    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:08:33.973337 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:33.973310    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 18:08:33.978192 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:33.978166    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 18:08:39.099638 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.099602    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"]
Jul 06 18:08:39.100171 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.100151    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea141b19-7397-4fb9-9727-790dba9008b6" containerName="authorino"
Jul 06 18:08:39.100257 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.100175    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea141b19-7397-4fb9-9727-790dba9008b6" containerName="authorino"
Jul 06 18:08:39.100310 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.100259    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea141b19-7397-4fb9-9727-790dba9008b6" containerName="authorino"
Jul 06 18:08:39.103054 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.103034    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.106056 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.106029    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-214076ae\"/\"openshift-service-ca.crt\""
Jul 06 18:08:39.107238 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.107216    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-214076ae\"/\"kube-root-ca.crt\""
Jul 06 18:08:39.107342 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.107291    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-214076ae\"/\"e2e-lifecycle-model-214076ae-kserve-self-signed-certs\""
Jul 06 18:08:39.107342 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.107318    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-214076ae\"/\"default-dockercfg-zp45f\""
Jul 06 18:08:39.112964 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.112942    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"]
Jul 06 18:08:39.172922 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.172887    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5257f9d5-6528-44c2-a228-205a8f67693a-tls-certs\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.173079 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.172948    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grp2z\" (UniqueName: \"kubernetes.io/projected/5257f9d5-6528-44c2-a228-205a8f67693a-kube-api-access-grp2z\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.173079 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.172987    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-tmp-dir\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.173079 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.173008    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-home\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.173079 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.173061    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-model-cache\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.173230 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.173090    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-dshm\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.273477 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.273442    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grp2z\" (UniqueName: \"kubernetes.io/projected/5257f9d5-6528-44c2-a228-205a8f67693a-kube-api-access-grp2z\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.273643 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.273507    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-tmp-dir\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.273643 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.273542    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-home\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.273643 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.273567    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-model-cache\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.273643 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.273592    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-dshm\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.273643 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.273632    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5257f9d5-6528-44c2-a228-205a8f67693a-tls-certs\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.273980 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.273955    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-tmp-dir\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.274032 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.273969    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-model-cache\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.274032 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.274018    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-home\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.275920 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.275899    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-dshm\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.276336 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.276311    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5257f9d5-6528-44c2-a228-205a8f67693a-tls-certs\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.282889 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.282865    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grp2z\" (UniqueName: \"kubernetes.io/projected/5257f9d5-6528-44c2-a228-205a8f67693a-kube-api-access-grp2z\") pod \"e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") " pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.414166 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.414082    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:39.544247 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:39.544214    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"]
Jul 06 18:08:39.547297 ip-10-0-128-234 kubenswrapper[2570]: W0706 18:08:39.547269    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5257f9d5_6528_44c2_a228_205a8f67693a.slice/crio-d90d1e02ed745f622df659f7abd658ad5f393e5fa13c9675f373e866ce96b667 WatchSource:0}: Error finding container d90d1e02ed745f622df659f7abd658ad5f393e5fa13c9675f373e866ce96b667: Status 404 returned error can't find the container with id d90d1e02ed745f622df659f7abd658ad5f393e5fa13c9675f373e866ce96b667
Jul 06 18:08:40.187096 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:40.187055    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg" event={"ID":"5257f9d5-6528-44c2-a228-205a8f67693a","Type":"ContainerStarted","Data":"557832bf4d202d22ee65a57c1b9006ccd77f98df4e86bf9a5140078f5176d5c4"}
Jul 06 18:08:40.187096 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:40.187100    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg" event={"ID":"5257f9d5-6528-44c2-a228-205a8f67693a","Type":"ContainerStarted","Data":"d90d1e02ed745f622df659f7abd658ad5f393e5fa13c9675f373e866ce96b667"}
Jul 06 18:08:40.207100 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:40.207056    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg" podStartSLOduration=1.207042376 podStartE2EDuration="1.207042376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:08:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:08:40.205450732 +0000 UTC m=+1806.783651569" watchObservedRunningTime="2026-07-06 18:08:40.207042376 +0000 UTC m=+1806.785243211"
Jul 06 18:08:42.037177 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:42.037145    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:08:49.414518 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:49.414477    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:49.414518 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:49.414522    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:49.426728 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:49.426704    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:50.249734 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:50.249690    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:08:58.190741 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:08:58.190683    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:09:11.878027 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:11.877991    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"]
Jul 06 18:09:12.279830 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:12.279798    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:09:26.898473 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:26.898430    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg" podUID="5257f9d5-6528-44c2-a228-205a8f67693a" containerName="main" containerID="cri-o://557832bf4d202d22ee65a57c1b9006ccd77f98df4e86bf9a5140078f5176d5c4" gracePeriod=45
Jul 06 18:09:27.150675 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.150616    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:09:27.181212 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.181176    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5257f9d5-6528-44c2-a228-205a8f67693a-tls-certs\") pod \"5257f9d5-6528-44c2-a228-205a8f67693a\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") "
Jul 06 18:09:27.181374 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.181224    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-home\") pod \"5257f9d5-6528-44c2-a228-205a8f67693a\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") "
Jul 06 18:09:27.181374 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.181248    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-model-cache\") pod \"5257f9d5-6528-44c2-a228-205a8f67693a\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") "
Jul 06 18:09:27.181374 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.181301    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-dshm\") pod \"5257f9d5-6528-44c2-a228-205a8f67693a\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") "
Jul 06 18:09:27.181374 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.181331    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grp2z\" (UniqueName: \"kubernetes.io/projected/5257f9d5-6528-44c2-a228-205a8f67693a-kube-api-access-grp2z\") pod \"5257f9d5-6528-44c2-a228-205a8f67693a\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") "
Jul 06 18:09:27.181596 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.181417    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-tmp-dir\") pod \"5257f9d5-6528-44c2-a228-205a8f67693a\" (UID: \"5257f9d5-6528-44c2-a228-205a8f67693a\") "
Jul 06 18:09:27.181596 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.181513    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-home" (OuterVolumeSpecName: "home") pod "5257f9d5-6528-44c2-a228-205a8f67693a" (UID: "5257f9d5-6528-44c2-a228-205a8f67693a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:09:27.181776 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.181754    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5257f9d5-6528-44c2-a228-205a8f67693a" (UID: "5257f9d5-6528-44c2-a228-205a8f67693a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:09:27.181852 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.181779    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:09:27.182078 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.182051    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-model-cache" (OuterVolumeSpecName: "model-cache") pod "5257f9d5-6528-44c2-a228-205a8f67693a" (UID: "5257f9d5-6528-44c2-a228-205a8f67693a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:09:27.183829 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.183801    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5257f9d5-6528-44c2-a228-205a8f67693a-kube-api-access-grp2z" (OuterVolumeSpecName: "kube-api-access-grp2z") pod "5257f9d5-6528-44c2-a228-205a8f67693a" (UID: "5257f9d5-6528-44c2-a228-205a8f67693a"). InnerVolumeSpecName "kube-api-access-grp2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 18:09:27.184018 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.183992    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5257f9d5-6528-44c2-a228-205a8f67693a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5257f9d5-6528-44c2-a228-205a8f67693a" (UID: "5257f9d5-6528-44c2-a228-205a8f67693a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 18:09:27.184121 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.184091    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-dshm" (OuterVolumeSpecName: "dshm") pod "5257f9d5-6528-44c2-a228-205a8f67693a" (UID: "5257f9d5-6528-44c2-a228-205a8f67693a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:09:27.283018 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.282981    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:09:27.283018 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.283011    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5257f9d5-6528-44c2-a228-205a8f67693a-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:09:27.283018 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.283020    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:09:27.283018 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.283027    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5257f9d5-6528-44c2-a228-205a8f67693a-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:09:27.283269 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.283037    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grp2z\" (UniqueName: \"kubernetes.io/projected/5257f9d5-6528-44c2-a228-205a8f67693a-kube-api-access-grp2z\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:09:27.415542 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.415451    2570 generic.go:356] "Generic (PLEG): container finished" podID="5257f9d5-6528-44c2-a228-205a8f67693a" containerID="557832bf4d202d22ee65a57c1b9006ccd77f98df4e86bf9a5140078f5176d5c4" exitCode=0
Jul 06 18:09:27.415542 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.415498    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"
Jul 06 18:09:27.415753 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.415540    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg" event={"ID":"5257f9d5-6528-44c2-a228-205a8f67693a","Type":"ContainerDied","Data":"557832bf4d202d22ee65a57c1b9006ccd77f98df4e86bf9a5140078f5176d5c4"}
Jul 06 18:09:27.415753 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.415591    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg" event={"ID":"5257f9d5-6528-44c2-a228-205a8f67693a","Type":"ContainerDied","Data":"d90d1e02ed745f622df659f7abd658ad5f393e5fa13c9675f373e866ce96b667"}
Jul 06 18:09:27.415753 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.415613    2570 scope.go:117] "RemoveContainer" containerID="557832bf4d202d22ee65a57c1b9006ccd77f98df4e86bf9a5140078f5176d5c4"
Jul 06 18:09:27.424504 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.424488    2570 scope.go:117] "RemoveContainer" containerID="557832bf4d202d22ee65a57c1b9006ccd77f98df4e86bf9a5140078f5176d5c4"
Jul 06 18:09:27.424786 ip-10-0-128-234 kubenswrapper[2570]: E0706 18:09:27.424767    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"557832bf4d202d22ee65a57c1b9006ccd77f98df4e86bf9a5140078f5176d5c4\": container with ID starting with 557832bf4d202d22ee65a57c1b9006ccd77f98df4e86bf9a5140078f5176d5c4 not found: ID does not exist" containerID="557832bf4d202d22ee65a57c1b9006ccd77f98df4e86bf9a5140078f5176d5c4"
Jul 06 18:09:27.424850 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.424796    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"557832bf4d202d22ee65a57c1b9006ccd77f98df4e86bf9a5140078f5176d5c4"} err="failed to get container status \"557832bf4d202d22ee65a57c1b9006ccd77f98df4e86bf9a5140078f5176d5c4\": rpc error: code = NotFound desc = could not find container \"557832bf4d202d22ee65a57c1b9006ccd77f98df4e86bf9a5140078f5176d5c4\": container with ID starting with 557832bf4d202d22ee65a57c1b9006ccd77f98df4e86bf9a5140078f5176d5c4 not found: ID does not exist"
Jul 06 18:09:27.437217 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.437197    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"]
Jul 06 18:09:27.438701 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.438672    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-214076ae/e2e-lifecycle-model-214076ae-kserve-6b764ff95f-zwvvg"]
Jul 06 18:09:27.974747 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:27.974718    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5257f9d5-6528-44c2-a228-205a8f67693a" path="/var/lib/kubelet/pods/5257f9d5-6528-44c2-a228-205a8f67693a/volumes"
Jul 06 18:09:51.186983 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:09:51.186945    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:10:04.800824 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:10:04.800783    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:10:14.186988 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:10:14.186951    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:10:43.759852 ip-10-0-128-234 kubenswrapper[2570]: E0706 18:10:43.759807    2570 controller.go:195] "Failed to update lease" err="Put \"https://a24db72f7093546ebb78a7f446cb991f-3442e0978c4f8a80.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-128-234.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 06 18:10:53.761030 ip-10-0-128-234 kubenswrapper[2570]: E0706 18:10:53.760989    2570 controller.go:195] "Failed to update lease" err="Put \"https://a24db72f7093546ebb78a7f446cb991f-3442e0978c4f8a80.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-128-234.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 06 18:11:03.761545 ip-10-0-128-234 kubenswrapper[2570]: E0706 18:11:03.761496    2570 controller.go:195] "Failed to update lease" err="Put \"https://a24db72f7093546ebb78a7f446cb991f-3442e0978c4f8a80.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-128-234.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 06 18:11:09.458402 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458350    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"default-dockercfg-h7h7w\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.458402 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458384    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.458402 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458392    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.458402 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458376    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.458402 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458415    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459108 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458350    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dw2nb\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459108 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458372    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xfjs2\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459108 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458437    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7b567\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459108 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458354    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459108 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458423    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459108 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458445    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkf68\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459108 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458443    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459108 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458467    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"default-dockercfg-n7npx\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459108 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458482    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rd8v9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459108 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458475    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459108 ip-10-0-128-234 kubenswrapper[2570]: E0706 18:11:09.458479    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-06T18:11:03Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-06T18:11:03Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-06T18:11:03Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-06T18:11:03Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-128-234.ec2.internal\": Patch \"https://a24db72f7093546ebb78a7f446cb991f-3442e0978c4f8a80.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-128-234.ec2.internal/status?timeout=10s\": http2: client connection lost"
Jul 06 18:11:09.459108 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458516    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"default-dockercfg-f424l\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459108 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458498    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d8f58\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459108 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458531    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459108 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458555    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-chbhn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458495    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458582    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458606    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458617    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bk52m\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458620    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458626    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458640    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458660    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-dockercfg-5x2vf\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458676    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458679    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458687    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458689    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-smm9k\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458720    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458737    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458745    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458756    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-46kbs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458773    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.459869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458781    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458797    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458830    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458834    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458868    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458891    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458901    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459003    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458921    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458926    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458944    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458948    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459039    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458971    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458972    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458981    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458918    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459072    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460442 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459040    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.458968    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459076    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459010    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bpmbv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459083    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459132    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459136    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2gfkn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459150    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459160    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: E0706 18:11:09.459158    2570 controller.go:195] "Failed to update lease" err="Put \"https://a24db72f7093546ebb78a7f446cb991f-3442e0978c4f8a80.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-128-234.ec2.internal?timeout=10s\": http2: client connection lost"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459184    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459198    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hswb7\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459209    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459221    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459216    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459242    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459248    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dr8qh\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459257    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5sljr\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.460992 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459251    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459278    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459286    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459303    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-v7lvk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459328    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459336    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459340    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459355    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g7nsn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459374    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lp5dx\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459375    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459374    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459384    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459393    2570 reflector.go:571] "Warning: watch ended with error" reflector="pkg/kubelet/config/apiserver.go:66" type="*v1.Pod" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459417    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459425    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459443    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459428    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459420    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7b8qq\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.461512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459446    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kbcgn\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459465    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459471    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459474    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459484    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459492    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459492    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ffctr\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459507    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qq6vl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459517    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459530    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459517    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bvc2m\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459540    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hk5ph\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459543    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459503    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459555    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459547    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459510    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"original-pull-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459592    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wwzt2\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462055 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459592    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459593    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459606    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459615    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-blv5s\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459620    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459543    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tdvgl\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459634    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459638    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rqk58\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459645    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459650    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459620    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459661    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-dockercfg-75j6z\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459635    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-t9st4\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459672    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459651    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459683    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459670    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459668    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8fxcc\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.462571 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459721    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.463100 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459727    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.463100 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459611    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.463100 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459719    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hvx7m\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.463100 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459743    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.463100 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459747    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.463100 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459740    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.463100 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459657    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.463100 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459754    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.463100 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459752    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.463100 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459758    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"default-dockercfg-hkwh9\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:09.463100 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:09.459721    2570 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 06 18:11:10.266951 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.266920    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bpmbv\""
Jul 06 18:11:10.280658 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.280627    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.294443 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.294425    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 18:11:10.298777 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.298756    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 18:11:10.301879 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.301861    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 18:11:10.305364 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.305347    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.309613 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.309591    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.310493 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.310477    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 18:11:10.311856 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.311841    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.321397 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.321380    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 18:11:10.334933 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.334912    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 18:11:10.343348 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.343332    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-blv5s\""
Jul 06 18:11:10.348674 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.348655    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 18:11:10.351681 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.351667    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 18:11:10.380300 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.380266    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 18:11:10.381677 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.381654    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 18:11:10.383686 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.383663    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.383799 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.383772    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 18:11:10.383859 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.383827    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hk5ph\""
Jul 06 18:11:10.384279 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.384262    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:11:10.390600 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.390583    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 18:11:10.397590 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.397573    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.404229 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.404211    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.404990 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.404974    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.408205 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.408189    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 18:11:10.410177 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.410163    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hvx7m\""
Jul 06 18:11:10.418132 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.418113    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rqk58\""
Jul 06 18:11:10.418789 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.418775    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.425494 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.425479    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.425568 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.425543    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 18:11:10.438510 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.438483    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.440091 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.440067    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 18:11:10.440192 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.440119    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hswb7\""
Jul 06 18:11:10.444031 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.444013    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 18:11:10.444540 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.444524    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 18:11:10.446461 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.446444    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.448438 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.448422    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.450444 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.450429    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d8f58\""
Jul 06 18:11:10.466550 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.466531    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 18:11:10.467283 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.467269    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 18:11:10.487971 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.487954    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 18:11:10.504510 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.504494    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 18:11:10.508723 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.508689    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 18:11:10.514562 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.514536    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.517468 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.517419    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.522864 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.522850    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 18:11:10.524755 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.524730    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.553110 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.553080    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 18:11:10.559313 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.559293    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-75j6z\""
Jul 06 18:11:10.560269 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.560255    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.569650 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.569633    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 18:11:10.570671 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.570654    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.580472 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.580453    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-chbhn\""
Jul 06 18:11:10.580564 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.580522    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.591327 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.591309    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 18:11:10.604013 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.603997    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.606031 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.606016    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 18:11:10.608271 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.608255    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.624856 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.624837    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 18:11:10.628107 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.628093    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dr8qh\""
Jul 06 18:11:10.632414 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.632395    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-smm9k\""
Jul 06 18:11:10.653802 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.653781    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 18:11:10.653886 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.653785    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.678889 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.678866    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.688735 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.688711    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dw2nb\""
Jul 06 18:11:10.693240 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.693224    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.709276 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.709255    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 18:11:10.712874 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.712855    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 18:11:10.715447 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.715430    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.715584 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.715561    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkf68\""
Jul 06 18:11:10.715654 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.715600    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.716331 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.716317    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.717362 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.717349    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xfjs2\""
Jul 06 18:11:10.718484 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.718469    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 18:11:10.723884 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.723868    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 18:11:10.725835 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.725811    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wwzt2\""
Jul 06 18:11:10.737585 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.737567    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.740626 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.740608    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 18:11:10.742814 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.742800    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.748263 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.748242    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.750337 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.750319    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bk52m\""
Jul 06 18:11:10.766826 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.766806    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5x2vf\""
Jul 06 18:11:10.781224 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.781167    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-t9st4\""
Jul 06 18:11:10.787672 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.787657    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.790059 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.790044    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.797529 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.797514    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rd8v9\""
Jul 06 18:11:10.798578 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.798561    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 18:11:10.802844 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.802830    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.828664 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.828644    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.831946 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.831924    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 18:11:10.836290 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.836268    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 18:11:10.836377 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.836268    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 18:11:10.846800 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.846782    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 18:11:10.857274 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.857258    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-v7lvk\""
Jul 06 18:11:10.859393 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.859379    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.870110 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.870093    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7b567\""
Jul 06 18:11:10.872656 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.872642    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.873618 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.873605    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 18:11:10.888664 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.888643    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 18:11:10.895219 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.895202    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5sljr\""
Jul 06 18:11:10.905134 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.905117    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 18:11:10.906030 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.906016    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7b8qq\""
Jul 06 18:11:10.913477 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.913461    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n7npx\""
Jul 06 18:11:10.913534 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.913484    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 18:11:10.915546 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.915528    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lp5dx\""
Jul 06 18:11:10.915885 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.915870    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 18:11:10.917488 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.917475    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.919926 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.919913    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 18:11:10.933373 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.933350    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kbcgn\""
Jul 06 18:11:10.935286 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.935271    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 18:11:10.939818 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.939805    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 18:11:10.944353 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.944329    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 18:11:10.944420 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.944405    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 18:11:10.946557 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.946542    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 06 18:11:10.947660 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.947647    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 18:11:10.965749 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.965728    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 18:11:10.965834 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.965763    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bvc2m\""
Jul 06 18:11:10.966245 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.966230    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 18:11:10.976733 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.976715    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 18:11:10.982167 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.982153    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 18:11:10.983233 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.983219    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qq6vl\""
Jul 06 18:11:10.986507 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.986492    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-46kbs\""
Jul 06 18:11:10.987502 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.987485    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g7nsn\""
Jul 06 18:11:10.999416 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:10.999394    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-h7h7w\""
Jul 06 18:11:11.003788 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:11.003771    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 06 18:11:11.016069 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:11.016048    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2gfkn\""
Jul 06 18:11:11.021925 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:11.021852    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-f424l\""
Jul 06 18:11:11.025346 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:11.025331    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 06 18:11:11.028553 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:11.028537    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8fxcc\""
Jul 06 18:11:11.031828 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:11.031773    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 18:11:11.033855 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:11.033836    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 18:11:11.040449 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:11.040431    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ffctr\""
Jul 06 18:11:11.044518 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:11.044496    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hkwh9\""
Jul 06 18:11:11.045554 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:11.045541    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 18:11:11.048609 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:11.048594    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 18:11:11.052835 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:11.052818    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 18:11:11.054207 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:11.054192    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 18:11:11.058336 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:11.058320    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tdvgl\""
Jul 06 18:11:13.785640 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.785607    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"]
Jul 06 18:11:13.786026 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.785981    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5257f9d5-6528-44c2-a228-205a8f67693a" containerName="main"
Jul 06 18:11:13.786026 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.785993    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5257f9d5-6528-44c2-a228-205a8f67693a" containerName="main"
Jul 06 18:11:13.786175 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.786072    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5257f9d5-6528-44c2-a228-205a8f67693a" containerName="main"
Jul 06 18:11:13.789110 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.789092    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:13.791764 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.791746    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b635d0\"/\"openshift-service-ca.crt\""
Jul 06 18:11:13.793267 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.793245    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-b635d0\"/\"kube-root-ca.crt\""
Jul 06 18:11:13.793377 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.793288    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b635d0\"/\"default-dockercfg-6d4r4\""
Jul 06 18:11:13.793377 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.793288    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-b635d0\"/\"test-model-b635d0-kserve-self-signed-certs\""
Jul 06 18:11:13.799656 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.799632    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"]
Jul 06 18:11:13.887985 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.887949    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:11:13.907481 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.907453    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-dshm\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:13.907634 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.907484    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92llx\" (UniqueName: \"kubernetes.io/projected/98632a7b-ad80-434f-b868-49ddf7e20be1-kube-api-access-92llx\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:13.907634 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.907515    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-tmp-dir\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:13.907634 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.907619    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-model-cache\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:13.907801 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.907659    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98632a7b-ad80-434f-b868-49ddf7e20be1-tls-certs\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:13.907801 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:13.907683    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-home\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:14.008252 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.008211    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-model-cache\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:14.008448 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.008276    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98632a7b-ad80-434f-b868-49ddf7e20be1-tls-certs\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:14.008448 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.008308    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-home\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:14.008448 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.008340    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-dshm\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:14.008448 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.008365    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92llx\" (UniqueName: \"kubernetes.io/projected/98632a7b-ad80-434f-b868-49ddf7e20be1-kube-api-access-92llx\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:14.008783 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.008511    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-tmp-dir\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:14.008783 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.008652    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-model-cache\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:14.008783 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.008737    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-home\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:14.009034 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.008931    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-tmp-dir\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:14.011224 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.011190    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-dshm\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:14.011353 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.011335    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98632a7b-ad80-434f-b868-49ddf7e20be1-tls-certs\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:14.020512 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.020487    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92llx\" (UniqueName: \"kubernetes.io/projected/98632a7b-ad80-434f-b868-49ddf7e20be1-kube-api-access-92llx\") pod \"test-model-b635d0-kserve-778f4c56cc-8kbbn\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") " pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:14.099527 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.099437    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:14.235744 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.235716    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"]
Jul 06 18:11:14.237654 ip-10-0-128-234 kubenswrapper[2570]: W0706 18:11:14.237621    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98632a7b_ad80_434f_b868_49ddf7e20be1.slice/crio-cd76c6213d383ceef2666b2be12d7f1ef95db49e98af6450b95f895819b932bb WatchSource:0}: Error finding container cd76c6213d383ceef2666b2be12d7f1ef95db49e98af6450b95f895819b932bb: Status 404 returned error can't find the container with id cd76c6213d383ceef2666b2be12d7f1ef95db49e98af6450b95f895819b932bb
Jul 06 18:11:14.920683 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.920641    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn" event={"ID":"98632a7b-ad80-434f-b868-49ddf7e20be1","Type":"ContainerStarted","Data":"d791b3777837e930637d34a63aae3dea5f9728560ca24d1e8a10e2b32face5c4"}
Jul 06 18:11:14.921078 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.920710    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn" event={"ID":"98632a7b-ad80-434f-b868-49ddf7e20be1","Type":"ContainerStarted","Data":"cd76c6213d383ceef2666b2be12d7f1ef95db49e98af6450b95f895819b932bb"}
Jul 06 18:11:14.937999 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:14.937947    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn" podStartSLOduration=1.937931729 podStartE2EDuration="1.937931729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:11:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:11:14.93727745 +0000 UTC m=+1961.515478286" watchObservedRunningTime="2026-07-06 18:11:14.937931729 +0000 UTC m=+1961.516132564"
Jul 06 18:11:22.690788 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:22.690751    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:11:24.099770 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:24.099726    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:24.100150 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:24.099787    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:24.112038 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:24.112007    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:24.983718 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:24.983659    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:11:35.087237 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.087197    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"]
Jul 06 18:11:35.092456 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.092431    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.096658 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.096618    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3168b2\"/\"kube-root-ca.crt\""
Jul 06 18:11:35.097184 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.097021    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3168b2\"/\"test-model-3168b2-kserve-self-signed-certs\""
Jul 06 18:11:35.097184 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.097127    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3168b2\"/\"default-dockercfg-htpsw\""
Jul 06 18:11:35.097184 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.097141    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3168b2\"/\"openshift-service-ca.crt\""
Jul 06 18:11:35.098671 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.098646    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"]
Jul 06 18:11:35.108471 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.108443    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-home\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.108620 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.108524    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-model-cache\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.108620 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.108582    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf4th\" (UniqueName: \"kubernetes.io/projected/1c46bc82-b96d-4f49-a9a1-6088098e50c2-kube-api-access-rf4th\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.108768 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.108633    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-dshm\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.108768 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.108685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-tmp-dir\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.108768 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.108728    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c46bc82-b96d-4f49-a9a1-6088098e50c2-tls-certs\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.209632 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.209587    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-model-cache\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.209632 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.209637    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf4th\" (UniqueName: \"kubernetes.io/projected/1c46bc82-b96d-4f49-a9a1-6088098e50c2-kube-api-access-rf4th\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.209918 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.209677    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-dshm\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.209918 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.209739    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-tmp-dir\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.209918 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.209764    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c46bc82-b96d-4f49-a9a1-6088098e50c2-tls-certs\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.209918 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.209837    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-home\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.210123 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.210108    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-model-cache\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.210183 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.210148    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-tmp-dir\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.210259 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.210233    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-home\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.212308 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.212281    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-dshm\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.212453 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.212386    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c46bc82-b96d-4f49-a9a1-6088098e50c2-tls-certs\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.218150 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.218123    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf4th\" (UniqueName: \"kubernetes.io/projected/1c46bc82-b96d-4f49-a9a1-6088098e50c2-kube-api-access-rf4th\") pod \"test-model-3168b2-kserve-7654658969-4bs8w\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") " pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.404069 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.403980    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:35.549219 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:35.549192    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"]
Jul 06 18:11:35.551014 ip-10-0-128-234 kubenswrapper[2570]: W0706 18:11:35.550977    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c46bc82_b96d_4f49_a9a1_6088098e50c2.slice/crio-bbb52a7de80514bcb70ba0f90598590e1603a81690f727ecafd97c02551c53e5 WatchSource:0}: Error finding container bbb52a7de80514bcb70ba0f90598590e1603a81690f727ecafd97c02551c53e5: Status 404 returned error can't find the container with id bbb52a7de80514bcb70ba0f90598590e1603a81690f727ecafd97c02551c53e5
Jul 06 18:11:36.023990 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:36.023959    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w" event={"ID":"1c46bc82-b96d-4f49-a9a1-6088098e50c2","Type":"ContainerStarted","Data":"491f963f5ee58bd2eec0be89f2c5496fb567032def61e7f4fe2681a84baa2747"}
Jul 06 18:11:36.023990 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:36.024000    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w" event={"ID":"1c46bc82-b96d-4f49-a9a1-6088098e50c2","Type":"ContainerStarted","Data":"bbb52a7de80514bcb70ba0f90598590e1603a81690f727ecafd97c02551c53e5"}
Jul 06 18:11:36.042914 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:36.042860    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w" podStartSLOduration=1.042844385 podStartE2EDuration="1.042844385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:11:36.041255195 +0000 UTC m=+1982.619456032" watchObservedRunningTime="2026-07-06 18:11:36.042844385 +0000 UTC m=+1982.621045220"
Jul 06 18:11:39.091491 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:39.091456    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:11:45.405053 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:45.405021    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:45.405460 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:45.405095    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:45.417313 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:45.417290    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:46.086235 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:46.086207    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:11:55.487328 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:55.487287    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:11:56.353821 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:56.353774    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"]
Jul 06 18:11:57.274608 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:11:57.274572    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"]
Jul 06 18:12:09.887710 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:09.887671    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:12:11.373735 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.373672    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn" podUID="98632a7b-ad80-434f-b868-49ddf7e20be1" containerName="main" containerID="cri-o://d791b3777837e930637d34a63aae3dea5f9728560ca24d1e8a10e2b32face5c4" gracePeriod=45
Jul 06 18:12:11.624300 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.624247    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:12:11.737185 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.737152    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98632a7b-ad80-434f-b868-49ddf7e20be1-tls-certs\") pod \"98632a7b-ad80-434f-b868-49ddf7e20be1\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") "
Jul 06 18:12:11.737376 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.737213    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92llx\" (UniqueName: \"kubernetes.io/projected/98632a7b-ad80-434f-b868-49ddf7e20be1-kube-api-access-92llx\") pod \"98632a7b-ad80-434f-b868-49ddf7e20be1\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") "
Jul 06 18:12:11.737376 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.737276    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-tmp-dir\") pod \"98632a7b-ad80-434f-b868-49ddf7e20be1\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") "
Jul 06 18:12:11.737376 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.737316    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-dshm\") pod \"98632a7b-ad80-434f-b868-49ddf7e20be1\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") "
Jul 06 18:12:11.737376 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.737337    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-home\") pod \"98632a7b-ad80-434f-b868-49ddf7e20be1\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") "
Jul 06 18:12:11.737595 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.737387    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-model-cache\") pod \"98632a7b-ad80-434f-b868-49ddf7e20be1\" (UID: \"98632a7b-ad80-434f-b868-49ddf7e20be1\") "
Jul 06 18:12:11.737595 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.737575    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "98632a7b-ad80-434f-b868-49ddf7e20be1" (UID: "98632a7b-ad80-434f-b868-49ddf7e20be1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:12:11.737729 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.737617    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-home" (OuterVolumeSpecName: "home") pod "98632a7b-ad80-434f-b868-49ddf7e20be1" (UID: "98632a7b-ad80-434f-b868-49ddf7e20be1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:12:11.737729 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.737710    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:12:11.737824 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.737754    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-model-cache" (OuterVolumeSpecName: "model-cache") pod "98632a7b-ad80-434f-b868-49ddf7e20be1" (UID: "98632a7b-ad80-434f-b868-49ddf7e20be1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:12:11.739483 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.739457    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98632a7b-ad80-434f-b868-49ddf7e20be1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "98632a7b-ad80-434f-b868-49ddf7e20be1" (UID: "98632a7b-ad80-434f-b868-49ddf7e20be1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 18:12:11.739593 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.739500    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98632a7b-ad80-434f-b868-49ddf7e20be1-kube-api-access-92llx" (OuterVolumeSpecName: "kube-api-access-92llx") pod "98632a7b-ad80-434f-b868-49ddf7e20be1" (UID: "98632a7b-ad80-434f-b868-49ddf7e20be1"). InnerVolumeSpecName "kube-api-access-92llx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 18:12:11.739593 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.739530    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-dshm" (OuterVolumeSpecName: "dshm") pod "98632a7b-ad80-434f-b868-49ddf7e20be1" (UID: "98632a7b-ad80-434f-b868-49ddf7e20be1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:12:11.838626 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.838591    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98632a7b-ad80-434f-b868-49ddf7e20be1-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:12:11.838626 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.838621    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92llx\" (UniqueName: \"kubernetes.io/projected/98632a7b-ad80-434f-b868-49ddf7e20be1-kube-api-access-92llx\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:12:11.838626 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.838630    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:12:11.838883 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.838638    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:12:11.838883 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:11.838646    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98632a7b-ad80-434f-b868-49ddf7e20be1-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:12:12.202037 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.202004    2570 generic.go:356] "Generic (PLEG): container finished" podID="98632a7b-ad80-434f-b868-49ddf7e20be1" containerID="d791b3777837e930637d34a63aae3dea5f9728560ca24d1e8a10e2b32face5c4" exitCode=0
Jul 06 18:12:12.202208 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.202046    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"
Jul 06 18:12:12.202208 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.202088    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn" event={"ID":"98632a7b-ad80-434f-b868-49ddf7e20be1","Type":"ContainerDied","Data":"d791b3777837e930637d34a63aae3dea5f9728560ca24d1e8a10e2b32face5c4"}
Jul 06 18:12:12.202208 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.202130    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn" event={"ID":"98632a7b-ad80-434f-b868-49ddf7e20be1","Type":"ContainerDied","Data":"cd76c6213d383ceef2666b2be12d7f1ef95db49e98af6450b95f895819b932bb"}
Jul 06 18:12:12.202208 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.202149    2570 scope.go:117] "RemoveContainer" containerID="d791b3777837e930637d34a63aae3dea5f9728560ca24d1e8a10e2b32face5c4"
Jul 06 18:12:12.210389 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.210373    2570 scope.go:117] "RemoveContainer" containerID="d791b3777837e930637d34a63aae3dea5f9728560ca24d1e8a10e2b32face5c4"
Jul 06 18:12:12.210666 ip-10-0-128-234 kubenswrapper[2570]: E0706 18:12:12.210649    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d791b3777837e930637d34a63aae3dea5f9728560ca24d1e8a10e2b32face5c4\": container with ID starting with d791b3777837e930637d34a63aae3dea5f9728560ca24d1e8a10e2b32face5c4 not found: ID does not exist" containerID="d791b3777837e930637d34a63aae3dea5f9728560ca24d1e8a10e2b32face5c4"
Jul 06 18:12:12.210753 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.210673    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d791b3777837e930637d34a63aae3dea5f9728560ca24d1e8a10e2b32face5c4"} err="failed to get container status \"d791b3777837e930637d34a63aae3dea5f9728560ca24d1e8a10e2b32face5c4\": rpc error: code = NotFound desc = could not find container \"d791b3777837e930637d34a63aae3dea5f9728560ca24d1e8a10e2b32face5c4\": container with ID starting with d791b3777837e930637d34a63aae3dea5f9728560ca24d1e8a10e2b32face5c4 not found: ID does not exist"
Jul 06 18:12:12.220085 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.220063    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"]
Jul 06 18:12:12.223732 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.223713    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-b635d0/test-model-b635d0-kserve-778f4c56cc-8kbbn"]
Jul 06 18:12:12.295505 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.295422    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w" podUID="1c46bc82-b96d-4f49-a9a1-6088098e50c2" containerName="main" containerID="cri-o://491f963f5ee58bd2eec0be89f2c5496fb567032def61e7f4fe2681a84baa2747" gracePeriod=45
Jul 06 18:12:12.554481 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.554425    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:12:12.645769 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.645736    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf4th\" (UniqueName: \"kubernetes.io/projected/1c46bc82-b96d-4f49-a9a1-6088098e50c2-kube-api-access-rf4th\") pod \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") "
Jul 06 18:12:12.645963 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.645777    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c46bc82-b96d-4f49-a9a1-6088098e50c2-tls-certs\") pod \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") "
Jul 06 18:12:12.645963 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.645794    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-tmp-dir\") pod \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") "
Jul 06 18:12:12.645963 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.645834    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-home\") pod \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") "
Jul 06 18:12:12.645963 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.645861    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-model-cache\") pod \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") "
Jul 06 18:12:12.645963 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.645910    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-dshm\") pod \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\" (UID: \"1c46bc82-b96d-4f49-a9a1-6088098e50c2\") "
Jul 06 18:12:12.646229 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.646115    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-home" (OuterVolumeSpecName: "home") pod "1c46bc82-b96d-4f49-a9a1-6088098e50c2" (UID: "1c46bc82-b96d-4f49-a9a1-6088098e50c2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:12:12.646229 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.646126    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1c46bc82-b96d-4f49-a9a1-6088098e50c2" (UID: "1c46bc82-b96d-4f49-a9a1-6088098e50c2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:12:12.646229 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.646138    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-model-cache" (OuterVolumeSpecName: "model-cache") pod "1c46bc82-b96d-4f49-a9a1-6088098e50c2" (UID: "1c46bc82-b96d-4f49-a9a1-6088098e50c2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:12:12.646374 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.646282    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:12:12.646374 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.646304    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:12:12.646374 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.646319    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:12:12.648131 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.648105    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c46bc82-b96d-4f49-a9a1-6088098e50c2-kube-api-access-rf4th" (OuterVolumeSpecName: "kube-api-access-rf4th") pod "1c46bc82-b96d-4f49-a9a1-6088098e50c2" (UID: "1c46bc82-b96d-4f49-a9a1-6088098e50c2"). InnerVolumeSpecName "kube-api-access-rf4th". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 18:12:12.648131 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.648119    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c46bc82-b96d-4f49-a9a1-6088098e50c2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1c46bc82-b96d-4f49-a9a1-6088098e50c2" (UID: "1c46bc82-b96d-4f49-a9a1-6088098e50c2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 18:12:12.648304 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.648122    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-dshm" (OuterVolumeSpecName: "dshm") pod "1c46bc82-b96d-4f49-a9a1-6088098e50c2" (UID: "1c46bc82-b96d-4f49-a9a1-6088098e50c2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:12:12.747595 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.747552    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf4th\" (UniqueName: \"kubernetes.io/projected/1c46bc82-b96d-4f49-a9a1-6088098e50c2-kube-api-access-rf4th\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:12:12.747595 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.747589    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c46bc82-b96d-4f49-a9a1-6088098e50c2-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:12:12.747595 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:12.747606    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c46bc82-b96d-4f49-a9a1-6088098e50c2-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:12:13.209746 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:13.209714    2570 generic.go:356] "Generic (PLEG): container finished" podID="1c46bc82-b96d-4f49-a9a1-6088098e50c2" containerID="491f963f5ee58bd2eec0be89f2c5496fb567032def61e7f4fe2681a84baa2747" exitCode=0
Jul 06 18:12:13.209746 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:13.209742    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"
Jul 06 18:12:13.209983 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:13.209771    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w" event={"ID":"1c46bc82-b96d-4f49-a9a1-6088098e50c2","Type":"ContainerDied","Data":"491f963f5ee58bd2eec0be89f2c5496fb567032def61e7f4fe2681a84baa2747"}
Jul 06 18:12:13.209983 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:13.209806    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w" event={"ID":"1c46bc82-b96d-4f49-a9a1-6088098e50c2","Type":"ContainerDied","Data":"bbb52a7de80514bcb70ba0f90598590e1603a81690f727ecafd97c02551c53e5"}
Jul 06 18:12:13.209983 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:13.209827    2570 scope.go:117] "RemoveContainer" containerID="491f963f5ee58bd2eec0be89f2c5496fb567032def61e7f4fe2681a84baa2747"
Jul 06 18:12:13.219049 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:13.219030    2570 scope.go:117] "RemoveContainer" containerID="491f963f5ee58bd2eec0be89f2c5496fb567032def61e7f4fe2681a84baa2747"
Jul 06 18:12:13.219300 ip-10-0-128-234 kubenswrapper[2570]: E0706 18:12:13.219282    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"491f963f5ee58bd2eec0be89f2c5496fb567032def61e7f4fe2681a84baa2747\": container with ID starting with 491f963f5ee58bd2eec0be89f2c5496fb567032def61e7f4fe2681a84baa2747 not found: ID does not exist" containerID="491f963f5ee58bd2eec0be89f2c5496fb567032def61e7f4fe2681a84baa2747"
Jul 06 18:12:13.219358 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:13.219309    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"491f963f5ee58bd2eec0be89f2c5496fb567032def61e7f4fe2681a84baa2747"} err="failed to get container status \"491f963f5ee58bd2eec0be89f2c5496fb567032def61e7f4fe2681a84baa2747\": rpc error: code = NotFound desc = could not find container \"491f963f5ee58bd2eec0be89f2c5496fb567032def61e7f4fe2681a84baa2747\": container with ID starting with 491f963f5ee58bd2eec0be89f2c5496fb567032def61e7f4fe2681a84baa2747 not found: ID does not exist"
Jul 06 18:12:13.231434 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:13.231406    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"]
Jul 06 18:12:13.236644 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:13.236623    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-3168b2/test-model-3168b2-kserve-7654658969-4bs8w"]
Jul 06 18:12:13.973865 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:13.973833    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c46bc82-b96d-4f49-a9a1-6088098e50c2" path="/var/lib/kubelet/pods/1c46bc82-b96d-4f49-a9a1-6088098e50c2/volumes"
Jul 06 18:12:13.974250 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:13.974234    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98632a7b-ad80-434f-b868-49ddf7e20be1" path="/var/lib/kubelet/pods/98632a7b-ad80-434f-b868-49ddf7e20be1/volumes"
Jul 06 18:12:44.188935 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:44.188900    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:12:56.287475 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:12:56.287394    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:13:05.987399 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:05.987362    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:13:17.989618 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:17.989585    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:13:29.286389 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:29.286352    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:13:34.007496 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:34.007465    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 18:13:34.011205 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:34.011184    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 18:13:41.897998 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:41.897966    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:13:48.886595 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.886560    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"]
Jul 06 18:13:48.887161 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.887124    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c46bc82-b96d-4f49-a9a1-6088098e50c2" containerName="main"
Jul 06 18:13:48.887161 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.887145    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c46bc82-b96d-4f49-a9a1-6088098e50c2" containerName="main"
Jul 06 18:13:48.887295 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.887168    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98632a7b-ad80-434f-b868-49ddf7e20be1" containerName="main"
Jul 06 18:13:48.887295 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.887177    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="98632a7b-ad80-434f-b868-49ddf7e20be1" containerName="main"
Jul 06 18:13:48.887295 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.887272    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="98632a7b-ad80-434f-b868-49ddf7e20be1" containerName="main"
Jul 06 18:13:48.887295 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.887285    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c46bc82-b96d-4f49-a9a1-6088098e50c2" containerName="main"
Jul 06 18:13:48.890415 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.890391    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:48.894540 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.894516    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3b0a18\"/\"kube-root-ca.crt\""
Jul 06 18:13:48.894674 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.894571    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3b0a18\"/\"default-dockercfg-4djfh\""
Jul 06 18:13:48.894674 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.894614    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3b0a18\"/\"openshift-service-ca.crt\""
Jul 06 18:13:48.894674 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.894628    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3b0a18\"/\"auth-test-model-3b0a18-kserve-self-signed-certs\""
Jul 06 18:13:48.900065 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.900043    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"]
Jul 06 18:13:48.990637 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.990594    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-model-cache\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:48.990637 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.990633    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-tmp-dir\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:48.990890 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.990661    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf89f\" (UniqueName: \"kubernetes.io/projected/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-kube-api-access-kf89f\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:48.990890 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.990807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-dshm\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:48.990890 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.990832    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-tls-certs\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:48.990890 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:48.990858    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-home\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:49.091896 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.091856    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-dshm\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:49.091896 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.091898    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-tls-certs\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:49.092139 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.092023    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-home\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:49.092139 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.092114    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-model-cache\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:49.092259 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.092138    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-tmp-dir\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:49.092259 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.092175    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf89f\" (UniqueName: \"kubernetes.io/projected/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-kube-api-access-kf89f\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:49.092776 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.092391    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-home\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:49.092776 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.092729    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-tmp-dir\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:49.092776 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.092744    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-model-cache\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:49.094201 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.094178    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-dshm\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:49.094451 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.094434    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-tls-certs\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:49.100794 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.100776    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf89f\" (UniqueName: \"kubernetes.io/projected/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-kube-api-access-kf89f\") pod \"auth-test-model-3b0a18-kserve-6468584479-f8g6c\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") " pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:49.200787 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.200757    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:49.350761 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.350733    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"]
Jul 06 18:13:49.352767 ip-10-0-128-234 kubenswrapper[2570]: W0706 18:13:49.352737    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfbb4701_4416_40b2_8f44_ad7f1a352c7b.slice/crio-f5b560bfd304e473856d3cf8456166a6e6cc6d756114cd24e9c2b94fd24f72d7 WatchSource:0}: Error finding container f5b560bfd304e473856d3cf8456166a6e6cc6d756114cd24e9c2b94fd24f72d7: Status 404 returned error can't find the container with id f5b560bfd304e473856d3cf8456166a6e6cc6d756114cd24e9c2b94fd24f72d7
Jul 06 18:13:49.663060 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.662967    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c" event={"ID":"bfbb4701-4416-40b2-8f44-ad7f1a352c7b","Type":"ContainerStarted","Data":"5b2b1425724d8dfc2fdc4ab2d55d6bfaff2fe84fd468bd3bdac6a8421683a77f"}
Jul 06 18:13:49.663060 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.663010    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c" event={"ID":"bfbb4701-4416-40b2-8f44-ad7f1a352c7b","Type":"ContainerStarted","Data":"f5b560bfd304e473856d3cf8456166a6e6cc6d756114cd24e9c2b94fd24f72d7"}
Jul 06 18:13:49.680443 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:49.680393    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c" podStartSLOduration=1.680378863 podStartE2EDuration="1.680378863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:13:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:13:49.679509715 +0000 UTC m=+2116.257710551" watchObservedRunningTime="2026-07-06 18:13:49.680378863 +0000 UTC m=+2116.258579699"
Jul 06 18:13:54.183901 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:54.183866    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:13:59.201845 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:59.201815    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:59.202312 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:59.201865    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:59.214240 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:59.214211    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:13:59.720709 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:13:59.720676    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:14:09.700353 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.700321    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"]
Jul 06 18:14:09.703795 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.703778    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.707671 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.707647    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a0e97d\"/\"auth-test-model-a0e97d-kserve-self-signed-certs\""
Jul 06 18:14:09.708970 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.708950    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a0e97d\"/\"kube-root-ca.crt\""
Jul 06 18:14:09.709116 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.709103    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a0e97d\"/\"openshift-service-ca.crt\""
Jul 06 18:14:09.709172 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.709160    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a0e97d\"/\"default-dockercfg-8w27q\""
Jul 06 18:14:09.715605 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.715578    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"]
Jul 06 18:14:09.769495 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.769465    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-home\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.769495 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.769497    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqthq\" (UniqueName: \"kubernetes.io/projected/56d5f301-334d-4f01-ba1a-2645832312de-kube-api-access-tqthq\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.769682 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.769529    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-model-cache\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.769682 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.769577    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d5f301-334d-4f01-ba1a-2645832312de-tls-certs\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.769682 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.769663    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-tmp-dir\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.769815 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.769724    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-dshm\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.870085 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.870053    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-tmp-dir\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.870275 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.870093    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-dshm\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.870275 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.870123    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-home\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.870275 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.870140    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqthq\" (UniqueName: \"kubernetes.io/projected/56d5f301-334d-4f01-ba1a-2645832312de-kube-api-access-tqthq\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.870275 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.870168    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-model-cache\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.870275 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.870214    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d5f301-334d-4f01-ba1a-2645832312de-tls-certs\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.870556 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.870533    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-tmp-dir\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.870620 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.870556    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-home\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.870620 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.870608    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-model-cache\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.872516 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.872480    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-dshm\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.872898 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.872879    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d5f301-334d-4f01-ba1a-2645832312de-tls-certs\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:09.878421 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:09.878395    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqthq\" (UniqueName: \"kubernetes.io/projected/56d5f301-334d-4f01-ba1a-2645832312de-kube-api-access-tqthq\") pod \"auth-test-model-a0e97d-kserve-55595dc74c-chnmp\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") " pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:10.014482 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:10.014388    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:10.147595 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:10.147560    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"]
Jul 06 18:14:10.149168 ip-10-0-128-234 kubenswrapper[2570]: W0706 18:14:10.149142    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56d5f301_334d_4f01_ba1a_2645832312de.slice/crio-5724044fb2754b09d8b97c3d078d27df154d86d85d651c10a67eac58f242421a WatchSource:0}: Error finding container 5724044fb2754b09d8b97c3d078d27df154d86d85d651c10a67eac58f242421a: Status 404 returned error can't find the container with id 5724044fb2754b09d8b97c3d078d27df154d86d85d651c10a67eac58f242421a
Jul 06 18:14:10.764984 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:10.764949    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp" event={"ID":"56d5f301-334d-4f01-ba1a-2645832312de","Type":"ContainerStarted","Data":"28605a1085a0fdcd242d6b5884e7f8800a485fd1582b57217400f037d020949d"}
Jul 06 18:14:10.765342 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:10.764995    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp" event={"ID":"56d5f301-334d-4f01-ba1a-2645832312de","Type":"ContainerStarted","Data":"5724044fb2754b09d8b97c3d078d27df154d86d85d651c10a67eac58f242421a"}
Jul 06 18:14:10.784166 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:10.784122    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp" podStartSLOduration=1.784108437 podStartE2EDuration="1.784108437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:14:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:14:10.782275357 +0000 UTC m=+2137.360476194" watchObservedRunningTime="2026-07-06 18:14:10.784108437 +0000 UTC m=+2137.362309274"
Jul 06 18:14:13.382902 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:13.382867    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:14:20.015529 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:20.015489    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:20.016167 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:20.015632    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:20.028223 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:20.028198    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:20.823068 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:20.823043    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:14:28.891281 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:28.891203    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:14:46.680554 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:46.680513    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:14:59.586766 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:14:59.586730    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:15:12.982623 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:15:12.982581    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:15:28.387489 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:15:28.387456    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:15:43.192390 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:15:43.192356    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:15:56.770342 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:15:56.770268    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"]
Jul 06 18:15:57.677934 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:15:57.677902    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"]
Jul 06 18:16:00.383738 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:00.383689    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:16:10.493151 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.493121    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"]
Jul 06 18:16:10.496530 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.496514    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.499249 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.499226    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3b0a18\"/\"sub-test-model-3b0a18-kserve-self-signed-certs\""
Jul 06 18:16:10.505177 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.505158    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"]
Jul 06 18:16:10.623623 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.623587    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6zfb\" (UniqueName: \"kubernetes.io/projected/234f33dd-d492-4f3d-8270-77dccc539c6f-kube-api-access-l6zfb\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.623623 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.623631    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-tmp-dir\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.623878 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.623754    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/234f33dd-d492-4f3d-8270-77dccc539c6f-tls-certs\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.623878 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.623786    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-dshm\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.623878 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.623805    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-home\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.623878 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.623821    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-model-cache\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.724297 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.724265    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-tmp-dir\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.724504 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.724331    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/234f33dd-d492-4f3d-8270-77dccc539c6f-tls-certs\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.724504 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.724358    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-dshm\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.724504 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.724382    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-home\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.724504 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.724402    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-model-cache\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.724751 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.724520    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6zfb\" (UniqueName: \"kubernetes.io/projected/234f33dd-d492-4f3d-8270-77dccc539c6f-kube-api-access-l6zfb\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.724819 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.724758    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-tmp-dir\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.724882 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.724830    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-home\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.724929 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.724876    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-model-cache\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.726629 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.726607    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-dshm\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.726917 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.726901    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/234f33dd-d492-4f3d-8270-77dccc539c6f-tls-certs\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.732538 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.732513    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6zfb\" (UniqueName: \"kubernetes.io/projected/234f33dd-d492-4f3d-8270-77dccc539c6f-kube-api-access-l6zfb\") pod \"sub-test-model-3b0a18-kserve-79bbb75df-4qv5w\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") " pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.806239 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.806152    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:10.943337 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:10.943249    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"]
Jul 06 18:16:10.946008 ip-10-0-128-234 kubenswrapper[2570]: W0706 18:16:10.945970    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod234f33dd_d492_4f3d_8270_77dccc539c6f.slice/crio-94762a0c5d3c927b4a06104c597d0117500f14f5576aa7123ee02546409f12fe WatchSource:0}: Error finding container 94762a0c5d3c927b4a06104c597d0117500f14f5576aa7123ee02546409f12fe: Status 404 returned error can't find the container with id 94762a0c5d3c927b4a06104c597d0117500f14f5576aa7123ee02546409f12fe
Jul 06 18:16:11.334077 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:11.334044    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w" event={"ID":"234f33dd-d492-4f3d-8270-77dccc539c6f","Type":"ContainerStarted","Data":"58f586ad7ea0697656a25732eb0b88a35a4db4c2cdb44bfeb8ae12424433a37d"}
Jul 06 18:16:11.334077 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:11.334084    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w" event={"ID":"234f33dd-d492-4f3d-8270-77dccc539c6f","Type":"ContainerStarted","Data":"94762a0c5d3c927b4a06104c597d0117500f14f5576aa7123ee02546409f12fe"}
Jul 06 18:16:11.351356 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:11.351304    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w" podStartSLOduration=1.351289412 podStartE2EDuration="1.351289412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:16:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:16:11.349645528 +0000 UTC m=+2257.927846364" watchObservedRunningTime="2026-07-06 18:16:11.351289412 +0000 UTC m=+2257.929490248"
Jul 06 18:16:11.792171 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:11.792122    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c" podUID="bfbb4701-4416-40b2-8f44-ad7f1a352c7b" containerName="main" containerID="cri-o://5b2b1425724d8dfc2fdc4ab2d55d6bfaff2fe84fd468bd3bdac6a8421683a77f" gracePeriod=45
Jul 06 18:16:12.051001 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.050938    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:16:12.136062 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.136028    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-tls-certs\") pod \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") "
Jul 06 18:16:12.136250 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.136072    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-tmp-dir\") pod \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") "
Jul 06 18:16:12.136250 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.136104    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-home\") pod \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") "
Jul 06 18:16:12.136250 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.136129    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf89f\" (UniqueName: \"kubernetes.io/projected/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-kube-api-access-kf89f\") pod \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") "
Jul 06 18:16:12.136250 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.136174    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-model-cache\") pod \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") "
Jul 06 18:16:12.136250 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.136234    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-dshm\") pod \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\" (UID: \"bfbb4701-4416-40b2-8f44-ad7f1a352c7b\") "
Jul 06 18:16:12.136539 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.136382    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bfbb4701-4416-40b2-8f44-ad7f1a352c7b" (UID: "bfbb4701-4416-40b2-8f44-ad7f1a352c7b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:16:12.136539 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.136399    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-home" (OuterVolumeSpecName: "home") pod "bfbb4701-4416-40b2-8f44-ad7f1a352c7b" (UID: "bfbb4701-4416-40b2-8f44-ad7f1a352c7b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:16:12.136539 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.136474    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:16:12.136539 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.136493    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:16:12.136539 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.136495    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-model-cache" (OuterVolumeSpecName: "model-cache") pod "bfbb4701-4416-40b2-8f44-ad7f1a352c7b" (UID: "bfbb4701-4416-40b2-8f44-ad7f1a352c7b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:16:12.138390 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.138363    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bfbb4701-4416-40b2-8f44-ad7f1a352c7b" (UID: "bfbb4701-4416-40b2-8f44-ad7f1a352c7b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 18:16:12.138511 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.138407    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-dshm" (OuterVolumeSpecName: "dshm") pod "bfbb4701-4416-40b2-8f44-ad7f1a352c7b" (UID: "bfbb4701-4416-40b2-8f44-ad7f1a352c7b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:16:12.138511 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.138422    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-kube-api-access-kf89f" (OuterVolumeSpecName: "kube-api-access-kf89f") pod "bfbb4701-4416-40b2-8f44-ad7f1a352c7b" (UID: "bfbb4701-4416-40b2-8f44-ad7f1a352c7b"). InnerVolumeSpecName "kube-api-access-kf89f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 18:16:12.237126 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.237088    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:16:12.237126 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.237115    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf89f\" (UniqueName: \"kubernetes.io/projected/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-kube-api-access-kf89f\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:16:12.237126 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.237128    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:16:12.237126 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.237136    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4701-4416-40b2-8f44-ad7f1a352c7b-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:16:12.340568 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.340483    2570 generic.go:356] "Generic (PLEG): container finished" podID="bfbb4701-4416-40b2-8f44-ad7f1a352c7b" containerID="5b2b1425724d8dfc2fdc4ab2d55d6bfaff2fe84fd468bd3bdac6a8421683a77f" exitCode=0
Jul 06 18:16:12.340568 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.340528    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"
Jul 06 18:16:12.340826 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.340573    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c" event={"ID":"bfbb4701-4416-40b2-8f44-ad7f1a352c7b","Type":"ContainerDied","Data":"5b2b1425724d8dfc2fdc4ab2d55d6bfaff2fe84fd468bd3bdac6a8421683a77f"}
Jul 06 18:16:12.340826 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.340623    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c" event={"ID":"bfbb4701-4416-40b2-8f44-ad7f1a352c7b","Type":"ContainerDied","Data":"f5b560bfd304e473856d3cf8456166a6e6cc6d756114cd24e9c2b94fd24f72d7"}
Jul 06 18:16:12.340826 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.340646    2570 scope.go:117] "RemoveContainer" containerID="5b2b1425724d8dfc2fdc4ab2d55d6bfaff2fe84fd468bd3bdac6a8421683a77f"
Jul 06 18:16:12.351229 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.351211    2570 scope.go:117] "RemoveContainer" containerID="5b2b1425724d8dfc2fdc4ab2d55d6bfaff2fe84fd468bd3bdac6a8421683a77f"
Jul 06 18:16:12.352386 ip-10-0-128-234 kubenswrapper[2570]: E0706 18:16:12.351983    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b2b1425724d8dfc2fdc4ab2d55d6bfaff2fe84fd468bd3bdac6a8421683a77f\": container with ID starting with 5b2b1425724d8dfc2fdc4ab2d55d6bfaff2fe84fd468bd3bdac6a8421683a77f not found: ID does not exist" containerID="5b2b1425724d8dfc2fdc4ab2d55d6bfaff2fe84fd468bd3bdac6a8421683a77f"
Jul 06 18:16:12.352386 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.352019    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b2b1425724d8dfc2fdc4ab2d55d6bfaff2fe84fd468bd3bdac6a8421683a77f"} err="failed to get container status \"5b2b1425724d8dfc2fdc4ab2d55d6bfaff2fe84fd468bd3bdac6a8421683a77f\": rpc error: code = NotFound desc = could not find container \"5b2b1425724d8dfc2fdc4ab2d55d6bfaff2fe84fd468bd3bdac6a8421683a77f\": container with ID starting with 5b2b1425724d8dfc2fdc4ab2d55d6bfaff2fe84fd468bd3bdac6a8421683a77f not found: ID does not exist"
Jul 06 18:16:12.366504 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.366480    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"]
Jul 06 18:16:12.370185 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.370163    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/auth-test-model-3b0a18-kserve-6468584479-f8g6c"]
Jul 06 18:16:12.698476 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.698433    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp" podUID="56d5f301-334d-4f01-ba1a-2645832312de" containerName="main" containerID="cri-o://28605a1085a0fdcd242d6b5884e7f8800a485fd1582b57217400f037d020949d" gracePeriod=45
Jul 06 18:16:12.948883 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:12.948826    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:16:13.042800 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.042773    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqthq\" (UniqueName: \"kubernetes.io/projected/56d5f301-334d-4f01-ba1a-2645832312de-kube-api-access-tqthq\") pod \"56d5f301-334d-4f01-ba1a-2645832312de\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") "
Jul 06 18:16:13.042962 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.042825    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d5f301-334d-4f01-ba1a-2645832312de-tls-certs\") pod \"56d5f301-334d-4f01-ba1a-2645832312de\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") "
Jul 06 18:16:13.042962 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.042847    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-tmp-dir\") pod \"56d5f301-334d-4f01-ba1a-2645832312de\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") "
Jul 06 18:16:13.042962 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.042883    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-dshm\") pod \"56d5f301-334d-4f01-ba1a-2645832312de\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") "
Jul 06 18:16:13.042962 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.042901    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-model-cache\") pod \"56d5f301-334d-4f01-ba1a-2645832312de\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") "
Jul 06 18:16:13.043194 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.042952    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-home\") pod \"56d5f301-334d-4f01-ba1a-2645832312de\" (UID: \"56d5f301-334d-4f01-ba1a-2645832312de\") "
Jul 06 18:16:13.043194 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.043173    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-model-cache" (OuterVolumeSpecName: "model-cache") pod "56d5f301-334d-4f01-ba1a-2645832312de" (UID: "56d5f301-334d-4f01-ba1a-2645832312de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:16:13.043305 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.043182    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "56d5f301-334d-4f01-ba1a-2645832312de" (UID: "56d5f301-334d-4f01-ba1a-2645832312de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:16:13.043668 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.043526    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-home" (OuterVolumeSpecName: "home") pod "56d5f301-334d-4f01-ba1a-2645832312de" (UID: "56d5f301-334d-4f01-ba1a-2645832312de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:16:13.043668 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.043592    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:16:13.043668 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.043612    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:16:13.045127 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.045095    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-dshm" (OuterVolumeSpecName: "dshm") pod "56d5f301-334d-4f01-ba1a-2645832312de" (UID: "56d5f301-334d-4f01-ba1a-2645832312de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:16:13.045374 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.045345    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d5f301-334d-4f01-ba1a-2645832312de-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "56d5f301-334d-4f01-ba1a-2645832312de" (UID: "56d5f301-334d-4f01-ba1a-2645832312de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 18:16:13.045501 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.045421    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d5f301-334d-4f01-ba1a-2645832312de-kube-api-access-tqthq" (OuterVolumeSpecName: "kube-api-access-tqthq") pod "56d5f301-334d-4f01-ba1a-2645832312de" (UID: "56d5f301-334d-4f01-ba1a-2645832312de"). InnerVolumeSpecName "kube-api-access-tqthq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 18:16:13.144607 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.144582    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:16:13.144607 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.144604    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqthq\" (UniqueName: \"kubernetes.io/projected/56d5f301-334d-4f01-ba1a-2645832312de-kube-api-access-tqthq\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:16:13.144607 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.144613    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d5f301-334d-4f01-ba1a-2645832312de-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:16:13.144822 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.144621    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d5f301-334d-4f01-ba1a-2645832312de-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:16:13.354378 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.354280    2570 generic.go:356] "Generic (PLEG): container finished" podID="56d5f301-334d-4f01-ba1a-2645832312de" containerID="28605a1085a0fdcd242d6b5884e7f8800a485fd1582b57217400f037d020949d" exitCode=0
Jul 06 18:16:13.354378 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.354332    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp" event={"ID":"56d5f301-334d-4f01-ba1a-2645832312de","Type":"ContainerDied","Data":"28605a1085a0fdcd242d6b5884e7f8800a485fd1582b57217400f037d020949d"}
Jul 06 18:16:13.354378 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.354359    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp" event={"ID":"56d5f301-334d-4f01-ba1a-2645832312de","Type":"ContainerDied","Data":"5724044fb2754b09d8b97c3d078d27df154d86d85d651c10a67eac58f242421a"}
Jul 06 18:16:13.354378 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.354358    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"
Jul 06 18:16:13.354378 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.354375    2570 scope.go:117] "RemoveContainer" containerID="28605a1085a0fdcd242d6b5884e7f8800a485fd1582b57217400f037d020949d"
Jul 06 18:16:13.363125 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.363104    2570 scope.go:117] "RemoveContainer" containerID="28605a1085a0fdcd242d6b5884e7f8800a485fd1582b57217400f037d020949d"
Jul 06 18:16:13.363395 ip-10-0-128-234 kubenswrapper[2570]: E0706 18:16:13.363375    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28605a1085a0fdcd242d6b5884e7f8800a485fd1582b57217400f037d020949d\": container with ID starting with 28605a1085a0fdcd242d6b5884e7f8800a485fd1582b57217400f037d020949d not found: ID does not exist" containerID="28605a1085a0fdcd242d6b5884e7f8800a485fd1582b57217400f037d020949d"
Jul 06 18:16:13.363446 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.363404    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28605a1085a0fdcd242d6b5884e7f8800a485fd1582b57217400f037d020949d"} err="failed to get container status \"28605a1085a0fdcd242d6b5884e7f8800a485fd1582b57217400f037d020949d\": rpc error: code = NotFound desc = could not find container \"28605a1085a0fdcd242d6b5884e7f8800a485fd1582b57217400f037d020949d\": container with ID starting with 28605a1085a0fdcd242d6b5884e7f8800a485fd1582b57217400f037d020949d not found: ID does not exist"
Jul 06 18:16:13.375421 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.375400    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"]
Jul 06 18:16:13.379240 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.379221    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/auth-test-model-a0e97d-kserve-55595dc74c-chnmp"]
Jul 06 18:16:13.973975 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.973947    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56d5f301-334d-4f01-ba1a-2645832312de" path="/var/lib/kubelet/pods/56d5f301-334d-4f01-ba1a-2645832312de/volumes"
Jul 06 18:16:13.974332 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:13.974322    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfbb4701-4416-40b2-8f44-ad7f1a352c7b" path="/var/lib/kubelet/pods/bfbb4701-4416-40b2-8f44-ad7f1a352c7b/volumes"
Jul 06 18:16:15.483027 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:15.482991    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:16:20.806886 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:20.806845    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:20.806886 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:20.806894    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:20.819281 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:20.819250    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:21.403918 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:21.403891    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:16:29.981244 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:29.981214    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"]
Jul 06 18:16:29.981780 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:29.981762    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfbb4701-4416-40b2-8f44-ad7f1a352c7b" containerName="main"
Jul 06 18:16:29.981869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:29.981782    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfbb4701-4416-40b2-8f44-ad7f1a352c7b" containerName="main"
Jul 06 18:16:29.981869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:29.981812    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d5f301-334d-4f01-ba1a-2645832312de" containerName="main"
Jul 06 18:16:29.981869 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:29.981821    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d5f301-334d-4f01-ba1a-2645832312de" containerName="main"
Jul 06 18:16:29.982033 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:29.981919    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfbb4701-4416-40b2-8f44-ad7f1a352c7b" containerName="main"
Jul 06 18:16:29.982033 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:29.981931    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d5f301-334d-4f01-ba1a-2645832312de" containerName="main"
Jul 06 18:16:29.986197 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:29.986177    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:29.990565 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:29.990367    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a0e97d\"/\"openshift-service-ca.crt\""
Jul 06 18:16:29.990565 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:29.990386    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a0e97d\"/\"sub-test-model-a0e97d-kserve-self-signed-certs\""
Jul 06 18:16:29.990565 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:29.990368    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a0e97d\"/\"default-dockercfg-8w27q\""
Jul 06 18:16:29.990565 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:29.990434    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a0e97d\"/\"kube-root-ca.crt\""
Jul 06 18:16:29.993077 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:29.993053    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"]
Jul 06 18:16:30.093389 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.093351    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-229s8\" (UniqueName: \"kubernetes.io/projected/059182d3-1cb9-4207-8def-3395939d9f29-kube-api-access-229s8\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.093389 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.093393    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/059182d3-1cb9-4207-8def-3395939d9f29-tls-certs\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.093616 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.093501    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-dshm\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.093616 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.093540    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-tmp-dir\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.093616 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.093564    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-model-cache\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.093616 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.093593    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-home\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.194281 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.194251    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-dshm\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.194475 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.194292    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-tmp-dir\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.194475 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.194427    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-model-cache\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.194602 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.194490    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-home\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.194602 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.194540    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-229s8\" (UniqueName: \"kubernetes.io/projected/059182d3-1cb9-4207-8def-3395939d9f29-kube-api-access-229s8\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.194602 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.194582    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/059182d3-1cb9-4207-8def-3395939d9f29-tls-certs\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.194786 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.194680    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-tmp-dir\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.194860 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.194791    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-model-cache\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.194860 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.194843    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-home\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.196653 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.196623    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-dshm\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.197119 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.197100    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/059182d3-1cb9-4207-8def-3395939d9f29-tls-certs\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.202901 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.202878    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-229s8\" (UniqueName: \"kubernetes.io/projected/059182d3-1cb9-4207-8def-3395939d9f29-kube-api-access-229s8\") pod \"sub-test-model-a0e97d-kserve-8686f584cf-w48sl\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") " pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.297340 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.297254    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:30.444735 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:30.440503    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"]
Jul 06 18:16:31.446864 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:31.446826    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl" event={"ID":"059182d3-1cb9-4207-8def-3395939d9f29","Type":"ContainerStarted","Data":"d6c6aabba63aff583e1eae2f572d5ba9d504b139914fb5e158bef189ebe67197"}
Jul 06 18:16:31.446864 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:31.446868    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl" event={"ID":"059182d3-1cb9-4207-8def-3395939d9f29","Type":"ContainerStarted","Data":"fa1965e67403ea618da62dbabc8d51d4e1fc958e7feaa007f00689dfbeff48e0"}
Jul 06 18:16:31.464472 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:31.464421    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl" podStartSLOduration=2.464406663 podStartE2EDuration="2.464406663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:16:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:16:31.463238804 +0000 UTC m=+2278.041439661" watchObservedRunningTime="2026-07-06 18:16:31.464406663 +0000 UTC m=+2278.042607499"
Jul 06 18:16:33.996323 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:33.996289    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:16:40.298044 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:40.298003    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:40.298418 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:40.298062    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:40.310745 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:40.310718    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:16:40.501900 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:16:40.501872    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:17:05.696410 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:05.696373    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:17:23.995890 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:23.995853    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:17:25.321069 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:25.321028    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"]
Jul 06 18:17:26.115279 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:26.115187    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"]
Jul 06 18:17:32.593386 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.593354    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"]
Jul 06 18:17:32.596934 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.596914    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.599710 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.599671    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3b0a18\"/\"rate-test-model-3b0a18-kserve-self-signed-certs\""
Jul 06 18:17:32.607906 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.607881    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"]
Jul 06 18:17:32.747232 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.747199    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-dshm\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.747232 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.747238    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-home\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.747481 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.747254    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-tmp-dir\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.747481 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.747302    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1168622e-e50b-4234-8a6f-5209f70466d0-tls-certs\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.747481 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.747331    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-model-cache\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.747481 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.747437    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m568n\" (UniqueName: \"kubernetes.io/projected/1168622e-e50b-4234-8a6f-5209f70466d0-kube-api-access-m568n\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.848825 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.848669    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m568n\" (UniqueName: \"kubernetes.io/projected/1168622e-e50b-4234-8a6f-5209f70466d0-kube-api-access-m568n\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.848825 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.848750    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-dshm\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.848825 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.848789    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-home\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.848825 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.848813    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-tmp-dir\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.849163 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.848857    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1168622e-e50b-4234-8a6f-5209f70466d0-tls-certs\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.849163 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.848907    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-model-cache\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.849348 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.849314    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-home\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.849477 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.849352    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-model-cache\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.849477 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.849317    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-tmp-dir\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.851230 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.851206    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-dshm\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.851474 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.851457    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1168622e-e50b-4234-8a6f-5209f70466d0-tls-certs\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.856354 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.856334    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m568n\" (UniqueName: \"kubernetes.io/projected/1168622e-e50b-4234-8a6f-5209f70466d0-kube-api-access-m568n\") pod \"rate-test-model-3b0a18-kserve-7f896f6cf5-nh969\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") " pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:32.906378 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:32.906352    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:33.041739 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:33.041711    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"]
Jul 06 18:17:33.043763 ip-10-0-128-234 kubenswrapper[2570]: W0706 18:17:33.043734    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1168622e_e50b_4234_8a6f_5209f70466d0.slice/crio-7ac26c2fab9220a6e238e1236b58190d74ed2f0ad0770f8cc844887a65a58066 WatchSource:0}: Error finding container 7ac26c2fab9220a6e238e1236b58190d74ed2f0ad0770f8cc844887a65a58066: Status 404 returned error can't find the container with id 7ac26c2fab9220a6e238e1236b58190d74ed2f0ad0770f8cc844887a65a58066
Jul 06 18:17:33.749786 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:33.749742    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969" event={"ID":"1168622e-e50b-4234-8a6f-5209f70466d0","Type":"ContainerStarted","Data":"a8441b28435a69e3830e1a2af2b2e23266aa7854de0f523d95763aa61900078a"}
Jul 06 18:17:33.750166 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:33.749794    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969" event={"ID":"1168622e-e50b-4234-8a6f-5209f70466d0","Type":"ContainerStarted","Data":"7ac26c2fab9220a6e238e1236b58190d74ed2f0ad0770f8cc844887a65a58066"}
Jul 06 18:17:33.767230 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:33.767169    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969" podStartSLOduration=1.767155322 podStartE2EDuration="1.767155322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:17:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:17:33.764337335 +0000 UTC m=+2340.342538170" watchObservedRunningTime="2026-07-06 18:17:33.767155322 +0000 UTC m=+2340.345356158"
Jul 06 18:17:37.187320 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:37.187285    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:17:40.734116 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:40.734071    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w" podUID="234f33dd-d492-4f3d-8270-77dccc539c6f" containerName="main" containerID="cri-o://58f586ad7ea0697656a25732eb0b88a35a4db4c2cdb44bfeb8ae12424433a37d" gracePeriod=45
Jul 06 18:17:40.990236 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:40.990176    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:17:41.019343 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.019313    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6zfb\" (UniqueName: \"kubernetes.io/projected/234f33dd-d492-4f3d-8270-77dccc539c6f-kube-api-access-l6zfb\") pod \"234f33dd-d492-4f3d-8270-77dccc539c6f\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") "
Jul 06 18:17:41.019516 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.019392    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-dshm\") pod \"234f33dd-d492-4f3d-8270-77dccc539c6f\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") "
Jul 06 18:17:41.019516 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.019443    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-tmp-dir\") pod \"234f33dd-d492-4f3d-8270-77dccc539c6f\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") "
Jul 06 18:17:41.019516 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.019496    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-model-cache\") pod \"234f33dd-d492-4f3d-8270-77dccc539c6f\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") "
Jul 06 18:17:41.019740 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.019546    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-home\") pod \"234f33dd-d492-4f3d-8270-77dccc539c6f\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") "
Jul 06 18:17:41.019740 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.019588    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/234f33dd-d492-4f3d-8270-77dccc539c6f-tls-certs\") pod \"234f33dd-d492-4f3d-8270-77dccc539c6f\" (UID: \"234f33dd-d492-4f3d-8270-77dccc539c6f\") "
Jul 06 18:17:41.019865 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.019739    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "234f33dd-d492-4f3d-8270-77dccc539c6f" (UID: "234f33dd-d492-4f3d-8270-77dccc539c6f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:17:41.019865 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.019829    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-model-cache" (OuterVolumeSpecName: "model-cache") pod "234f33dd-d492-4f3d-8270-77dccc539c6f" (UID: "234f33dd-d492-4f3d-8270-77dccc539c6f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:17:41.019865 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.019836    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-home" (OuterVolumeSpecName: "home") pod "234f33dd-d492-4f3d-8270-77dccc539c6f" (UID: "234f33dd-d492-4f3d-8270-77dccc539c6f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:17:41.020027 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.019932    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:17:41.020027 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.019954    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:17:41.020027 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.019967    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:17:41.021447 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.021423    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/234f33dd-d492-4f3d-8270-77dccc539c6f-kube-api-access-l6zfb" (OuterVolumeSpecName: "kube-api-access-l6zfb") pod "234f33dd-d492-4f3d-8270-77dccc539c6f" (UID: "234f33dd-d492-4f3d-8270-77dccc539c6f"). InnerVolumeSpecName "kube-api-access-l6zfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 18:17:41.021639 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.021624    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/234f33dd-d492-4f3d-8270-77dccc539c6f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "234f33dd-d492-4f3d-8270-77dccc539c6f" (UID: "234f33dd-d492-4f3d-8270-77dccc539c6f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 18:17:41.021737 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.021678    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-dshm" (OuterVolumeSpecName: "dshm") pod "234f33dd-d492-4f3d-8270-77dccc539c6f" (UID: "234f33dd-d492-4f3d-8270-77dccc539c6f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:17:41.120487 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.120458    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/234f33dd-d492-4f3d-8270-77dccc539c6f-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:17:41.120487 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.120484    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6zfb\" (UniqueName: \"kubernetes.io/projected/234f33dd-d492-4f3d-8270-77dccc539c6f-kube-api-access-l6zfb\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:17:41.120487 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.120495    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/234f33dd-d492-4f3d-8270-77dccc539c6f-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:17:41.136453 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.136395    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl" podUID="059182d3-1cb9-4207-8def-3395939d9f29" containerName="main" containerID="cri-o://d6c6aabba63aff583e1eae2f572d5ba9d504b139914fb5e158bef189ebe67197" gracePeriod=45
Jul 06 18:17:41.380343 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.380313    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:17:41.423417 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.423386    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-dshm\") pod \"059182d3-1cb9-4207-8def-3395939d9f29\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") "
Jul 06 18:17:41.423417 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.423422    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-model-cache\") pod \"059182d3-1cb9-4207-8def-3395939d9f29\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") "
Jul 06 18:17:41.423630 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.423449    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-home\") pod \"059182d3-1cb9-4207-8def-3395939d9f29\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") "
Jul 06 18:17:41.423630 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.423497    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/059182d3-1cb9-4207-8def-3395939d9f29-tls-certs\") pod \"059182d3-1cb9-4207-8def-3395939d9f29\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") "
Jul 06 18:17:41.423630 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.423548    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-tmp-dir\") pod \"059182d3-1cb9-4207-8def-3395939d9f29\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") "
Jul 06 18:17:41.423630 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.423590    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-229s8\" (UniqueName: \"kubernetes.io/projected/059182d3-1cb9-4207-8def-3395939d9f29-kube-api-access-229s8\") pod \"059182d3-1cb9-4207-8def-3395939d9f29\" (UID: \"059182d3-1cb9-4207-8def-3395939d9f29\") "
Jul 06 18:17:41.423855 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.423716    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-model-cache" (OuterVolumeSpecName: "model-cache") pod "059182d3-1cb9-4207-8def-3395939d9f29" (UID: "059182d3-1cb9-4207-8def-3395939d9f29"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:17:41.423855 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.423756    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-home" (OuterVolumeSpecName: "home") pod "059182d3-1cb9-4207-8def-3395939d9f29" (UID: "059182d3-1cb9-4207-8def-3395939d9f29"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:17:41.423977 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.423910    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:17:41.423977 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.423922    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:17:41.423977 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.423925    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "059182d3-1cb9-4207-8def-3395939d9f29" (UID: "059182d3-1cb9-4207-8def-3395939d9f29"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:17:41.425482 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.425453    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-dshm" (OuterVolumeSpecName: "dshm") pod "059182d3-1cb9-4207-8def-3395939d9f29" (UID: "059182d3-1cb9-4207-8def-3395939d9f29"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:17:41.425600 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.425567    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/059182d3-1cb9-4207-8def-3395939d9f29-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "059182d3-1cb9-4207-8def-3395939d9f29" (UID: "059182d3-1cb9-4207-8def-3395939d9f29"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 18:17:41.425642 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.425600    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/059182d3-1cb9-4207-8def-3395939d9f29-kube-api-access-229s8" (OuterVolumeSpecName: "kube-api-access-229s8") pod "059182d3-1cb9-4207-8def-3395939d9f29" (UID: "059182d3-1cb9-4207-8def-3395939d9f29"). InnerVolumeSpecName "kube-api-access-229s8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 18:17:41.525067 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.524983    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:17:41.525067 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.525012    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/059182d3-1cb9-4207-8def-3395939d9f29-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:17:41.525067 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.525021    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/059182d3-1cb9-4207-8def-3395939d9f29-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:17:41.525067 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.525030    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-229s8\" (UniqueName: \"kubernetes.io/projected/059182d3-1cb9-4207-8def-3395939d9f29-kube-api-access-229s8\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:17:41.789258 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.789180    2570 generic.go:356] "Generic (PLEG): container finished" podID="059182d3-1cb9-4207-8def-3395939d9f29" containerID="d6c6aabba63aff583e1eae2f572d5ba9d504b139914fb5e158bef189ebe67197" exitCode=0
Jul 06 18:17:41.789258 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.789225    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"
Jul 06 18:17:41.789749 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.789268    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl" event={"ID":"059182d3-1cb9-4207-8def-3395939d9f29","Type":"ContainerDied","Data":"d6c6aabba63aff583e1eae2f572d5ba9d504b139914fb5e158bef189ebe67197"}
Jul 06 18:17:41.789749 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.789308    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl" event={"ID":"059182d3-1cb9-4207-8def-3395939d9f29","Type":"ContainerDied","Data":"fa1965e67403ea618da62dbabc8d51d4e1fc958e7feaa007f00689dfbeff48e0"}
Jul 06 18:17:41.789749 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.789326    2570 scope.go:117] "RemoveContainer" containerID="d6c6aabba63aff583e1eae2f572d5ba9d504b139914fb5e158bef189ebe67197"
Jul 06 18:17:41.790677 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.790653    2570 generic.go:356] "Generic (PLEG): container finished" podID="234f33dd-d492-4f3d-8270-77dccc539c6f" containerID="58f586ad7ea0697656a25732eb0b88a35a4db4c2cdb44bfeb8ae12424433a37d" exitCode=0
Jul 06 18:17:41.790771 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.790719    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"
Jul 06 18:17:41.790771 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.790714    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w" event={"ID":"234f33dd-d492-4f3d-8270-77dccc539c6f","Type":"ContainerDied","Data":"58f586ad7ea0697656a25732eb0b88a35a4db4c2cdb44bfeb8ae12424433a37d"}
Jul 06 18:17:41.790771 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.790758    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w" event={"ID":"234f33dd-d492-4f3d-8270-77dccc539c6f","Type":"ContainerDied","Data":"94762a0c5d3c927b4a06104c597d0117500f14f5576aa7123ee02546409f12fe"}
Jul 06 18:17:41.805976 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.805955    2570 scope.go:117] "RemoveContainer" containerID="d6c6aabba63aff583e1eae2f572d5ba9d504b139914fb5e158bef189ebe67197"
Jul 06 18:17:41.806252 ip-10-0-128-234 kubenswrapper[2570]: E0706 18:17:41.806227    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6c6aabba63aff583e1eae2f572d5ba9d504b139914fb5e158bef189ebe67197\": container with ID starting with d6c6aabba63aff583e1eae2f572d5ba9d504b139914fb5e158bef189ebe67197 not found: ID does not exist" containerID="d6c6aabba63aff583e1eae2f572d5ba9d504b139914fb5e158bef189ebe67197"
Jul 06 18:17:41.806363 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.806256    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c6aabba63aff583e1eae2f572d5ba9d504b139914fb5e158bef189ebe67197"} err="failed to get container status \"d6c6aabba63aff583e1eae2f572d5ba9d504b139914fb5e158bef189ebe67197\": rpc error: code = NotFound desc = could not find container \"d6c6aabba63aff583e1eae2f572d5ba9d504b139914fb5e158bef189ebe67197\": container with ID starting with d6c6aabba63aff583e1eae2f572d5ba9d504b139914fb5e158bef189ebe67197 not found: ID does not exist"
Jul 06 18:17:41.806363 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.806272    2570 scope.go:117] "RemoveContainer" containerID="58f586ad7ea0697656a25732eb0b88a35a4db4c2cdb44bfeb8ae12424433a37d"
Jul 06 18:17:41.814496 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.814467    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"]
Jul 06 18:17:41.815315 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.815297    2570 scope.go:117] "RemoveContainer" containerID="58f586ad7ea0697656a25732eb0b88a35a4db4c2cdb44bfeb8ae12424433a37d"
Jul 06 18:17:41.815606 ip-10-0-128-234 kubenswrapper[2570]: E0706 18:17:41.815558    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58f586ad7ea0697656a25732eb0b88a35a4db4c2cdb44bfeb8ae12424433a37d\": container with ID starting with 58f586ad7ea0697656a25732eb0b88a35a4db4c2cdb44bfeb8ae12424433a37d not found: ID does not exist" containerID="58f586ad7ea0697656a25732eb0b88a35a4db4c2cdb44bfeb8ae12424433a37d"
Jul 06 18:17:41.815674 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.815618    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58f586ad7ea0697656a25732eb0b88a35a4db4c2cdb44bfeb8ae12424433a37d"} err="failed to get container status \"58f586ad7ea0697656a25732eb0b88a35a4db4c2cdb44bfeb8ae12424433a37d\": rpc error: code = NotFound desc = could not find container \"58f586ad7ea0697656a25732eb0b88a35a4db4c2cdb44bfeb8ae12424433a37d\": container with ID starting with 58f586ad7ea0697656a25732eb0b88a35a4db4c2cdb44bfeb8ae12424433a37d not found: ID does not exist"
Jul 06 18:17:41.816872 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.816851    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/sub-test-model-a0e97d-kserve-8686f584cf-w48sl"]
Jul 06 18:17:41.827485 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.827463    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"]
Jul 06 18:17:41.829547 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.829525    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/sub-test-model-3b0a18-kserve-79bbb75df-4qv5w"]
Jul 06 18:17:41.973782 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.973753    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="059182d3-1cb9-4207-8def-3395939d9f29" path="/var/lib/kubelet/pods/059182d3-1cb9-4207-8def-3395939d9f29/volumes"
Jul 06 18:17:41.974157 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:41.974142    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="234f33dd-d492-4f3d-8270-77dccc539c6f" path="/var/lib/kubelet/pods/234f33dd-d492-4f3d-8270-77dccc539c6f/volumes"
Jul 06 18:17:42.907320 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:42.907287    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:42.907842 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:42.907334    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:42.919501 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:42.919478    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:17:43.827998 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:17:43.827971    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:18:12.693645 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.693607    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"]
Jul 06 18:18:12.694590 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.694564    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="059182d3-1cb9-4207-8def-3395939d9f29" containerName="main"
Jul 06 18:18:12.694680 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.694592    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="059182d3-1cb9-4207-8def-3395939d9f29" containerName="main"
Jul 06 18:18:12.694680 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.694621    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="234f33dd-d492-4f3d-8270-77dccc539c6f" containerName="main"
Jul 06 18:18:12.694680 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.694630    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="234f33dd-d492-4f3d-8270-77dccc539c6f" containerName="main"
Jul 06 18:18:12.694918 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.694759    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="059182d3-1cb9-4207-8def-3395939d9f29" containerName="main"
Jul 06 18:18:12.694918 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.694772    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="234f33dd-d492-4f3d-8270-77dccc539c6f" containerName="main"
Jul 06 18:18:12.697930 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.697906    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.701522 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.701497    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"]
Jul 06 18:18:12.702066 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.702042    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a0e97d\"/\"rate-test-model-a0e97d-kserve-self-signed-certs\""
Jul 06 18:18:12.702225 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.702066    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a0e97d\"/\"openshift-service-ca.crt\""
Jul 06 18:18:12.702304 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.702066    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a0e97d\"/\"kube-root-ca.crt\""
Jul 06 18:18:12.702366 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.702066    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a0e97d\"/\"default-dockercfg-8w27q\""
Jul 06 18:18:12.797757 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.797720    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-tmp-dir\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.797757 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.797759    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vsvk\" (UniqueName: \"kubernetes.io/projected/bd06458b-7373-482b-be68-c7d2edeeaaa4-kube-api-access-2vsvk\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.798022 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.797779    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd06458b-7373-482b-be68-c7d2edeeaaa4-tls-certs\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.798022 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.797957    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-model-cache\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.798134 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.798017    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-home\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.798134 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.798062    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-dshm\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.898662 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.898624    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-model-cache\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.898874 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.898674    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-home\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.898874 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.898723    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-dshm\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.898874 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.898741    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-tmp-dir\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.898874 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.898771    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vsvk\" (UniqueName: \"kubernetes.io/projected/bd06458b-7373-482b-be68-c7d2edeeaaa4-kube-api-access-2vsvk\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.898874 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.898790    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd06458b-7373-482b-be68-c7d2edeeaaa4-tls-certs\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.899146 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.899074    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-model-cache\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.899205 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.899152    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-tmp-dir\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.899264 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.899217    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-home\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.900998 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.900976    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-dshm\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.901292 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.901273    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd06458b-7373-482b-be68-c7d2edeeaaa4-tls-certs\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:12.907173 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:12.907146    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vsvk\" (UniqueName: \"kubernetes.io/projected/bd06458b-7373-482b-be68-c7d2edeeaaa4-kube-api-access-2vsvk\") pod \"rate-test-model-a0e97d-kserve-745598d88c-q5v8j\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") " pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:13.008815 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:13.008730    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:13.141291 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:13.141265    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"]
Jul 06 18:18:13.143310 ip-10-0-128-234 kubenswrapper[2570]: W0706 18:18:13.143274    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd06458b_7373_482b_be68_c7d2edeeaaa4.slice/crio-75c37e76291478824f2a69ed4ec2bbc66828438f6f9d6a21d36b70f13fbb2709 WatchSource:0}: Error finding container 75c37e76291478824f2a69ed4ec2bbc66828438f6f9d6a21d36b70f13fbb2709: Status 404 returned error can't find the container with id 75c37e76291478824f2a69ed4ec2bbc66828438f6f9d6a21d36b70f13fbb2709
Jul 06 18:18:13.963979 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:13.963945    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j" event={"ID":"bd06458b-7373-482b-be68-c7d2edeeaaa4","Type":"ContainerStarted","Data":"f379d7b8d140dc9842a2340c7afba78cc68c8ccc5e515531becf7e9d7362d553"}
Jul 06 18:18:13.963979 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:13.963985    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j" event={"ID":"bd06458b-7373-482b-be68-c7d2edeeaaa4","Type":"ContainerStarted","Data":"75c37e76291478824f2a69ed4ec2bbc66828438f6f9d6a21d36b70f13fbb2709"}
Jul 06 18:18:13.983438 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:13.983386    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j" podStartSLOduration=1.9833715170000001 podStartE2EDuration="1.983371517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:18:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:18:13.980846294 +0000 UTC m=+2380.559047129" watchObservedRunningTime="2026-07-06 18:18:13.983371517 +0000 UTC m=+2380.561572352"
Jul 06 18:18:17.187848 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:17.187808    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:18:23.009207 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:23.009176    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:23.009660 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:23.009223    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:23.021717 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:23.021668    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:24.021753 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:24.021720    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:18:34.038140 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:34.038112    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 18:18:34.041342 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:34.041319    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 18:18:39.787036 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:39.787000    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:18:54.293585 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:18:54.289438    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:19:00.460824 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:00.460725    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"]
Jul 06 18:19:01.409949 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:01.409910    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"]
Jul 06 18:19:07.090365 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:07.090325    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:19:15.481955 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.481909    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969" podUID="1168622e-e50b-4234-8a6f-5209f70466d0" containerName="main" containerID="cri-o://a8441b28435a69e3830e1a2af2b2e23266aa7854de0f523d95763aa61900078a" gracePeriod=45
Jul 06 18:19:15.735515 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.735457    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:19:15.754095 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.753603    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-model-cache\") pod \"1168622e-e50b-4234-8a6f-5209f70466d0\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") "
Jul 06 18:19:15.754095 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.753729    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-tmp-dir\") pod \"1168622e-e50b-4234-8a6f-5209f70466d0\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") "
Jul 06 18:19:15.754095 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.753759    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1168622e-e50b-4234-8a6f-5209f70466d0-tls-certs\") pod \"1168622e-e50b-4234-8a6f-5209f70466d0\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") "
Jul 06 18:19:15.754095 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.753907    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-model-cache" (OuterVolumeSpecName: "model-cache") pod "1168622e-e50b-4234-8a6f-5209f70466d0" (UID: "1168622e-e50b-4234-8a6f-5209f70466d0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:19:15.754095 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.754020    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1168622e-e50b-4234-8a6f-5209f70466d0" (UID: "1168622e-e50b-4234-8a6f-5209f70466d0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:19:15.754095 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.754132    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-home" (OuterVolumeSpecName: "home") pod "1168622e-e50b-4234-8a6f-5209f70466d0" (UID: "1168622e-e50b-4234-8a6f-5209f70466d0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:19:15.754558 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.753811    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-home\") pod \"1168622e-e50b-4234-8a6f-5209f70466d0\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") "
Jul 06 18:19:15.754558 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.754314    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-dshm\") pod \"1168622e-e50b-4234-8a6f-5209f70466d0\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") "
Jul 06 18:19:15.754558 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.754343    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m568n\" (UniqueName: \"kubernetes.io/projected/1168622e-e50b-4234-8a6f-5209f70466d0-kube-api-access-m568n\") pod \"1168622e-e50b-4234-8a6f-5209f70466d0\" (UID: \"1168622e-e50b-4234-8a6f-5209f70466d0\") "
Jul 06 18:19:15.754687 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.754615    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:19:15.754687 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.754638    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:19:15.754687 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.754652    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:19:15.756348 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.756313    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1168622e-e50b-4234-8a6f-5209f70466d0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1168622e-e50b-4234-8a6f-5209f70466d0" (UID: "1168622e-e50b-4234-8a6f-5209f70466d0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 18:19:15.756952 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.756921    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-dshm" (OuterVolumeSpecName: "dshm") pod "1168622e-e50b-4234-8a6f-5209f70466d0" (UID: "1168622e-e50b-4234-8a6f-5209f70466d0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:19:15.757128 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.756991    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1168622e-e50b-4234-8a6f-5209f70466d0-kube-api-access-m568n" (OuterVolumeSpecName: "kube-api-access-m568n") pod "1168622e-e50b-4234-8a6f-5209f70466d0" (UID: "1168622e-e50b-4234-8a6f-5209f70466d0"). InnerVolumeSpecName "kube-api-access-m568n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 18:19:15.855906 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.855868    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1168622e-e50b-4234-8a6f-5209f70466d0-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:19:15.855906 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.855899    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1168622e-e50b-4234-8a6f-5209f70466d0-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:19:15.855906 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:15.855908    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m568n\" (UniqueName: \"kubernetes.io/projected/1168622e-e50b-4234-8a6f-5209f70466d0-kube-api-access-m568n\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:19:16.252351 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.252308    2570 generic.go:356] "Generic (PLEG): container finished" podID="1168622e-e50b-4234-8a6f-5209f70466d0" containerID="a8441b28435a69e3830e1a2af2b2e23266aa7854de0f523d95763aa61900078a" exitCode=0
Jul 06 18:19:16.252351 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.252352    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"
Jul 06 18:19:16.252629 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.252401    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969" event={"ID":"1168622e-e50b-4234-8a6f-5209f70466d0","Type":"ContainerDied","Data":"a8441b28435a69e3830e1a2af2b2e23266aa7854de0f523d95763aa61900078a"}
Jul 06 18:19:16.252629 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.252451    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969" event={"ID":"1168622e-e50b-4234-8a6f-5209f70466d0","Type":"ContainerDied","Data":"7ac26c2fab9220a6e238e1236b58190d74ed2f0ad0770f8cc844887a65a58066"}
Jul 06 18:19:16.252629 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.252473    2570 scope.go:117] "RemoveContainer" containerID="a8441b28435a69e3830e1a2af2b2e23266aa7854de0f523d95763aa61900078a"
Jul 06 18:19:16.261365 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.261344    2570 scope.go:117] "RemoveContainer" containerID="a8441b28435a69e3830e1a2af2b2e23266aa7854de0f523d95763aa61900078a"
Jul 06 18:19:16.261678 ip-10-0-128-234 kubenswrapper[2570]: E0706 18:19:16.261657    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8441b28435a69e3830e1a2af2b2e23266aa7854de0f523d95763aa61900078a\": container with ID starting with a8441b28435a69e3830e1a2af2b2e23266aa7854de0f523d95763aa61900078a not found: ID does not exist" containerID="a8441b28435a69e3830e1a2af2b2e23266aa7854de0f523d95763aa61900078a"
Jul 06 18:19:16.261760 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.261687    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8441b28435a69e3830e1a2af2b2e23266aa7854de0f523d95763aa61900078a"} err="failed to get container status \"a8441b28435a69e3830e1a2af2b2e23266aa7854de0f523d95763aa61900078a\": rpc error: code = NotFound desc = could not find container \"a8441b28435a69e3830e1a2af2b2e23266aa7854de0f523d95763aa61900078a\": container with ID starting with a8441b28435a69e3830e1a2af2b2e23266aa7854de0f523d95763aa61900078a not found: ID does not exist"
Jul 06 18:19:16.269164 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.269134    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"]
Jul 06 18:19:16.273114 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.273088    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3b0a18/rate-test-model-3b0a18-kserve-7f896f6cf5-nh969"]
Jul 06 18:19:16.429893 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.429849    2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j" podUID="bd06458b-7373-482b-be68-c7d2edeeaaa4" containerName="main" containerID="cri-o://f379d7b8d140dc9842a2340c7afba78cc68c8ccc5e515531becf7e9d7362d553" gracePeriod=45
Jul 06 18:19:16.694536 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.694510    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:19:16.763749 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.763715    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-dshm\") pod \"bd06458b-7373-482b-be68-c7d2edeeaaa4\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") "
Jul 06 18:19:16.763956 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.763759    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-model-cache\") pod \"bd06458b-7373-482b-be68-c7d2edeeaaa4\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") "
Jul 06 18:19:16.763956 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.763795    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-tmp-dir\") pod \"bd06458b-7373-482b-be68-c7d2edeeaaa4\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") "
Jul 06 18:19:16.763956 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.763840    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vsvk\" (UniqueName: \"kubernetes.io/projected/bd06458b-7373-482b-be68-c7d2edeeaaa4-kube-api-access-2vsvk\") pod \"bd06458b-7373-482b-be68-c7d2edeeaaa4\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") "
Jul 06 18:19:16.763956 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.763855    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-home\") pod \"bd06458b-7373-482b-be68-c7d2edeeaaa4\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") "
Jul 06 18:19:16.763956 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.763891    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd06458b-7373-482b-be68-c7d2edeeaaa4-tls-certs\") pod \"bd06458b-7373-482b-be68-c7d2edeeaaa4\" (UID: \"bd06458b-7373-482b-be68-c7d2edeeaaa4\") "
Jul 06 18:19:16.764234 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.764031    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-model-cache" (OuterVolumeSpecName: "model-cache") pod "bd06458b-7373-482b-be68-c7d2edeeaaa4" (UID: "bd06458b-7373-482b-be68-c7d2edeeaaa4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:19:16.764234 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.764128    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bd06458b-7373-482b-be68-c7d2edeeaaa4" (UID: "bd06458b-7373-482b-be68-c7d2edeeaaa4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:19:16.764234 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.764144    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-home" (OuterVolumeSpecName: "home") pod "bd06458b-7373-482b-be68-c7d2edeeaaa4" (UID: "bd06458b-7373-482b-be68-c7d2edeeaaa4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:19:16.764234 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.764160    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-model-cache\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:19:16.765967 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.765936    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-dshm" (OuterVolumeSpecName: "dshm") pod "bd06458b-7373-482b-be68-c7d2edeeaaa4" (UID: "bd06458b-7373-482b-be68-c7d2edeeaaa4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 18:19:16.766092 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.765974    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd06458b-7373-482b-be68-c7d2edeeaaa4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bd06458b-7373-482b-be68-c7d2edeeaaa4" (UID: "bd06458b-7373-482b-be68-c7d2edeeaaa4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 18:19:16.766092 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.765986    2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd06458b-7373-482b-be68-c7d2edeeaaa4-kube-api-access-2vsvk" (OuterVolumeSpecName: "kube-api-access-2vsvk") pod "bd06458b-7373-482b-be68-c7d2edeeaaa4" (UID: "bd06458b-7373-482b-be68-c7d2edeeaaa4"). InnerVolumeSpecName "kube-api-access-2vsvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 18:19:16.864843 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.864750    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vsvk\" (UniqueName: \"kubernetes.io/projected/bd06458b-7373-482b-be68-c7d2edeeaaa4-kube-api-access-2vsvk\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:19:16.864843 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.864785    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-home\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:19:16.864843 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.864797    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd06458b-7373-482b-be68-c7d2edeeaaa4-tls-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:19:16.864843 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.864805    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-dshm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:19:16.864843 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:16.864813    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd06458b-7373-482b-be68-c7d2edeeaaa4-tmp-dir\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Jul 06 18:19:17.258732 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:17.258672    2570 generic.go:356] "Generic (PLEG): container finished" podID="bd06458b-7373-482b-be68-c7d2edeeaaa4" containerID="f379d7b8d140dc9842a2340c7afba78cc68c8ccc5e515531becf7e9d7362d553" exitCode=0
Jul 06 18:19:17.258943 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:17.258750    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"
Jul 06 18:19:17.258943 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:17.258763    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j" event={"ID":"bd06458b-7373-482b-be68-c7d2edeeaaa4","Type":"ContainerDied","Data":"f379d7b8d140dc9842a2340c7afba78cc68c8ccc5e515531becf7e9d7362d553"}
Jul 06 18:19:17.258943 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:17.258814    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j" event={"ID":"bd06458b-7373-482b-be68-c7d2edeeaaa4","Type":"ContainerDied","Data":"75c37e76291478824f2a69ed4ec2bbc66828438f6f9d6a21d36b70f13fbb2709"}
Jul 06 18:19:17.258943 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:17.258838    2570 scope.go:117] "RemoveContainer" containerID="f379d7b8d140dc9842a2340c7afba78cc68c8ccc5e515531becf7e9d7362d553"
Jul 06 18:19:17.268430 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:17.268409    2570 scope.go:117] "RemoveContainer" containerID="f379d7b8d140dc9842a2340c7afba78cc68c8ccc5e515531becf7e9d7362d553"
Jul 06 18:19:17.268714 ip-10-0-128-234 kubenswrapper[2570]: E0706 18:19:17.268674    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f379d7b8d140dc9842a2340c7afba78cc68c8ccc5e515531becf7e9d7362d553\": container with ID starting with f379d7b8d140dc9842a2340c7afba78cc68c8ccc5e515531becf7e9d7362d553 not found: ID does not exist" containerID="f379d7b8d140dc9842a2340c7afba78cc68c8ccc5e515531becf7e9d7362d553"
Jul 06 18:19:17.268810 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:17.268781    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f379d7b8d140dc9842a2340c7afba78cc68c8ccc5e515531becf7e9d7362d553"} err="failed to get container status \"f379d7b8d140dc9842a2340c7afba78cc68c8ccc5e515531becf7e9d7362d553\": rpc error: code = NotFound desc = could not find container \"f379d7b8d140dc9842a2340c7afba78cc68c8ccc5e515531becf7e9d7362d553\": container with ID starting with f379d7b8d140dc9842a2340c7afba78cc68c8ccc5e515531becf7e9d7362d553 not found: ID does not exist"
Jul 06 18:19:17.282226 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:17.282202    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"]
Jul 06 18:19:17.285474 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:17.285452    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a0e97d/rate-test-model-a0e97d-kserve-745598d88c-q5v8j"]
Jul 06 18:19:17.975187 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:17.975153    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1168622e-e50b-4234-8a6f-5209f70466d0" path="/var/lib/kubelet/pods/1168622e-e50b-4234-8a6f-5209f70466d0/volumes"
Jul 06 18:19:17.975569 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:17.975515    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd06458b-7373-482b-be68-c7d2edeeaaa4" path="/var/lib/kubelet/pods/bd06458b-7373-482b-be68-c7d2edeeaaa4/volumes"
Jul 06 18:19:48.994487 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:48.994451    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pcxrg"]
Jul 06 18:19:57.309614 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:57.309582    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7fm26_fa251531-ca54-4aad-838c-aeb7f6a6e2fb/manager/0.log"
Jul 06 18:19:57.428709 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:57.428671    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-p7hgc_0f5923d5-44a2-460c-bee0-f5e1911f7875/manager/0.log"
Jul 06 18:19:58.011387 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:58.011361    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tpv8f_f44d6ec7-ea98-4c49-a3b1-5eb124914b93/server/0.log"
Jul 06 18:19:58.137337 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:58.137306    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lmcq8_fc5360bc-160c-44c3-bcfc-164d085ec2e8/manager/0.log"
Jul 06 18:19:58.253822 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:58.253794    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-597bcb8998-7s2dk_f0806ed5-6d5e-4a47-9d08-2013a58f526e/copy-manifests/0.log"
Jul 06 18:19:58.271390 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:58.271324    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-597bcb8998-7s2dk_f0806ed5-6d5e-4a47-9d08-2013a58f526e/manager/0.log"
Jul 06 18:19:58.625995 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:19:58.625911    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-62kdr_c586af24-98f1-4c00-aab4-d430d5589e3e/postgres/0.log"
Jul 06 18:20:00.062325 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:00.062296    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wlz98_e14869ad-13b2-4504-86d2-36ceaf54023a/manager/0.log"
Jul 06 18:20:00.194555 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:00.194519    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kj9hd_82ad259e-7475-4458-879e-ba2549a98951/manager/0.log"
Jul 06 18:20:00.433069 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:00.432977    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pflsd_2e6b7dae-17ad-4e4e-88c1-b7df790919c1/registry-server/0.log"
Jul 06 18:20:00.695742 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:00.695712    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pcxrg_4d77f544-1cef-46bb-8cfd-971dcebaac80/limitador/0.log"
Jul 06 18:20:00.823177 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:00.823146    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-x64vs_179c65c6-fbc5-4c1e-bb65-0e446418eeac/manager/0.log"
Jul 06 18:20:01.405907 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:01.405875    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cf85c8449-g6gvs_d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5/kube-auth-proxy/0.log"
Jul 06 18:20:01.894853 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:01.894820    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-v44sf_18c999ac-336d-40ed-8ad9-d17f0d9910e1/payload-processing/0.log"
Jul 06 18:20:02.349196 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:02.349164    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-p6j46_b8c9b125-1ec9-4352-8ee3-30d29648346a/main/0.log"
Jul 06 18:20:02.701950 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:02.701922    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbgwxlf_516b5eaa-8c4c-4108-85d7-d79d7362e4dc/main/0.log"
Jul 06 18:20:02.932499 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:02.932468    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-m72q4_727bce7a-49d7-4ed7-af7a-d081ad18538f/main/0.log"
Jul 06 18:20:07.418639 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.418595    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9w8k6/must-gather-xmhrz"]
Jul 06 18:20:07.419271 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.419140    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1168622e-e50b-4234-8a6f-5209f70466d0" containerName="main"
Jul 06 18:20:07.419271 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.419161    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1168622e-e50b-4234-8a6f-5209f70466d0" containerName="main"
Jul 06 18:20:07.419271 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.419202    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd06458b-7373-482b-be68-c7d2edeeaaa4" containerName="main"
Jul 06 18:20:07.419271 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.419212    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd06458b-7373-482b-be68-c7d2edeeaaa4" containerName="main"
Jul 06 18:20:07.419495 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.419306    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1168622e-e50b-4234-8a6f-5209f70466d0" containerName="main"
Jul 06 18:20:07.419495 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.419320    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd06458b-7373-482b-be68-c7d2edeeaaa4" containerName="main"
Jul 06 18:20:07.422192 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.422170    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9w8k6/must-gather-xmhrz"
Jul 06 18:20:07.424997 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.424974    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9w8k6\"/\"kube-root-ca.crt\""
Jul 06 18:20:07.425116 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.425022    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9w8k6\"/\"openshift-service-ca.crt\""
Jul 06 18:20:07.434247 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.434223    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9w8k6/must-gather-xmhrz"]
Jul 06 18:20:07.506821 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.506781    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/141e3a5b-4dfd-46ee-bc56-f91db432e00c-must-gather-output\") pod \"must-gather-xmhrz\" (UID: \"141e3a5b-4dfd-46ee-bc56-f91db432e00c\") " pod="openshift-must-gather-9w8k6/must-gather-xmhrz"
Jul 06 18:20:07.507007 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.506856    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9qjw\" (UniqueName: \"kubernetes.io/projected/141e3a5b-4dfd-46ee-bc56-f91db432e00c-kube-api-access-m9qjw\") pod \"must-gather-xmhrz\" (UID: \"141e3a5b-4dfd-46ee-bc56-f91db432e00c\") " pod="openshift-must-gather-9w8k6/must-gather-xmhrz"
Jul 06 18:20:07.608003 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.607961    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/141e3a5b-4dfd-46ee-bc56-f91db432e00c-must-gather-output\") pod \"must-gather-xmhrz\" (UID: \"141e3a5b-4dfd-46ee-bc56-f91db432e00c\") " pod="openshift-must-gather-9w8k6/must-gather-xmhrz"
Jul 06 18:20:07.608170 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.608015    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9qjw\" (UniqueName: \"kubernetes.io/projected/141e3a5b-4dfd-46ee-bc56-f91db432e00c-kube-api-access-m9qjw\") pod \"must-gather-xmhrz\" (UID: \"141e3a5b-4dfd-46ee-bc56-f91db432e00c\") " pod="openshift-must-gather-9w8k6/must-gather-xmhrz"
Jul 06 18:20:07.608340 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.608318    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/141e3a5b-4dfd-46ee-bc56-f91db432e00c-must-gather-output\") pod \"must-gather-xmhrz\" (UID: \"141e3a5b-4dfd-46ee-bc56-f91db432e00c\") " pod="openshift-must-gather-9w8k6/must-gather-xmhrz"
Jul 06 18:20:07.616345 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.616311    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9qjw\" (UniqueName: \"kubernetes.io/projected/141e3a5b-4dfd-46ee-bc56-f91db432e00c-kube-api-access-m9qjw\") pod \"must-gather-xmhrz\" (UID: \"141e3a5b-4dfd-46ee-bc56-f91db432e00c\") " pod="openshift-must-gather-9w8k6/must-gather-xmhrz"
Jul 06 18:20:07.732352 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.732306    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9w8k6/must-gather-xmhrz"
Jul 06 18:20:07.863993 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.863951    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9w8k6/must-gather-xmhrz"]
Jul 06 18:20:07.865430 ip-10-0-128-234 kubenswrapper[2570]: W0706 18:20:07.865404    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod141e3a5b_4dfd_46ee_bc56_f91db432e00c.slice/crio-f63fc37741907f0fff6220eb669a843fedde55b4803c965ca20b61671fa4e2f6 WatchSource:0}: Error finding container f63fc37741907f0fff6220eb669a843fedde55b4803c965ca20b61671fa4e2f6: Status 404 returned error can't find the container with id f63fc37741907f0fff6220eb669a843fedde55b4803c965ca20b61671fa4e2f6
Jul 06 18:20:07.867148 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:07.867129    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 18:20:08.495529 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:08.495497    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9w8k6/must-gather-xmhrz" event={"ID":"141e3a5b-4dfd-46ee-bc56-f91db432e00c","Type":"ContainerStarted","Data":"f63fc37741907f0fff6220eb669a843fedde55b4803c965ca20b61671fa4e2f6"}
Jul 06 18:20:09.505830 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:09.505002    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9w8k6/must-gather-xmhrz" event={"ID":"141e3a5b-4dfd-46ee-bc56-f91db432e00c","Type":"ContainerStarted","Data":"253fde93f824b7a47de990d4bec66ee25046e1f0c9ffa3af655be649b82a9c6d"}
Jul 06 18:20:09.505830 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:09.505053    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9w8k6/must-gather-xmhrz" event={"ID":"141e3a5b-4dfd-46ee-bc56-f91db432e00c","Type":"ContainerStarted","Data":"e9665a589ae41d78bd18b4c5415f375eb19821a52b0b3fb5d5c5701735447c7f"}
Jul 06 18:20:09.521514 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:09.521458    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9w8k6/must-gather-xmhrz" podStartSLOduration=1.506035128 podStartE2EDuration="2.521443483s" totalImagesPullingTime="1.015408355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:20:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:09.521023226 +0000 UTC m=+2496.099224063" watchObservedRunningTime="2026-07-06 18:20:09.521443483 +0000 UTC m=+2496.099644321"
Jul 06 18:20:10.435872 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:10.435840    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zj4jw_a4034c17-7d21-4541-998d-1c24d8e3ac45/global-pull-secret-syncer/0.log"
Jul 06 18:20:10.552651 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:10.552604    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qdlcp_3e763fe4-2283-4e52-8424-7a99d7680e5d/konnectivity-agent/0.log"
Jul 06 18:20:10.571101 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:10.571059    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-234.ec2.internal_1822161f850ef2b3317aaf5916b61399/haproxy/0.log"
Jul 06 18:20:15.891988 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:15.891953    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wlz98_e14869ad-13b2-4504-86d2-36ceaf54023a/manager/0.log"
Jul 06 18:20:15.913793 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:15.913763    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kj9hd_82ad259e-7475-4458-879e-ba2549a98951/manager/0.log"
Jul 06 18:20:15.989659 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:15.989624    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pflsd_2e6b7dae-17ad-4e4e-88c1-b7df790919c1/registry-server/0.log"
Jul 06 18:20:16.121463 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:16.121436    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pcxrg_4d77f544-1cef-46bb-8cfd-971dcebaac80/limitador/0.log"
Jul 06 18:20:16.217116 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:16.217085    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-x64vs_179c65c6-fbc5-4c1e-bb65-0e446418eeac/manager/0.log"
Jul 06 18:20:18.506868 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:18.506835    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n955n_50ff71d8-0a3b-4a12-8b65-c82cc7f263df/node-exporter/0.log"
Jul 06 18:20:18.523260 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:18.523231    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n955n_50ff71d8-0a3b-4a12-8b65-c82cc7f263df/kube-rbac-proxy/0.log"
Jul 06 18:20:18.540095 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:18.540063    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n955n_50ff71d8-0a3b-4a12-8b65-c82cc7f263df/init-textfile/0.log"
Jul 06 18:20:20.228129 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.228098    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-4hwlm_4c6abc92-6390-431d-a869-a937ed5365e9/networking-console-plugin/0.log"
Jul 06 18:20:20.484064 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.483975    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"]
Jul 06 18:20:20.490111 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.490078    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.496058 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.496020    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9w8k6\"/\"default-dockercfg-s5m7h\""
Jul 06 18:20:20.496420 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.496398    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"]
Jul 06 18:20:20.529962 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.528751    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72a563f5-e514-4bfd-b1e3-25f1c84e27bd-lib-modules\") pod \"perf-node-gather-daemonset-kp5f8\" (UID: \"72a563f5-e514-4bfd-b1e3-25f1c84e27bd\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.529962 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.528845    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72a563f5-e514-4bfd-b1e3-25f1c84e27bd-podres\") pod \"perf-node-gather-daemonset-kp5f8\" (UID: \"72a563f5-e514-4bfd-b1e3-25f1c84e27bd\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.529962 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.528918    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n58b\" (UniqueName: \"kubernetes.io/projected/72a563f5-e514-4bfd-b1e3-25f1c84e27bd-kube-api-access-6n58b\") pod \"perf-node-gather-daemonset-kp5f8\" (UID: \"72a563f5-e514-4bfd-b1e3-25f1c84e27bd\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.529962 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.529118    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72a563f5-e514-4bfd-b1e3-25f1c84e27bd-sys\") pod \"perf-node-gather-daemonset-kp5f8\" (UID: \"72a563f5-e514-4bfd-b1e3-25f1c84e27bd\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.529962 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.529184    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72a563f5-e514-4bfd-b1e3-25f1c84e27bd-proc\") pod \"perf-node-gather-daemonset-kp5f8\" (UID: \"72a563f5-e514-4bfd-b1e3-25f1c84e27bd\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.630341 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.630300    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72a563f5-e514-4bfd-b1e3-25f1c84e27bd-proc\") pod \"perf-node-gather-daemonset-kp5f8\" (UID: \"72a563f5-e514-4bfd-b1e3-25f1c84e27bd\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.630624 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.630421    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72a563f5-e514-4bfd-b1e3-25f1c84e27bd-proc\") pod \"perf-node-gather-daemonset-kp5f8\" (UID: \"72a563f5-e514-4bfd-b1e3-25f1c84e27bd\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.630763 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.630745    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72a563f5-e514-4bfd-b1e3-25f1c84e27bd-lib-modules\") pod \"perf-node-gather-daemonset-kp5f8\" (UID: \"72a563f5-e514-4bfd-b1e3-25f1c84e27bd\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.630881 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.630601    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72a563f5-e514-4bfd-b1e3-25f1c84e27bd-lib-modules\") pod \"perf-node-gather-daemonset-kp5f8\" (UID: \"72a563f5-e514-4bfd-b1e3-25f1c84e27bd\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.631013 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.630997    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72a563f5-e514-4bfd-b1e3-25f1c84e27bd-podres\") pod \"perf-node-gather-daemonset-kp5f8\" (UID: \"72a563f5-e514-4bfd-b1e3-25f1c84e27bd\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.631125 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.631107    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72a563f5-e514-4bfd-b1e3-25f1c84e27bd-podres\") pod \"perf-node-gather-daemonset-kp5f8\" (UID: \"72a563f5-e514-4bfd-b1e3-25f1c84e27bd\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.631225 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.631142    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n58b\" (UniqueName: \"kubernetes.io/projected/72a563f5-e514-4bfd-b1e3-25f1c84e27bd-kube-api-access-6n58b\") pod \"perf-node-gather-daemonset-kp5f8\" (UID: \"72a563f5-e514-4bfd-b1e3-25f1c84e27bd\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.631407 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.631391    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72a563f5-e514-4bfd-b1e3-25f1c84e27bd-sys\") pod \"perf-node-gather-daemonset-kp5f8\" (UID: \"72a563f5-e514-4bfd-b1e3-25f1c84e27bd\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.631528 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.631511    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72a563f5-e514-4bfd-b1e3-25f1c84e27bd-sys\") pod \"perf-node-gather-daemonset-kp5f8\" (UID: \"72a563f5-e514-4bfd-b1e3-25f1c84e27bd\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.641306 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.641275    2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n58b\" (UniqueName: \"kubernetes.io/projected/72a563f5-e514-4bfd-b1e3-25f1c84e27bd-kube-api-access-6n58b\") pod \"perf-node-gather-daemonset-kp5f8\" (UID: \"72a563f5-e514-4bfd-b1e3-25f1c84e27bd\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.806804 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.806702    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:20.865782 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.865756    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/2.log"
Jul 06 18:20:20.871827 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:20.871798    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b7j6m_01de017a-3d89-4c44-9ed4-c7ea05a9a84e/console-operator/3.log"
Jul 06 18:20:21.009064 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:21.009028    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"]
Jul 06 18:20:21.017939 ip-10-0-128-234 kubenswrapper[2570]: W0706 18:20:21.017895    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod72a563f5_e514_4bfd_b1e3_25f1c84e27bd.slice/crio-7590af75aefcd0fb93ee13f1491f4d1104f730733e4b9ea230ab676220d6288a WatchSource:0}: Error finding container 7590af75aefcd0fb93ee13f1491f4d1104f730733e4b9ea230ab676220d6288a: Status 404 returned error can't find the container with id 7590af75aefcd0fb93ee13f1491f4d1104f730733e4b9ea230ab676220d6288a
Jul 06 18:20:21.596172 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:21.596135    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8" event={"ID":"72a563f5-e514-4bfd-b1e3-25f1c84e27bd","Type":"ContainerStarted","Data":"207da078d86794e2ad8096ceb015750680972177a776aebc7399595acc1fc0ce"}
Jul 06 18:20:21.596677 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:21.596191    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8" event={"ID":"72a563f5-e514-4bfd-b1e3-25f1c84e27bd","Type":"ContainerStarted","Data":"7590af75aefcd0fb93ee13f1491f4d1104f730733e4b9ea230ab676220d6288a"}
Jul 06 18:20:21.596677 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:21.596238    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:21.614421 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:21.614365    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8" podStartSLOduration=1.614349805 podStartE2EDuration="1.614349805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:20:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:21.611992483 +0000 UTC m=+2508.190193320" watchObservedRunningTime="2026-07-06 18:20:21.614349805 +0000 UTC m=+2508.192550639"
Jul 06 18:20:22.863202 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:22.863168    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5wj5t_3030c401-885a-4d9b-b58f-159282dee0ea/dns/0.log"
Jul 06 18:20:22.881254 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:22.881217    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5wj5t_3030c401-885a-4d9b-b58f-159282dee0ea/kube-rbac-proxy/0.log"
Jul 06 18:20:23.023385 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:23.023355    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rvnql_09179db9-f2bb-4347-94d1-1a3384e1916a/dns-node-resolver/0.log"
Jul 06 18:20:23.527134 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:23.527092    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ftklr_bd70feac-5dfd-48b2-aace-d6464eaab7cb/node-ca/0.log"
Jul 06 18:20:24.646661 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:24.646620    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cf85c8449-g6gvs_d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5/kube-auth-proxy/0.log"
Jul 06 18:20:24.854976 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:24.854943    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-v44sf_18c999ac-336d-40ed-8ad9-d17f0d9910e1/payload-processing/0.log"
Jul 06 18:20:25.557897 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:25.557836    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4f8mj_fc879502-ae48-40d5-9e23-c58c6fa046b4/serve-healthcheck-canary/0.log"
Jul 06 18:20:26.041404 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:26.041372    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-k5ghp_6a82af56-16d0-456d-a04f-b82f288688c8/insights-operator/0.log"
Jul 06 18:20:26.044259 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:26.044232    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-k5ghp_6a82af56-16d0-456d-a04f-b82f288688c8/insights-operator/1.log"
Jul 06 18:20:26.060615 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:26.060588    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f899r_d6a988e7-d4c4-4517-9f16-2d597b9a67ed/kube-rbac-proxy/0.log"
Jul 06 18:20:26.076716 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:26.076679    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f899r_d6a988e7-d4c4-4517-9f16-2d597b9a67ed/exporter/0.log"
Jul 06 18:20:26.093893 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:26.093868    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f899r_d6a988e7-d4c4-4517-9f16-2d597b9a67ed/extractor/0.log"
Jul 06 18:20:27.613086 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:27.613038    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-kp5f8"
Jul 06 18:20:28.255849 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:28.255811    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7fm26_fa251531-ca54-4aad-838c-aeb7f6a6e2fb/manager/0.log"
Jul 06 18:20:28.502540 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:28.502511    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-p7hgc_0f5923d5-44a2-460c-bee0-f5e1911f7875/manager/0.log"
Jul 06 18:20:28.692481 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:28.692451    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tpv8f_f44d6ec7-ea98-4c49-a3b1-5eb124914b93/server/0.log"
Jul 06 18:20:28.786532 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:28.786495    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lmcq8_fc5360bc-160c-44c3-bcfc-164d085ec2e8/manager/0.log"
Jul 06 18:20:28.823605 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:28.823563    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-597bcb8998-7s2dk_f0806ed5-6d5e-4a47-9d08-2013a58f526e/manager/0.log"
Jul 06 18:20:28.835577 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:28.835545    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-597bcb8998-7s2dk_f0806ed5-6d5e-4a47-9d08-2013a58f526e/copy-manifests/0.log"
Jul 06 18:20:28.982355 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:28.982268    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-62kdr_c586af24-98f1-4c00-aab4-d430d5589e3e/postgres/0.log"
Jul 06 18:20:31.465547 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:31.465516    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cf85c8449-g6gvs_d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5/kube-auth-proxy/0.log"
Jul 06 18:20:31.644430 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:31.644396    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-v44sf_18c999ac-336d-40ed-8ad9-d17f0d9910e1/payload-processing/0.log"
Jul 06 18:20:33.091139 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:33.091099    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6cf85c8449-g6gvs_d76e88a7-0b12-4bc9-b611-8a5d0e39e2c5/kube-auth-proxy/0.log"
Jul 06 18:20:33.266165 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:33.266122    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-v44sf_18c999ac-336d-40ed-8ad9-d17f0d9910e1/payload-processing/0.log"
Jul 06 18:20:35.691222 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:35.691187    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-n9knh_235b3c7e-5ad8-4006-9424-31d2f85b9b72/kube-storage-version-migrator-operator/1.log"
Jul 06 18:20:35.693092 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:35.693057    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-n9knh_235b3c7e-5ad8-4006-9424-31d2f85b9b72/kube-storage-version-migrator-operator/0.log"
Jul 06 18:20:36.610297 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:36.610268    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vnvng_d7c5985e-315d-4459-8274-6dd000f12c0b/kube-multus-additional-cni-plugins/0.log"
Jul 06 18:20:36.628564 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:36.628533    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vnvng_d7c5985e-315d-4459-8274-6dd000f12c0b/egress-router-binary-copy/0.log"
Jul 06 18:20:36.647753 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:36.647710    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vnvng_d7c5985e-315d-4459-8274-6dd000f12c0b/cni-plugins/0.log"
Jul 06 18:20:36.662752 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:36.662721    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vnvng_d7c5985e-315d-4459-8274-6dd000f12c0b/bond-cni-plugin/0.log"
Jul 06 18:20:36.677059 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:36.677027    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vnvng_d7c5985e-315d-4459-8274-6dd000f12c0b/routeoverride-cni/0.log"
Jul 06 18:20:36.691898 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:36.691863    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vnvng_d7c5985e-315d-4459-8274-6dd000f12c0b/whereabouts-cni-bincopy/0.log"
Jul 06 18:20:36.708162 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:36.708139    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vnvng_d7c5985e-315d-4459-8274-6dd000f12c0b/whereabouts-cni/0.log"
Jul 06 18:20:37.021386 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:37.021358    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dppdr_2e407ce7-21d1-4316-b572-a4a28f3e2235/kube-multus/0.log"
Jul 06 18:20:37.109546 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:37.109510    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4kzvg_c33ba8f0-913e-48a7-a455-54c14e022b74/network-metrics-daemon/0.log"
Jul 06 18:20:37.121709 ip-10-0-128-234 kubenswrapper[2570]: I0706 18:20:37.121667    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4kzvg_c33ba8f0-913e-48a7-a455-54c14e022b74/kube-rbac-proxy/0.log"