Jul 13 17:31:43.032214 ip-10-0-137-223 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 17:31:43.478971 ip-10-0-137-223 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 17:31:43.478971 ip-10-0-137-223 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 17:31:43.478971 ip-10-0-137-223 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 17:31:43.478971 ip-10-0-137-223 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 17:31:43.478971 ip-10-0-137-223 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 17:31:43.480974 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.480869    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 17:31:43.485920 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485898    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:31:43.485920 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485920    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:31:43.485920 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485923    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485927    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485930    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485933    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485936    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485939    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485942    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485945    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485954    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485957    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485959    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485962    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485965    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485968    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485970    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485973    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485975    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485978    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485980    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485983    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:31:43.486055 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485985    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485988    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485991    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485993    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485996    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.485998    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486001    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486003    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486006    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486008    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486011    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486013    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486016    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486019    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486022    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486025    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486028    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486030    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486034    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486038    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:31:43.486800 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486041    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486044    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486047    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486049    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486052    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486054    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486057    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486060    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486062    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486065    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486068    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486071    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486073    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486076    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486079    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486081    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486084    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486086    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486090    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:31:43.487543 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486094    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486097    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486100    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486103    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486112    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486115    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486119    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486122    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486125    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486128    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486132    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486135    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486138    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486141    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486143    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486147    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486152    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486156    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486159    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:31:43.488213 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486162    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486164    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486167    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486170    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486173    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486176    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486179    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486181    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486184    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486188    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486190    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486193    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486196    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486198    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486201    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486203    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486206    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486209    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.486212    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487000    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:31:43.488894 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487007    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487011    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487014    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487017    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487021    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487024    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487027    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487030    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487033    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487041    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487045    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487047    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487050    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487053    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487056    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487059    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487061    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487064    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487067    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487069    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:31:43.489591 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487072    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487074    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487077    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487081    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487085    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487088    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487091    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487093    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487096    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487100    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487103    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487107    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487111    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487114    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487117    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487120    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487123    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487125    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487128    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:31:43.490481 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487131    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487134    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487136    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487145    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487147    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487150    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487152    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487155    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487157    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487160    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487162    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487165    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487167    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487170    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487172    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487174    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487178    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487180    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487183    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:31:43.491175 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487185    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487188    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487191    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487193    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487196    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487199    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487202    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487204    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487207    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487209    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487211    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487214    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487216    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487220    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487223    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487225    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487228    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487236    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487239    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487242    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:31:43.491853 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487244    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487247    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487249    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487252    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487255    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487257    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487260    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487262    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487265    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487268    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487270    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487273    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487276    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487278    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487281    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487283    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487286    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487289    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487291    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:31:43.492571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487295    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487757    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487762    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487765    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487767    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487771    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487773    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487776    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487778    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487781    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487789    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487792    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487794    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487797    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487799    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487802    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487804    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487807    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487810    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487812    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:31:43.493277 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487815    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487818    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487821    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487823    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487826    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487828    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487831    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487834    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487837    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487839    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487842    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487844    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487847    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487849    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487852    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487854    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487857    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487859    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487861    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487864    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:31:43.494005 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487866    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487869    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487871    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487892    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487896    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487899    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487901    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487904    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487906    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487909    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487911    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487914    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487916    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487919    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487922    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487926    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487928    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487931    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487933    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:31:43.494717 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487937    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487940    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487943    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487946    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487949    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487951    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487954    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487957    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487959    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487962    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487964    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487966    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487969    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487971    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487973    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487977    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487981    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487989    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487993    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487995    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:31:43.495411 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.487998    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488000    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488003    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488005    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488008    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488010    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488013    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488016    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488018    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488021    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488024    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488026    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488029    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488031    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488034    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488037    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488039    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488042    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488044    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:31:43.496137 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488047    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488051    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488129    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488136    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488150    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488154    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488158    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488162    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488166    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488171    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488174    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488183    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488187    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488190    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488193    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488196    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488199    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488204    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488207    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488210    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488218    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488221    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488224    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 17:31:43.496798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488227    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488231    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488235    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488237    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488241    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488244    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488247    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488250    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488253    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488256    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488259    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488263    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488266    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488269    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488272    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488275    2564 flags.go:64] FLAG: --enable-server="true"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488278    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488284    2564 flags.go:64] FLAG: --event-burst="100"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488288    2564 flags.go:64] FLAG: --event-qps="50"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488290    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488294    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488302    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488306    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488309    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488312    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 17:31:43.497639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488315    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488319    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488322    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488325    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488328    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488331    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488334    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488336    2564 flags.go:64] FLAG: --feature-gates=""
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488340    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488343    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488346    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488350    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488353    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488359    2564 flags.go:64] FLAG: --help="false"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488362    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-137-223.ec2.internal"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488365    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488368    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488371    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488374    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488378    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488381    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488384    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488386    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 17:31:43.498557 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488389    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488392    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488395    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488400    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488402    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488405    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488414    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488417    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488420    2564 flags.go:64] FLAG: --lock-file=""
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488428    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488433    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488436    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488442    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488445    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488447    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488450    2564 flags.go:64] FLAG: --logging-format="text"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488453    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488456    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488459    2564 flags.go:64] FLAG: --manifest-url=""
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488462    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488466    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488470    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488474    2564 flags.go:64] FLAG: --max-pods="110"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488477    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488480    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 17:31:43.499421 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488482    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488485    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488488    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488491    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488494    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488501    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488504    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488507    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488510    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488513    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488521    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488524    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488527    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488530    2564 flags.go:64] FLAG: --port="10250"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488538    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488541    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bab609a73d5b0064"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488545    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488548    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488553    2564 flags.go:64] FLAG: --register-node="true"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488556    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488560    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488563    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488565    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488568    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488572    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 17:31:43.500431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488575    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488578    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488581    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488584    2564 flags.go:64] FLAG: --runonce="false"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488587    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488590    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488592    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488595    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488598    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488601    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488604    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488607    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488610    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488613    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488615    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488618    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488621    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488625    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488628    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488633    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488636    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488639    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488659    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488662    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488665    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 17:31:43.501200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488669    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488672    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488675    2564 flags.go:64] FLAG: --v="2"
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488679    2564 flags.go:64] FLAG: --version="false"
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488684    2564 flags.go:64] FLAG: --vmodule=""
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488687    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.488690    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488847    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488850    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488854    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488856    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488859    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488862    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488865    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488867    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488870    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488873    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488875    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488891    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488894    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488897    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:31:43.501810 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488899    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488902    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488905    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488909    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488912    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488915    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488917    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488920    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488922    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488931    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488934    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488939    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488941    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488944    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488947    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488949    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488953    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488956    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488959    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488962    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:31:43.502349 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488965    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488967    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488970    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488973    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488975    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488978    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488980    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488983    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488985    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488988    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488990    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488993    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488995    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.488997    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489000    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489004    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489007    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489009    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489012    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489014    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:31:43.502864 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489017    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489019    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489028    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489040    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489044    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489046    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489049    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489051    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489054    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489057    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489059    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489062    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489065    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489067    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489070    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489072    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489075    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489077    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489081    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:31:43.503366 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489085    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489087    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489090    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489093    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489095    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489098    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489100    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489103    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489107    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489109    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489112    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489115    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489117    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489120    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489122    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489125    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489134    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489137    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489140    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489142    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:31:43.503827 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489145    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:31:43.504322 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489148    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:31:43.504322 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489150    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:31:43.504322 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489153    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:31:43.504322 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489155    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:31:43.504322 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.489159    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:31:43.504322 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.490051    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 17:31:43.504322 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.501784    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 17:31:43.504322 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.501809    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 17:31:43.504322 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.502679    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 17:31:43.504322 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.502686    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 17:31:43.504322 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502756    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:31:43.504322 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502761    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:31:43.504322 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502765    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:31:43.504322 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502768    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502773    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502777    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502780    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502783    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502786    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502789    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502793    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502798    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502801    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502805    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502808    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502811    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502813    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502816    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502819    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502822    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502825    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502828    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:31:43.504672 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502831    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502834    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502837    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502840    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502842    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502845    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502848    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502851    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502854    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502857    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502859    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502862    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502865    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502868    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502870    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502873    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502876    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502895    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502898    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502901    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:31:43.505162 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502905    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502908    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502911    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502914    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502924    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502927    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502929    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502932    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502935    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502938    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502940    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502943    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502945    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502948    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502951    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502953    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502956    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502958    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502961    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502965    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:31:43.505642 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502968    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502971    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502974    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502976    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502979    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502982    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502984    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502987    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502989    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502992    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502994    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502997    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.502999    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503002    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503005    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503007    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503010    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503014    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503016    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503019    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:31:43.506152 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503022    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503024    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503027    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503030    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503032    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503035    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503037    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503040    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503042    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503045    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503047    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503051    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503053    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503056    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503059    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503061    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:31:43.506619 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503064    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:31:43.507026 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.503069    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 17:31:43.507026 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503187    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 17:31:43.507026 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503193    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 17:31:43.507026 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503196    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 17:31:43.507026 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503199    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 17:31:43.507026 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503202    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 17:31:43.507026 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503205    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 17:31:43.507026 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503209    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 17:31:43.507026 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503211    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 17:31:43.507026 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503214    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 17:31:43.507026 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503217    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 17:31:43.507026 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503219    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 17:31:43.507026 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503222    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 17:31:43.507026 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503225    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 17:31:43.507026 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503228    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503230    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503233    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503236    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503239    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503242    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503244    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503247    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503249    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503252    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503254    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503257    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503259    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503262    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503265    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503267    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503270    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503273    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503276    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503279    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 17:31:43.507402 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503281    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503284    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503286    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503289    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503291    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503294    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503296    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503298    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503301    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503303    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503306    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503308    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503313    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503317    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503320    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503324    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503328    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503331    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503333    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 17:31:43.507875 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503336    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503339    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503341    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503344    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503346    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503349    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503352    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503355    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503357    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503360    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503363    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503365    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503368    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503371    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503374    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503376    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503379    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503383    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503387    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 17:31:43.508357 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503389    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503392    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503395    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503398    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503400    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503403    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503405    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503409    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503411    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503414    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503417    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503419    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503422    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503424    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503427    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503430    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503432    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503435    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503437    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503440    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 17:31:43.508814 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503442    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 17:31:43.509330 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503445    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 17:31:43.509330 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503447    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 17:31:43.509330 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503450    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 17:31:43.509330 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503452    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 17:31:43.509330 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503455    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 17:31:43.509330 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503458    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 17:31:43.509330 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:43.503460    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 17:31:43.509330 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.503465    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 17:31:43.509330 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.503598    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 17:31:43.510131 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.510112    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 17:31:43.511749 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.511736    2564 server.go:1019] "Starting client certificate rotation"
Jul 13 17:31:43.511869 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.511849    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 17:31:43.511923 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.511901    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 17:31:43.514560 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.514544    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 17:31:43.517419 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.517397    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 17:31:43.529772 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.529753    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 13 17:31:43.532407 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.532390    2564 log.go:25] "Validated CRI v1 image API"
Jul 13 17:31:43.533293 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.533263    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 17:31:43.536232 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.536207    2564 fs.go:135] Filesystem UUIDs: map[238c5da6-1748-4f25-b4e7-424d32a1b3b1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 be70055d-1f5d-4bd6-bc22-8cecab48d933:/dev/nvme0n1p3]
Jul 13 17:31:43.536319 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.536231    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 17:31:43.541502 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.541476    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 17:31:43.541693 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.541573    2564 manager.go:216] Machine: {Timestamp:2026-07-13 17:31:43.541024693 +0000 UTC m=+0.379588176 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3068301 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec268babfa55cd4621206a99902da856 SystemUUID:ec268bab-fa55-cd46-2120-6a99902da856 BootID:f61112e8-5361-4334-9ce6-76b4e8e2fd05 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:70:6e:51:0b:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:70:6e:51:0b:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:b8:04:52:81:f8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 17:31:43.541693 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.541688    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 17:31:43.541837 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.541825    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 17:31:43.544456 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.544429    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 17:31:43.544645 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.544458    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-223.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 17:31:43.545333 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.545322    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 17:31:43.545366 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.545336    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 17:31:43.545366 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.545344    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 17:31:43.545366 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.545359    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 17:31:43.547257 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.547245    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 17:31:43.552087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.552071    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 17:31:43.552215 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.552205    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 17:31:43.552246 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.552237    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 17:31:43.552273 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.552247    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 17:31:43.552273 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.552259    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 17:31:43.552273 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.552270    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 13 17:31:43.552359 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.552280    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 17:31:43.552709 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.552688    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 17:31:43.552743 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.552714    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 17:31:43.554980 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.554955    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 17:31:43.557222 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.557205    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 17:31:43.557310 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.557237    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 17:31:43.557410 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.557400    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 17:31:43.557444 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.557415    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 17:31:43.557444 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.557421    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 17:31:43.557444 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.557426    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 17:31:43.557444 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.557434    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 17:31:43.557444 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.557440    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 17:31:43.558027 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.558018    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 17:31:43.558064 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.558027    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 17:31:43.558064 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.558035    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 17:31:43.558064 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.558041    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 17:31:43.558064 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.558049    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 17:31:43.558064 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.558056    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 17:31:43.558977 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.558967    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 17:31:43.558977 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.558977    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 17:31:43.561315 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.561290    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-223.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 17:31:43.561413 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.561354    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 17:31:43.561413 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.561364    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-223.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 17:31:43.562590 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.562577    2564 server.go:1268] "Started kubelet"
Jul 13 17:31:43.562736 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.562678    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 17:31:43.562800 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.562763    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 17:31:43.563451 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.563420    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 17:31:43.563546 ip-10-0-137-223 systemd[1]: Started Kubernetes Kubelet.
Jul 13 17:31:43.564284 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.564263    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 17:31:43.564593 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.564580    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 17:31:43.568807 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.568785    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 17:31:43.568932 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.567715    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-223.ec2.internal.18c1e9b7ebf6edc5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-223.ec2.internal,UID:ip-10-0-137-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-223.ec2.internal,},FirstTimestamp:2026-07-13 17:31:43.562542533 +0000 UTC m=+0.401106016,LastTimestamp:2026-07-13 17:31:43.562542533 +0000 UTC m=+0.401106016,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-223.ec2.internal,}"
Jul 13 17:31:43.572854 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.572834    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 17:31:43.573574 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.573557    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 17:31:43.573839 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.573713    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-223.ec2.internal\" not found"
Jul 13 17:31:43.574364 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.574348    2564 factory.go:55] Registering systemd factory
Jul 13 17:31:43.574430 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.574369    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 13 17:31:43.574476 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.574427    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 17:31:43.574476 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.574439    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 17:31:43.574476 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.574436    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 17:31:43.574584 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.574567    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 17:31:43.574584 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.574576    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 17:31:43.574653 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.574624    2564 factory.go:153] Registering CRI-O factory
Jul 13 17:31:43.574653 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.574637    2564 factory.go:223] Registration of the crio container factory successfully
Jul 13 17:31:43.574703 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.574693    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 17:31:43.574736 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.574721    2564 factory.go:103] Registering Raw factory
Jul 13 17:31:43.574764 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.574736    2564 manager.go:1196] Started watching for new ooms in manager
Jul 13 17:31:43.575695 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.575680    2564 manager.go:349] Starting recovery of all containers
Jul 13 17:31:43.584873 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.584588    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 17:31:43.584873 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.584621    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-223.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 17:31:43.587395 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.587374    2564 manager.go:354] Recovery completed
Jul 13 17:31:43.588133 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.588102    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2x745"
Jul 13 17:31:43.591769 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.591752    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:31:43.593743 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.593720    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:31:43.593817 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.593758    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:31:43.593817 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.593769    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:31:43.594385 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.594369    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 17:31:43.594385 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.594384    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 17:31:43.594476 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.594401    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 17:31:43.594476 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.594435    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:31:43.595184 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.595170    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:31:43.595228 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.595198    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:31:43.595228 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.595209    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:31:43.595703 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.595634    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-223.ec2.internal.18c1e9b7edd2fe2f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-223.ec2.internal,UID:ip-10-0-137-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-223.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-223.ec2.internal,},FirstTimestamp:2026-07-13 17:31:43.593741871 +0000 UTC m=+0.432305357,LastTimestamp:2026-07-13 17:31:43.593741871 +0000 UTC m=+0.432305357,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-223.ec2.internal,}"
Jul 13 17:31:43.596595 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.596584    2564 policy_none.go:49] "None policy: Start"
Jul 13 17:31:43.596630 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.596600    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 17:31:43.596630 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.596610    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 17:31:43.598784 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.598767    2564 policy_none.go:47] "Start"
Jul 13 17:31:43.598988 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.598970    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2x745"
Jul 13 17:31:43.603910 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.603823    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-223.ec2.internal.18c1e9b7edd35180  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-223.ec2.internal,UID:ip-10-0-137-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-223.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-223.ec2.internal,},FirstTimestamp:2026-07-13 17:31:43.5937632 +0000 UTC m=+0.432326686,LastTimestamp:2026-07-13 17:31:43.5937632 +0000 UTC m=+0.432326686,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-223.ec2.internal,}"
Jul 13 17:31:43.642730 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.642644    2564 manager.go:337] "Starting Device Plugin manager"
Jul 13 17:31:43.642730 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.642703    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 17:31:43.642730 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.642716    2564 server.go:87] "Starting device plugin registration server"
Jul 13 17:31:43.657028 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.643030    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 17:31:43.657028 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.643042    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 17:31:43.657028 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.643126    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 17:31:43.657028 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.643206    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 17:31:43.657028 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.643214    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 17:31:43.657028 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.643790    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 17:31:43.657028 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.643835    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-223.ec2.internal\" not found"
Jul 13 17:31:43.676776 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.676739    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 17:31:43.677982 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.677965    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 17:31:43.678083 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.678009    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 17:31:43.678083 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.678035    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 17:31:43.678083 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.678076    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 17:31:43.680228 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.680202    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:31:43.744083 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.744052    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:31:43.745274 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.745255    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:31:43.745390 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.745286    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:31:43.745390 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.745296    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:31:43.745390 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.745320    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-223.ec2.internal"
Jul 13 17:31:43.753640 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.753618    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-223.ec2.internal"
Jul 13 17:31:43.753708 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.753651    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-223.ec2.internal\": node \"ip-10-0-137-223.ec2.internal\" not found"
Jul 13 17:31:43.773267 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.773242    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-223.ec2.internal\" not found"
Jul 13 17:31:43.778448 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.778415    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-223.ec2.internal"]
Jul 13 17:31:43.778531 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.778497    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:31:43.779440 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.779425    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:31:43.779505 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.779456    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:31:43.779505 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.779465    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:31:43.781498 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.781484    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:31:43.781607 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.781594    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal"
Jul 13 17:31:43.781644 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.781631    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:31:43.782255 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.782240    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:31:43.782321 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.782243    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:31:43.782321 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.782283    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:31:43.782321 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.782294    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:31:43.782321 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.782265    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:31:43.782450 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.782352    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:31:43.784302 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.784283    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-223.ec2.internal"
Jul 13 17:31:43.784400 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.784313    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:31:43.785120 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.785105    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:31:43.785219 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.785133    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:31:43.785219 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.785146    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:31:43.814911 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.814864    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-223.ec2.internal\" not found" node="ip-10-0-137-223.ec2.internal"
Jul 13 17:31:43.819596 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.819574    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-223.ec2.internal\" not found" node="ip-10-0-137-223.ec2.internal"
Jul 13 17:31:43.874190 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.874152    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-223.ec2.internal\" not found"
Jul 13 17:31:43.875380 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.875353    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d20729b6d64007b4475ae9754086a553-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal\" (UID: \"d20729b6d64007b4475ae9754086a553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal"
Jul 13 17:31:43.875468 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.875390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d20729b6d64007b4475ae9754086a553-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal\" (UID: \"d20729b6d64007b4475ae9754086a553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal"
Jul 13 17:31:43.974590 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:43.974523    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-223.ec2.internal\" not found"
Jul 13 17:31:43.975643 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.975621    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d20729b6d64007b4475ae9754086a553-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal\" (UID: \"d20729b6d64007b4475ae9754086a553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal"
Jul 13 17:31:43.975718 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.975656    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2c4c00b6996d408e41b531f802af9845-config\") pod \"kube-apiserver-proxy-ip-10-0-137-223.ec2.internal\" (UID: \"2c4c00b6996d408e41b531f802af9845\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-223.ec2.internal"
Jul 13 17:31:43.975718 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.975685    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d20729b6d64007b4475ae9754086a553-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal\" (UID: \"d20729b6d64007b4475ae9754086a553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal"
Jul 13 17:31:43.975808 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.975738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d20729b6d64007b4475ae9754086a553-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal\" (UID: \"d20729b6d64007b4475ae9754086a553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal"
Jul 13 17:31:43.975808 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:43.975738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d20729b6d64007b4475ae9754086a553-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal\" (UID: \"d20729b6d64007b4475ae9754086a553\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal"
Jul 13 17:31:44.075210 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:44.075172    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-223.ec2.internal\" not found"
Jul 13 17:31:44.076284 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.076264    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2c4c00b6996d408e41b531f802af9845-config\") pod \"kube-apiserver-proxy-ip-10-0-137-223.ec2.internal\" (UID: \"2c4c00b6996d408e41b531f802af9845\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-223.ec2.internal"
Jul 13 17:31:44.076343 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.076316    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2c4c00b6996d408e41b531f802af9845-config\") pod \"kube-apiserver-proxy-ip-10-0-137-223.ec2.internal\" (UID: \"2c4c00b6996d408e41b531f802af9845\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-223.ec2.internal"
Jul 13 17:31:44.116386 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.116349    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal"
Jul 13 17:31:44.122414 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.122395    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-223.ec2.internal"
Jul 13 17:31:44.176032 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:44.175994    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-223.ec2.internal\" not found"
Jul 13 17:31:44.276534 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:44.276456    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-223.ec2.internal\" not found"
Jul 13 17:31:44.376933 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:44.376899    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-223.ec2.internal\" not found"
Jul 13 17:31:44.477614 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:44.477579    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-223.ec2.internal\" not found"
Jul 13 17:31:44.510860 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.510817    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 17:31:44.511467 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.511015    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 17:31:44.577990 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:44.577921    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-223.ec2.internal\" not found"
Jul 13 17:31:44.603923 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.603859    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 17:26:44 +0000 UTC" deadline="2028-04-30 01:55:52.380796768 +0000 UTC"
Jul 13 17:31:44.603923 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.603910    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15752h24m7.776889828s"
Jul 13 17:31:44.678477 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.678446    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 17:31:44.678649 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:44.678445    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-223.ec2.internal\" not found"
Jul 13 17:31:44.679977 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.679958    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 17:31:44.680087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.679989    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 17:31:44.680087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.680000    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeHasSufficientPID"
Jul 13 17:31:44.732076 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:44.732045    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c4c00b6996d408e41b531f802af9845.slice/crio-4e41fdefcfd9724db70f252be93f707ff3a1f6f3e2ee9bde8fc62f577d297ae6 WatchSource:0}: Error finding container 4e41fdefcfd9724db70f252be93f707ff3a1f6f3e2ee9bde8fc62f577d297ae6: Status 404 returned error can't find the container with id 4e41fdefcfd9724db70f252be93f707ff3a1f6f3e2ee9bde8fc62f577d297ae6
Jul 13 17:31:44.738145 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.738123    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:31:44.746308 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:44.746281    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20729b6d64007b4475ae9754086a553.slice/crio-dfb9a8fbd65daee78879af6b9487d64ee45a83bf4c5b53263d08174b6864361e WatchSource:0}: Error finding container dfb9a8fbd65daee78879af6b9487d64ee45a83bf4c5b53263d08174b6864361e: Status 404 returned error can't find the container with id dfb9a8fbd65daee78879af6b9487d64ee45a83bf4c5b53263d08174b6864361e
Jul 13 17:31:44.779500 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:44.779464    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-223.ec2.internal\" not found"
Jul 13 17:31:44.835936 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.835865    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:31:44.848427 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.848404    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:31:44.874723 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.874694    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal"
Jul 13 17:31:44.886933 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.886908    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 17:31:44.888930 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.888913    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-223.ec2.internal"
Jul 13 17:31:44.897241 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:44.897221    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 17:31:45.078064 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.078033    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:31:45.553234 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.553202    2564 apiserver.go:52] "Watching apiserver"
Jul 13 17:31:45.560024 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.559795    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 17:31:45.560311 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.560285    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-hwf7p","openshift-multus/network-metrics-daemon-vzwcn","openshift-network-diagnostics/network-check-target-4bdcp","openshift-network-operator/iptables-alerter-4stks","openshift-ovn-kubernetes/ovnkube-node-w54x7","kube-system/global-pull-secret-syncer-s4xjg","kube-system/konnectivity-agent-qrvn2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6","openshift-cluster-node-tuning-operator/tuned-8t85k","openshift-dns/node-resolver-7gznh","openshift-image-registry/node-ca-nx5qk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal","openshift-multus/multus-additional-cni-plugins-p58fk","kube-system/kube-apiserver-proxy-ip-10-0-137-223.ec2.internal"]
Jul 13 17:31:45.563129 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.563103    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qrvn2"
Jul 13 17:31:45.566799 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.566772    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 17:31:45.567033 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.567013    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8n9xl\""
Jul 13 17:31:45.568762 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.567253    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 17:31:45.568762 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.567589    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:45.568762 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.568481    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:31:45.568762 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:45.568562    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:31:45.569448 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.569308    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 17:31:45.569681 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.569662    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m5khn\""
Jul 13 17:31:45.570061 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.570038    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 17:31:45.570730 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.570681    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4stks"
Jul 13 17:31:45.571844 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.571526    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 17:31:45.572924 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.571994    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 17:31:45.572924 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.572214    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 17:31:45.573524 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.573401    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vch8s\""
Jul 13 17:31:45.573800 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.573786    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 17:31:45.573872 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.573797    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 17:31:45.573872 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.573830    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 17:31:45.574777 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.574597    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:31:45.575167 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.575145    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.578431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.578120    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 17:31:45.578431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.578193    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 17:31:45.578431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.578236    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 17:31:45.579590 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.578633    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:45.579590 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:45.578755    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:31:45.579590 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.579077    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hsdkw\""
Jul 13 17:31:45.579590 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.579086    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 17:31:45.579590 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.579255    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 17:31:45.579590 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.579347    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 17:31:45.582459 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.582436    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-log-socket\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.582668 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.582648    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-os-release\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:45.582951 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.582867    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59679176-562f-4d4f-9108-27f65f1efc4b-host-slash\") pod \"iptables-alerter-4stks\" (UID: \"59679176-562f-4d4f-9108-27f65f1efc4b\") " pod="openshift-network-operator/iptables-alerter-4stks"
Jul 13 17:31:45.583077 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583062    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj7md\" (UniqueName: \"kubernetes.io/projected/59679176-562f-4d4f-9108-27f65f1efc4b-kube-api-access-sj7md\") pod \"iptables-alerter-4stks\" (UID: \"59679176-562f-4d4f-9108-27f65f1efc4b\") " pod="openshift-network-operator/iptables-alerter-4stks"
Jul 13 17:31:45.583173 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59b522db-1e47-4a2c-a485-a3d78792a661-env-overrides\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.583267 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583255    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59b522db-1e47-4a2c-a485-a3d78792a661-ovnkube-script-lib\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.583371 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583345    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk6t4\" (UniqueName: \"kubernetes.io/projected/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-kube-api-access-dk6t4\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:45.583635 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583612    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/59679176-562f-4d4f-9108-27f65f1efc4b-iptables-alerter-script\") pod \"iptables-alerter-4stks\" (UID: \"59679176-562f-4d4f-9108-27f65f1efc4b\") " pod="openshift-network-operator/iptables-alerter-4stks"
Jul 13 17:31:45.583737 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583644    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-slash\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.583737 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583667    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-var-lib-openvswitch\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.583737 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583690    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-run-openvswitch\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.583737 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583713    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-run-ovn\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.583737 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583734    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-cni-bin\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.584005 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-systemd-units\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.584005 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583779    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-node-log\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.584005 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583802    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:45.584005 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583825    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:45.584005 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583847    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-cni-netd\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.584005 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583873    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.584005 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583934    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-system-cni-dir\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:45.584005 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.583966    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-cnibin\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:45.585511 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.584011    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-kubelet\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.585511 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.584035    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-etc-openvswitch\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.585511 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.584062    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpqv6\" (UniqueName: \"kubernetes.io/projected/59b522db-1e47-4a2c-a485-a3d78792a661-kube-api-access-fpqv6\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.585511 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.584098    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f05dbea2-6cf8-47e0-861c-8045ec151d3c-konnectivity-ca\") pod \"konnectivity-agent-qrvn2\" (UID: \"f05dbea2-6cf8-47e0-861c-8045ec151d3c\") " pod="kube-system/konnectivity-agent-qrvn2"
Jul 13 17:31:45.585511 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.584116    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:45.585511 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.584124    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-run-ovn-kubernetes\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.585511 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.584145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59b522db-1e47-4a2c-a485-a3d78792a661-ovnkube-config\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.585511 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.584180    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:45.585511 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.584236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:45.585511 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.584270    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgk5b\" (UniqueName: \"kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b\") pod \"network-check-target-4bdcp\" (UID: \"890ecca9-2a93-47c0-bace-5c5b3d18a55e\") " pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:31:45.585511 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.584304    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59b522db-1e47-4a2c-a485-a3d78792a661-ovn-node-metrics-cert\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.585511 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.584328    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f05dbea2-6cf8-47e0-861c-8045ec151d3c-agent-certs\") pod \"konnectivity-agent-qrvn2\" (UID: \"f05dbea2-6cf8-47e0-861c-8045ec151d3c\") " pod="kube-system/konnectivity-agent-qrvn2"
Jul 13 17:31:45.585511 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.584351    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-run-netns\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.585511 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.584375    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-run-systemd\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:45.586209 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.585739    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:45.586209 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.586034    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w8bbl\""
Jul 13 17:31:45.586867 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.586850    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 17:31:45.587205 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.587186    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:31:45.587798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.587636    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 17:31:45.588949 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.588627    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:45.588949 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:45.588713    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:31:45.589787 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.589315    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d5jqr\""
Jul 13 17:31:45.589787 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.589565    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 17:31:45.590673 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.590656    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7gznh"
Jul 13 17:31:45.592355 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.592332    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 17:31:45.592623 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.592609    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b58qp\""
Jul 13 17:31:45.592732 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.592715    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 17:31:45.593161 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.593109    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nx5qk"
Jul 13 17:31:45.595108 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.594954    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vp779\""
Jul 13 17:31:45.595663 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.595225    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 17:31:45.595663 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.595482    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 17:31:45.596042 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.595423    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 17:31:45.596517 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.596326    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:45.599137 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.599116    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 17:31:45.599311 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.599292    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 17:31:45.599591 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.599180    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 17:31:45.599591 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.599587    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5jj2x\""
Jul 13 17:31:45.605808 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.605790    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-79hbj"
Jul 13 17:31:45.614713 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.614665    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-79hbj"
Jul 13 17:31:45.675685 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:45.675600    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 17:31:47.010096 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010031    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-var-lib-cni-bin\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.010096 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010086    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59b522db-1e47-4a2c-a485-a3d78792a661-ovn-node-metrics-cert\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.010332 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010115    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdgpx\" (UniqueName: \"kubernetes.io/projected/0e86d56d-6153-46b0-b239-1d02235ce1e3-kube-api-access-zdgpx\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.010332 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010139    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-etc-kubernetes\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.010332 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f05dbea2-6cf8-47e0-861c-8045ec151d3c-agent-certs\") pod \"konnectivity-agent-qrvn2\" (UID: \"f05dbea2-6cf8-47e0-861c-8045ec151d3c\") " pod="kube-system/konnectivity-agent-qrvn2"
Jul 13 17:31:47.010332 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010181    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0b0c1eb-d696-4180-bfd9-f7d1d32dec80-host\") pod \"node-ca-nx5qk\" (UID: \"e0b0c1eb-d696-4180-bfd9-f7d1d32dec80\") " pod="openshift-image-registry/node-ca-nx5qk"
Jul 13 17:31:47.010332 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010199    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-sys\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.010332 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-lib-modules\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.010332 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010240    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-tmp\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.010332 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010260    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-multus-cni-dir\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.010332 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-log-socket\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.010332 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010331    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj7md\" (UniqueName: \"kubernetes.io/projected/59679176-562f-4d4f-9108-27f65f1efc4b-kube-api-access-sj7md\") pod \"iptables-alerter-4stks\" (UID: \"59679176-562f-4d4f-9108-27f65f1efc4b\") " pod="openshift-network-operator/iptables-alerter-4stks"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59b522db-1e47-4a2c-a485-a3d78792a661-env-overrides\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-tuned\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-hostroot\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs\") pod \"network-metrics-daemon-vzwcn\" (UID: \"b049232f-2f86-4a9a-aed5-5c294c59e33d\") " pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk6t4\" (UniqueName: \"kubernetes.io/projected/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-kube-api-access-dk6t4\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010494    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-var-lib-openvswitch\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-run-openvswitch\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010553    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-cni-bin\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010599    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-sys-fs\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-var-lib-kubelet\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010644    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-run-k8s-cni-cncf-io\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010673    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-systemd-units\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010699    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-node-log\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010723    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-sysctl-d\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010755    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-sysctl-conf\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.010809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-device-dir\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010836    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-modprobe-d\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010859    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-systemd\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010885    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-system-cni-dir\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-cnibin\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-kubelet\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010965    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7j8q\" (UniqueName: \"kubernetes.io/projected/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-kube-api-access-b7j8q\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.010993    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f05dbea2-6cf8-47e0-861c-8045ec151d3c-konnectivity-ca\") pod \"konnectivity-agent-qrvn2\" (UID: \"f05dbea2-6cf8-47e0-861c-8045ec151d3c\") " pod="kube-system/konnectivity-agent-qrvn2"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011016    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-socket-dir\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011052    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/25cdc609-cac2-4bf2-9410-a4f48e6f5094-kubelet-config\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011077    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-run\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-system-cni-dir\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011125    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011152    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011177    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgk5b\" (UniqueName: \"kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b\") pod \"network-check-target-4bdcp\" (UID: \"890ecca9-2a93-47c0-bace-5c5b3d18a55e\") " pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:31:47.011637 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011202    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0b0c1eb-d696-4180-bfd9-f7d1d32dec80-serviceca\") pod \"node-ca-nx5qk\" (UID: \"e0b0c1eb-d696-4180-bfd9-f7d1d32dec80\") " pod="openshift-image-registry/node-ca-nx5qk"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011225    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-kubernetes\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-host\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011287    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-var-lib-cni-multus\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-var-lib-kubelet\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-run-netns\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011365    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-run-systemd\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49q8k\" (UniqueName: \"kubernetes.io/projected/e0b0c1eb-d696-4180-bfd9-f7d1d32dec80-kube-api-access-49q8k\") pod \"node-ca-nx5qk\" (UID: \"e0b0c1eb-d696-4180-bfd9-f7d1d32dec80\") " pod="openshift-image-registry/node-ca-nx5qk"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011443    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-multus-socket-dir-parent\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011467    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-run-netns\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4skdl\" (UniqueName: \"kubernetes.io/projected/5e61016d-5fbf-4809-ab79-1115f7308201-kube-api-access-4skdl\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011521    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpn66\" (UniqueName: \"kubernetes.io/projected/b049232f-2f86-4a9a-aed5-5c294c59e33d-kube-api-access-lpn66\") pod \"network-metrics-daemon-vzwcn\" (UID: \"b049232f-2f86-4a9a-aed5-5c294c59e33d\") " pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011499    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal" event={"ID":"d20729b6d64007b4475ae9754086a553","Type":"ContainerStarted","Data":"dfb9a8fbd65daee78879af6b9487d64ee45a83bf4c5b53263d08174b6864361e"}
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011549    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-os-release\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59679176-562f-4d4f-9108-27f65f1efc4b-host-slash\") pod \"iptables-alerter-4stks\" (UID: \"59679176-562f-4d4f-9108-27f65f1efc4b\") " pod="openshift-network-operator/iptables-alerter-4stks"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59b522db-1e47-4a2c-a485-a3d78792a661-ovnkube-script-lib\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011628    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-cnibin\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.012409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e61016d-5fbf-4809-ab79-1115f7308201-cni-binary-copy\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011652    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011677    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-run-multus-certs\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/59679176-562f-4d4f-9108-27f65f1efc4b-iptables-alerter-script\") pod \"iptables-alerter-4stks\" (UID: \"59679176-562f-4d4f-9108-27f65f1efc4b\") " pod="openshift-network-operator/iptables-alerter-4stks"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011742    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-slash\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011775    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-run-ovn\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011803    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-registration-dir\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/25cdc609-cac2-4bf2-9410-a4f48e6f5094-dbus\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011881    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d8d7\" (UniqueName: \"kubernetes.io/projected/26261b52-74ca-405a-98cc-4cd807ec42f4-kube-api-access-6d8d7\") pod \"node-resolver-7gznh\" (UID: \"26261b52-74ca-405a-98cc-4cd807ec42f4\") " pod="openshift-dns/node-resolver-7gznh"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011927    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-sysconfig\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-os-release\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.011988    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012044    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-cni-netd\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012070    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26261b52-74ca-405a-98cc-4cd807ec42f4-hosts-file\") pod \"node-resolver-7gznh\" (UID: \"26261b52-74ca-405a-98cc-4cd807ec42f4\") " pod="openshift-dns/node-resolver-7gznh"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012056    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 17:31:47.013138 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012120    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-multus-conf-dir\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.013943 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012156    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e61016d-5fbf-4809-ab79-1115f7308201-multus-daemon-config\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.013943 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012180    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-etc-openvswitch\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.013943 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpqv6\" (UniqueName: \"kubernetes.io/projected/59b522db-1e47-4a2c-a485-a3d78792a661-kube-api-access-fpqv6\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.013943 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012230    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26261b52-74ca-405a-98cc-4cd807ec42f4-tmp-dir\") pod \"node-resolver-7gznh\" (UID: \"26261b52-74ca-405a-98cc-4cd807ec42f4\") " pod="openshift-dns/node-resolver-7gznh"
Jul 13 17:31:47.013943 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.013943 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012289    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-run-ovn-kubernetes\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.013943 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012318    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59b522db-1e47-4a2c-a485-a3d78792a661-ovnkube-config\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.013943 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012356    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-system-cni-dir\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.013943 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012401    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-cnibin\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.013943 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012442    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-kubelet\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.013943 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012916    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/59b522db-1e47-4a2c-a485-a3d78792a661-ovnkube-config\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.013943 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.012925    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f05dbea2-6cf8-47e0-861c-8045ec151d3c-konnectivity-ca\") pod \"konnectivity-agent-qrvn2\" (UID: \"f05dbea2-6cf8-47e0-861c-8045ec151d3c\") " pod="kube-system/konnectivity-agent-qrvn2"
Jul 13 17:31:47.014523 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.014036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.014523 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.014482    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.014696    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-run-netns\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.014743    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-run-systemd\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.014810    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-os-release\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.014810    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-log-socket\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.014848    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59679176-562f-4d4f-9108-27f65f1efc4b-host-slash\") pod \"iptables-alerter-4stks\" (UID: \"59679176-562f-4d4f-9108-27f65f1efc4b\") " pod="openshift-network-operator/iptables-alerter-4stks"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.015381    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/59b522db-1e47-4a2c-a485-a3d78792a661-ovnkube-script-lib\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.015401    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/59b522db-1e47-4a2c-a485-a3d78792a661-env-overrides\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.015458    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-run-ovn\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.015893    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/59679176-562f-4d4f-9108-27f65f1efc4b-iptables-alerter-script\") pod \"iptables-alerter-4stks\" (UID: \"59679176-562f-4d4f-9108-27f65f1efc4b\") " pod="openshift-network-operator/iptables-alerter-4stks"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.015913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.015941    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-slash\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.016053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.016095    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-cni-netd\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.016137    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-var-lib-openvswitch\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.016169    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-run-openvswitch\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.016199    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-cni-bin\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.016236    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-systemd-units\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.016423 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.016264    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-node-log\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.019313 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.016312    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-etc-openvswitch\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.019313 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.016338    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59b522db-1e47-4a2c-a485-a3d78792a661-host-run-ovn-kubernetes\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.019313 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.017257    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/59b522db-1e47-4a2c-a485-a3d78792a661-ovn-node-metrics-cert\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.019313 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.018871    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-223.ec2.internal" event={"ID":"2c4c00b6996d408e41b531f802af9845","Type":"ContainerStarted","Data":"4e41fdefcfd9724db70f252be93f707ff3a1f6f3e2ee9bde8fc62f577d297ae6"}
Jul 13 17:31:47.019501 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.019376    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f05dbea2-6cf8-47e0-861c-8045ec151d3c-agent-certs\") pod \"konnectivity-agent-qrvn2\" (UID: \"f05dbea2-6cf8-47e0-861c-8045ec151d3c\") " pod="kube-system/konnectivity-agent-qrvn2"
Jul 13 17:31:47.020474 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.020333    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:31:47.020474 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.020361    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:31:47.020474 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.020373    2564 projected.go:196] Error preparing data for projected volume kube-api-access-kgk5b for pod openshift-network-diagnostics/network-check-target-4bdcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:31:47.020474 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.020433    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b podName:890ecca9-2a93-47c0-bace-5c5b3d18a55e nodeName:}" failed. No retries permitted until 2026-07-13 17:31:47.520413646 +0000 UTC m=+3.033588906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kgk5b" (UniqueName: "kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b") pod "network-check-target-4bdcp" (UID: "890ecca9-2a93-47c0-bace-5c5b3d18a55e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:31:47.023780 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.023682    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj7md\" (UniqueName: \"kubernetes.io/projected/59679176-562f-4d4f-9108-27f65f1efc4b-kube-api-access-sj7md\") pod \"iptables-alerter-4stks\" (UID: \"59679176-562f-4d4f-9108-27f65f1efc4b\") " pod="openshift-network-operator/iptables-alerter-4stks"
Jul 13 17:31:47.026377 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.026313    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk6t4\" (UniqueName: \"kubernetes.io/projected/b8d7f308-9d05-4571-9072-9dadbdf3ccb4-kube-api-access-dk6t4\") pod \"multus-additional-cni-plugins-p58fk\" (UID: \"b8d7f308-9d05-4571-9072-9dadbdf3ccb4\") " pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.026555 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.026506    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpqv6\" (UniqueName: \"kubernetes.io/projected/59b522db-1e47-4a2c-a485-a3d78792a661-kube-api-access-fpqv6\") pod \"ovnkube-node-w54x7\" (UID: \"59b522db-1e47-4a2c-a485-a3d78792a661\") " pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.113077 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113037    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-tmp\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.113311 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113098    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-multus-cni-dir\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.113311 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113126    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-tuned\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.113311 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113152    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-hostroot\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.113311 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113179    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs\") pod \"network-metrics-daemon-vzwcn\" (UID: \"b049232f-2f86-4a9a-aed5-5c294c59e33d\") " pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:47.113311 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113208    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.113311 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-sys-fs\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.113311 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-var-lib-kubelet\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.113311 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113261    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-multus-cni-dir\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.113773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113350    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.113773 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.113393    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:31:47.113773 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.113478    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs podName:b049232f-2f86-4a9a-aed5-5c294c59e33d nodeName:}" failed. No retries permitted until 2026-07-13 17:31:47.613457711 +0000 UTC m=+3.126632974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs") pod "network-metrics-daemon-vzwcn" (UID: "b049232f-2f86-4a9a-aed5-5c294c59e33d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:31:47.113773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113539    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-hostroot\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.113773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-run-k8s-cni-cncf-io\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.113773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113612    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-sys-fs\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.113773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113625    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-sysctl-d\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.113773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-sysctl-conf\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.113773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-device-dir\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.113773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-modprobe-d\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.113773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113728    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-systemd\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.113773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113734    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-var-lib-kubelet\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.113773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-run-k8s-cni-cncf-io\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.113773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7j8q\" (UniqueName: \"kubernetes.io/projected/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-kube-api-access-b7j8q\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.113773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-socket-dir\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113790    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-device-dir\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113808    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/25cdc609-cac2-4bf2-9410-a4f48e6f5094-kubelet-config\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113828    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-run\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-system-cni-dir\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0b0c1eb-d696-4180-bfd9-f7d1d32dec80-serviceca\") pod \"node-ca-nx5qk\" (UID: \"e0b0c1eb-d696-4180-bfd9-f7d1d32dec80\") " pod="openshift-image-registry/node-ca-nx5qk"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113907    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-kubernetes\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-sysctl-conf\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113918    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-sysctl-d\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113929    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-host\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113957    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-var-lib-cni-multus\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113973    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/25cdc609-cac2-4bf2-9410-a4f48e6f5094-kubelet-config\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.113987    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-run\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114006    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-var-lib-cni-multus\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114019    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-kubernetes\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114031    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-systemd\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114086    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-system-cni-dir\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114096    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-modprobe-d\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.114372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114139    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-host\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-var-lib-kubelet\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-socket-dir\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49q8k\" (UniqueName: \"kubernetes.io/projected/e0b0c1eb-d696-4180-bfd9-f7d1d32dec80-kube-api-access-49q8k\") pod \"node-ca-nx5qk\" (UID: \"e0b0c1eb-d696-4180-bfd9-f7d1d32dec80\") " pod="openshift-image-registry/node-ca-nx5qk"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114225    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-var-lib-kubelet\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-multus-socket-dir-parent\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114287    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-multus-socket-dir-parent\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-run-netns\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114318    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4skdl\" (UniqueName: \"kubernetes.io/projected/5e61016d-5fbf-4809-ab79-1115f7308201-kube-api-access-4skdl\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114320    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-run-netns\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpn66\" (UniqueName: \"kubernetes.io/projected/b049232f-2f86-4a9a-aed5-5c294c59e33d-kube-api-access-lpn66\") pod \"network-metrics-daemon-vzwcn\" (UID: \"b049232f-2f86-4a9a-aed5-5c294c59e33d\") " pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-cnibin\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e61016d-5fbf-4809-ab79-1115f7308201-cni-binary-copy\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-run-multus-certs\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114465    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-registration-dir\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114488    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/25cdc609-cac2-4bf2-9410-a4f48e6f5094-dbus\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114485    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-cnibin\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-run-multus-certs\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.115212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114533    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-registration-dir\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114566    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d8d7\" (UniqueName: \"kubernetes.io/projected/26261b52-74ca-405a-98cc-4cd807ec42f4-kube-api-access-6d8d7\") pod \"node-resolver-7gznh\" (UID: \"26261b52-74ca-405a-98cc-4cd807ec42f4\") " pod="openshift-dns/node-resolver-7gznh"
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114614    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/25cdc609-cac2-4bf2-9410-a4f48e6f5094-dbus\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-sysconfig\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-os-release\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.114667    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26261b52-74ca-405a-98cc-4cd807ec42f4-hosts-file\") pod \"node-resolver-7gznh\" (UID: \"26261b52-74ca-405a-98cc-4cd807ec42f4\") " pod="openshift-dns/node-resolver-7gznh"
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114702    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-os-release\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114655    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-sysconfig\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.114716    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret podName:25cdc609-cac2-4bf2-9410-a4f48e6f5094 nodeName:}" failed. No retries permitted until 2026-07-13 17:31:47.614699593 +0000 UTC m=+3.127874845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret") pod "global-pull-secret-syncer-s4xjg" (UID: "25cdc609-cac2-4bf2-9410-a4f48e6f5094") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114704    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-multus-conf-dir\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114744    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-multus-conf-dir\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/26261b52-74ca-405a-98cc-4cd807ec42f4-hosts-file\") pod \"node-resolver-7gznh\" (UID: \"26261b52-74ca-405a-98cc-4cd807ec42f4\") " pod="openshift-dns/node-resolver-7gznh"
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114764    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e61016d-5fbf-4809-ab79-1115f7308201-multus-daemon-config\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26261b52-74ca-405a-98cc-4cd807ec42f4-tmp-dir\") pod \"node-resolver-7gznh\" (UID: \"26261b52-74ca-405a-98cc-4cd807ec42f4\") " pod="openshift-dns/node-resolver-7gznh"
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114819    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.116087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114845    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-var-lib-cni-bin\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114869    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdgpx\" (UniqueName: \"kubernetes.io/projected/0e86d56d-6153-46b0-b239-1d02235ce1e3-kube-api-access-zdgpx\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114891    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-etc-kubernetes\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114915    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0b0c1eb-d696-4180-bfd9-f7d1d32dec80-host\") pod \"node-ca-nx5qk\" (UID: \"e0b0c1eb-d696-4180-bfd9-f7d1d32dec80\") " pod="openshift-image-registry/node-ca-nx5qk"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114917    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0e86d56d-6153-46b0-b239-1d02235ce1e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114936    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-sys\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-lib-modules\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.114998    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e61016d-5fbf-4809-ab79-1115f7308201-cni-binary-copy\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.115062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-host-var-lib-cni-bin\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.115075    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-lib-modules\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.115072    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0b0c1eb-d696-4180-bfd9-f7d1d32dec80-host\") pod \"node-ca-nx5qk\" (UID: \"e0b0c1eb-d696-4180-bfd9-f7d1d32dec80\") " pod="openshift-image-registry/node-ca-nx5qk"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.115107    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e61016d-5fbf-4809-ab79-1115f7308201-etc-kubernetes\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.115130    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-sys\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.115232    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26261b52-74ca-405a-98cc-4cd807ec42f4-tmp-dir\") pod \"node-resolver-7gznh\" (UID: \"26261b52-74ca-405a-98cc-4cd807ec42f4\") " pod="openshift-dns/node-resolver-7gznh"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.115261    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e61016d-5fbf-4809-ab79-1115f7308201-multus-daemon-config\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.115345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0b0c1eb-d696-4180-bfd9-f7d1d32dec80-serviceca\") pod \"node-ca-nx5qk\" (UID: \"e0b0c1eb-d696-4180-bfd9-f7d1d32dec80\") " pod="openshift-image-registry/node-ca-nx5qk"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.116073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-etc-tuned\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.116903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.116755    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-tmp\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.122513 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.122478    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7j8q\" (UniqueName: \"kubernetes.io/projected/1b8b39d1-cf5d-4d5c-a386-1edd084e7e42-kube-api-access-b7j8q\") pod \"tuned-8t85k\" (UID: \"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42\") " pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.124630 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.124602    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdgpx\" (UniqueName: \"kubernetes.io/projected/0e86d56d-6153-46b0-b239-1d02235ce1e3-kube-api-access-zdgpx\") pod \"aws-ebs-csi-driver-node-9bhm6\" (UID: \"0e86d56d-6153-46b0-b239-1d02235ce1e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.124755 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.124631    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4skdl\" (UniqueName: \"kubernetes.io/projected/5e61016d-5fbf-4809-ab79-1115f7308201-kube-api-access-4skdl\") pod \"multus-hwf7p\" (UID: \"5e61016d-5fbf-4809-ab79-1115f7308201\") " pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.124755 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.124609    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d8d7\" (UniqueName: \"kubernetes.io/projected/26261b52-74ca-405a-98cc-4cd807ec42f4-kube-api-access-6d8d7\") pod \"node-resolver-7gznh\" (UID: \"26261b52-74ca-405a-98cc-4cd807ec42f4\") " pod="openshift-dns/node-resolver-7gznh"
Jul 13 17:31:47.125075 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.125056    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49q8k\" (UniqueName: \"kubernetes.io/projected/e0b0c1eb-d696-4180-bfd9-f7d1d32dec80-kube-api-access-49q8k\") pod \"node-ca-nx5qk\" (UID: \"e0b0c1eb-d696-4180-bfd9-f7d1d32dec80\") " pod="openshift-image-registry/node-ca-nx5qk"
Jul 13 17:31:47.125200 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.125181    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpn66\" (UniqueName: \"kubernetes.io/projected/b049232f-2f86-4a9a-aed5-5c294c59e33d-kube-api-access-lpn66\") pod \"network-metrics-daemon-vzwcn\" (UID: \"b049232f-2f86-4a9a-aed5-5c294c59e33d\") " pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:47.208332 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.208238    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qrvn2"
Jul 13 17:31:47.225556 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.225518    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p58fk"
Jul 13 17:31:47.236367 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.236330    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4stks"
Jul 13 17:31:47.242370 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.242344    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:31:47.251283 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.251237    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8t85k"
Jul 13 17:31:47.261167 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.261127    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hwf7p"
Jul 13 17:31:47.269049 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.269019    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7gznh"
Jul 13 17:31:47.277901 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.277873    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nx5qk"
Jul 13 17:31:47.286639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.286608    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6"
Jul 13 17:31:47.319475 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.319437    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 17:31:47.619111 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.619027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgk5b\" (UniqueName: \"kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b\") pod \"network-check-target-4bdcp\" (UID: \"890ecca9-2a93-47c0-bace-5c5b3d18a55e\") " pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:31:47.619111 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.619090    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:47.619353 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.619132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs\") pod \"network-metrics-daemon-vzwcn\" (UID: \"b049232f-2f86-4a9a-aed5-5c294c59e33d\") " pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:47.619353 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.619200    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:31:47.619353 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.619224    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:31:47.619353 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.619234    2564 projected.go:196] Error preparing data for projected volume kube-api-access-kgk5b for pod openshift-network-diagnostics/network-check-target-4bdcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:31:47.619353 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.619247    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:31:47.619353 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.619247    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:31:47.619353 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.619302    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b podName:890ecca9-2a93-47c0-bace-5c5b3d18a55e nodeName:}" failed. No retries permitted until 2026-07-13 17:31:48.619283812 +0000 UTC m=+4.132459071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgk5b" (UniqueName: "kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b") pod "network-check-target-4bdcp" (UID: "890ecca9-2a93-47c0-bace-5c5b3d18a55e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:31:47.619353 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.619318    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs podName:b049232f-2f86-4a9a-aed5-5c294c59e33d nodeName:}" failed. No retries permitted until 2026-07-13 17:31:48.619311237 +0000 UTC m=+4.132486479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs") pod "network-metrics-daemon-vzwcn" (UID: "b049232f-2f86-4a9a-aed5-5c294c59e33d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:31:47.619353 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:47.619330    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret podName:25cdc609-cac2-4bf2-9410-a4f48e6f5094 nodeName:}" failed. No retries permitted until 2026-07-13 17:31:48.619324397 +0000 UTC m=+4.132499640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret") pod "global-pull-secret-syncer-s4xjg" (UID: "25cdc609-cac2-4bf2-9410-a4f48e6f5094") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:31:47.943917 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.943800    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 17:26:46 +0000 UTC" deadline="2028-02-14 01:23:59.354135048 +0000 UTC"
Jul 13 17:31:47.943917 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:47.943859    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13927h52m11.410279744s"
Jul 13 17:31:48.004282 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:48.004237    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:48.004447 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:48.004371    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:31:48.160375 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:48.160348    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0b0c1eb_d696_4180_bfd9_f7d1d32dec80.slice/crio-921df39f9039be4e2e09761f0a39e128be978b29e6af4e7357325cc6acec69f8 WatchSource:0}: Error finding container 921df39f9039be4e2e09761f0a39e128be978b29e6af4e7357325cc6acec69f8: Status 404 returned error can't find the container with id 921df39f9039be4e2e09761f0a39e128be978b29e6af4e7357325cc6acec69f8
Jul 13 17:31:48.165006 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:48.164700    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e86d56d_6153_46b0_b239_1d02235ce1e3.slice/crio-15bb91923f7ea52a72c003eb148291c01e6170715d390e6e0b5e2d3ecf214471 WatchSource:0}: Error finding container 15bb91923f7ea52a72c003eb148291c01e6170715d390e6e0b5e2d3ecf214471: Status 404 returned error can't find the container with id 15bb91923f7ea52a72c003eb148291c01e6170715d390e6e0b5e2d3ecf214471
Jul 13 17:31:48.168957 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:48.168403    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26261b52_74ca_405a_98cc_4cd807ec42f4.slice/crio-425858156fc0db6cbad4159741c9febddf684780691f5983e85308a977de9fac WatchSource:0}: Error finding container 425858156fc0db6cbad4159741c9febddf684780691f5983e85308a977de9fac: Status 404 returned error can't find the container with id 425858156fc0db6cbad4159741c9febddf684780691f5983e85308a977de9fac
Jul 13 17:31:48.169403 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:48.169379    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b522db_1e47_4a2c_a485_a3d78792a661.slice/crio-7dfca7dbde74c3ac6536f114bb2360f86a64367140c7748efef3b910f75e10a3 WatchSource:0}: Error finding container 7dfca7dbde74c3ac6536f114bb2360f86a64367140c7748efef3b910f75e10a3: Status 404 returned error can't find the container with id 7dfca7dbde74c3ac6536f114bb2360f86a64367140c7748efef3b910f75e10a3
Jul 13 17:31:48.170330 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:48.170301    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59679176_562f_4d4f_9108_27f65f1efc4b.slice/crio-d3259fbc9155c11cdc1de6192e879012cb466ff8b8264db76387975bc1a41634 WatchSource:0}: Error finding container d3259fbc9155c11cdc1de6192e879012cb466ff8b8264db76387975bc1a41634: Status 404 returned error can't find the container with id d3259fbc9155c11cdc1de6192e879012cb466ff8b8264db76387975bc1a41634
Jul 13 17:31:48.172121 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:48.171984    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e61016d_5fbf_4809_ab79_1115f7308201.slice/crio-21d7b3e4b0b997ec1f63ea9540841affafa93129c66fe18c397441c65ed0e666 WatchSource:0}: Error finding container 21d7b3e4b0b997ec1f63ea9540841affafa93129c66fe18c397441c65ed0e666: Status 404 returned error can't find the container with id 21d7b3e4b0b997ec1f63ea9540841affafa93129c66fe18c397441c65ed0e666
Jul 13 17:31:48.174242 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:48.173973    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8b39d1_cf5d_4d5c_a386_1edd084e7e42.slice/crio-6267c55fb5172f1bae6f87bc57871690208073519e4ecc899350cbfb57b8f9e8 WatchSource:0}: Error finding container 6267c55fb5172f1bae6f87bc57871690208073519e4ecc899350cbfb57b8f9e8: Status 404 returned error can't find the container with id 6267c55fb5172f1bae6f87bc57871690208073519e4ecc899350cbfb57b8f9e8
Jul 13 17:31:48.175787 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:48.175686    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf05dbea2_6cf8_47e0_861c_8045ec151d3c.slice/crio-39169123b686e957c1e81d4d8b22a4d5f9960234529eed43f01ddc0ecff0e56a WatchSource:0}: Error finding container 39169123b686e957c1e81d4d8b22a4d5f9960234529eed43f01ddc0ecff0e56a: Status 404 returned error can't find the container with id 39169123b686e957c1e81d4d8b22a4d5f9960234529eed43f01ddc0ecff0e56a
Jul 13 17:31:48.176459 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:31:48.176437    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8d7f308_9d05_4571_9072_9dadbdf3ccb4.slice/crio-51fdd89cf8033042c9fd1b03cec65e905ad0ecd3ad79a5e6d7beb6becc310803 WatchSource:0}: Error finding container 51fdd89cf8033042c9fd1b03cec65e905ad0ecd3ad79a5e6d7beb6becc310803: Status 404 returned error can't find the container with id 51fdd89cf8033042c9fd1b03cec65e905ad0ecd3ad79a5e6d7beb6becc310803
Jul 13 17:31:48.627100 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:48.626977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgk5b\" (UniqueName: \"kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b\") pod \"network-check-target-4bdcp\" (UID: \"890ecca9-2a93-47c0-bace-5c5b3d18a55e\") " pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:31:48.627100 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:48.627049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:48.627322 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:48.627168    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:31:48.627669 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:48.627648    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:31:48.627669 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:48.627672    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:31:48.627827 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:48.627684    2564 projected.go:196] Error preparing data for projected volume kube-api-access-kgk5b for pod openshift-network-diagnostics/network-check-target-4bdcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:31:48.627827 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:48.627743    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret podName:25cdc609-cac2-4bf2-9410-a4f48e6f5094 nodeName:}" failed. No retries permitted until 2026-07-13 17:31:50.627726659 +0000 UTC m=+6.140901903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret") pod "global-pull-secret-syncer-s4xjg" (UID: "25cdc609-cac2-4bf2-9410-a4f48e6f5094") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:31:48.627827 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:48.627763    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b podName:890ecca9-2a93-47c0-bace-5c5b3d18a55e nodeName:}" failed. No retries permitted until 2026-07-13 17:31:50.627753592 +0000 UTC m=+6.140928838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgk5b" (UniqueName: "kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b") pod "network-check-target-4bdcp" (UID: "890ecca9-2a93-47c0-bace-5c5b3d18a55e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:31:48.627827 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:48.627805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs\") pod \"network-metrics-daemon-vzwcn\" (UID: \"b049232f-2f86-4a9a-aed5-5c294c59e33d\") " pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:48.628033 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:48.627902    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:31:48.628033 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:48.627936    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs podName:b049232f-2f86-4a9a-aed5-5c294c59e33d nodeName:}" failed. No retries permitted until 2026-07-13 17:31:50.627925846 +0000 UTC m=+6.141101095 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs") pod "network-metrics-daemon-vzwcn" (UID: "b049232f-2f86-4a9a-aed5-5c294c59e33d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:31:48.944621 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:48.944528    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 17:26:46 +0000 UTC" deadline="2028-04-02 12:34:25.512327978 +0000 UTC"
Jul 13 17:31:48.944621 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:48.944572    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15091h2m36.567761466s"
Jul 13 17:31:49.007342 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:49.006506    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:31:49.007342 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:49.006634    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:31:49.007342 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:49.007010    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:49.007342 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:49.007094    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:31:49.034324 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:49.033975    2564 generic.go:356] "Generic (PLEG): container finished" podID="d20729b6d64007b4475ae9754086a553" containerID="27015021afbd760ea097b864b86c0fe63b0831650d642685e0cf076ee96e3ac0" exitCode=0
Jul 13 17:31:49.034324 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:49.034077    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal" event={"ID":"d20729b6d64007b4475ae9754086a553","Type":"ContainerDied","Data":"27015021afbd760ea097b864b86c0fe63b0831650d642685e0cf076ee96e3ac0"}
Jul 13 17:31:49.061107 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:49.061069    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-223.ec2.internal" event={"ID":"2c4c00b6996d408e41b531f802af9845","Type":"ContainerStarted","Data":"bdb9d883ec6d2a650edfc7a5de7be17024182e8ff44b803d366cfe0c4de00bc2"}
Jul 13 17:31:49.070163 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:49.070084    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8t85k" event={"ID":"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42","Type":"ContainerStarted","Data":"6267c55fb5172f1bae6f87bc57871690208073519e4ecc899350cbfb57b8f9e8"}
Jul 13 17:31:49.077849 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:49.077766    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7gznh" event={"ID":"26261b52-74ca-405a-98cc-4cd807ec42f4","Type":"ContainerStarted","Data":"425858156fc0db6cbad4159741c9febddf684780691f5983e85308a977de9fac"}
Jul 13 17:31:49.098585 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:49.098542    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nx5qk" event={"ID":"e0b0c1eb-d696-4180-bfd9-f7d1d32dec80","Type":"ContainerStarted","Data":"921df39f9039be4e2e09761f0a39e128be978b29e6af4e7357325cc6acec69f8"}
Jul 13 17:31:49.105015 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:49.103084    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p58fk" event={"ID":"b8d7f308-9d05-4571-9072-9dadbdf3ccb4","Type":"ContainerStarted","Data":"51fdd89cf8033042c9fd1b03cec65e905ad0ecd3ad79a5e6d7beb6becc310803"}
Jul 13 17:31:49.108214 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:49.108121    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qrvn2" event={"ID":"f05dbea2-6cf8-47e0-861c-8045ec151d3c","Type":"ContainerStarted","Data":"39169123b686e957c1e81d4d8b22a4d5f9960234529eed43f01ddc0ecff0e56a"}
Jul 13 17:31:49.109895 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:49.109806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hwf7p" event={"ID":"5e61016d-5fbf-4809-ab79-1115f7308201","Type":"ContainerStarted","Data":"21d7b3e4b0b997ec1f63ea9540841affafa93129c66fe18c397441c65ed0e666"}
Jul 13 17:31:49.129201 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:49.129106    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4stks" event={"ID":"59679176-562f-4d4f-9108-27f65f1efc4b","Type":"ContainerStarted","Data":"d3259fbc9155c11cdc1de6192e879012cb466ff8b8264db76387975bc1a41634"}
Jul 13 17:31:49.150450 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:49.150388    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7" event={"ID":"59b522db-1e47-4a2c-a485-a3d78792a661","Type":"ContainerStarted","Data":"7dfca7dbde74c3ac6536f114bb2360f86a64367140c7748efef3b910f75e10a3"}
Jul 13 17:31:49.159021 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:49.158967    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6" event={"ID":"0e86d56d-6153-46b0-b239-1d02235ce1e3","Type":"ContainerStarted","Data":"15bb91923f7ea52a72c003eb148291c01e6170715d390e6e0b5e2d3ecf214471"}
Jul 13 17:31:50.004204 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:50.004171    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:50.004698 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:50.004337    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:31:50.177362 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:50.177321    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal" event={"ID":"d20729b6d64007b4475ae9754086a553","Type":"ContainerStarted","Data":"1f184b3a5c437da68fb18f87d00dad85cabda56e2ee0a1d9181154752f2fcc14"}
Jul 13 17:31:50.191610 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:50.191512    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-223.ec2.internal" podStartSLOduration=4.191488666 podStartE2EDuration="4.191488666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:31:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:31:49.074286483 +0000 UTC m=+4.587461747" watchObservedRunningTime="2026-07-13 17:31:50.191488666 +0000 UTC m=+5.704663932"
Jul 13 17:31:50.646240 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:50.645242    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgk5b\" (UniqueName: \"kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b\") pod \"network-check-target-4bdcp\" (UID: \"890ecca9-2a93-47c0-bace-5c5b3d18a55e\") " pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:31:50.646240 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:50.645333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:50.646240 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:50.645381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs\") pod \"network-metrics-daemon-vzwcn\" (UID: \"b049232f-2f86-4a9a-aed5-5c294c59e33d\") " pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:50.646240 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:50.645517    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:31:50.646240 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:50.645595    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs podName:b049232f-2f86-4a9a-aed5-5c294c59e33d nodeName:}" failed. No retries permitted until 2026-07-13 17:31:54.645576864 +0000 UTC m=+10.158752114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs") pod "network-metrics-daemon-vzwcn" (UID: "b049232f-2f86-4a9a-aed5-5c294c59e33d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:31:50.646240 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:50.646029    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:31:50.646240 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:50.646048    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:31:50.646240 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:50.646061    2564 projected.go:196] Error preparing data for projected volume kube-api-access-kgk5b for pod openshift-network-diagnostics/network-check-target-4bdcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:31:50.646240 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:50.646109    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b podName:890ecca9-2a93-47c0-bace-5c5b3d18a55e nodeName:}" failed. No retries permitted until 2026-07-13 17:31:54.646092412 +0000 UTC m=+10.159267660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgk5b" (UniqueName: "kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b") pod "network-check-target-4bdcp" (UID: "890ecca9-2a93-47c0-bace-5c5b3d18a55e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:31:50.646240 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:50.646171    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:31:50.646240 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:50.646202    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret podName:25cdc609-cac2-4bf2-9410-a4f48e6f5094 nodeName:}" failed. No retries permitted until 2026-07-13 17:31:54.646192212 +0000 UTC m=+10.159367458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret") pod "global-pull-secret-syncer-s4xjg" (UID: "25cdc609-cac2-4bf2-9410-a4f48e6f5094") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:31:51.006130 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:51.006047    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:31:51.006600 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:51.006178    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:31:51.006600 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:51.006589    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:51.006713 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:51.006688    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:31:52.004051 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:52.004011    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:52.004230 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:52.004164    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:31:53.004576 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:53.004542    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:31:53.004576 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:53.004567    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:53.004976 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:53.004681    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:31:53.004976 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:53.004778    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:31:54.004319 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:54.004289    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:54.004499 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:54.004414    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:31:54.684213 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:54.684035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:54.684213 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:54.684190    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:31:54.684865 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:54.684228    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs\") pod \"network-metrics-daemon-vzwcn\" (UID: \"b049232f-2f86-4a9a-aed5-5c294c59e33d\") " pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:54.684865 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:54.684333    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret podName:25cdc609-cac2-4bf2-9410-a4f48e6f5094 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:02.684257321 +0000 UTC m=+18.197432577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret") pod "global-pull-secret-syncer-s4xjg" (UID: "25cdc609-cac2-4bf2-9410-a4f48e6f5094") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:31:54.684865 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:54.684358    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:31:54.684865 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:54.684398    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgk5b\" (UniqueName: \"kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b\") pod \"network-check-target-4bdcp\" (UID: \"890ecca9-2a93-47c0-bace-5c5b3d18a55e\") " pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:31:54.684865 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:54.684412    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs podName:b049232f-2f86-4a9a-aed5-5c294c59e33d nodeName:}" failed. No retries permitted until 2026-07-13 17:32:02.684395284 +0000 UTC m=+18.197570550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs") pod "network-metrics-daemon-vzwcn" (UID: "b049232f-2f86-4a9a-aed5-5c294c59e33d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:31:54.684865 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:54.684491    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:31:54.684865 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:54.684511    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:31:54.684865 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:54.684523    2564 projected.go:196] Error preparing data for projected volume kube-api-access-kgk5b for pod openshift-network-diagnostics/network-check-target-4bdcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:31:54.684865 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:54.684564    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b podName:890ecca9-2a93-47c0-bace-5c5b3d18a55e nodeName:}" failed. No retries permitted until 2026-07-13 17:32:02.684551066 +0000 UTC m=+18.197726332 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgk5b" (UniqueName: "kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b") pod "network-check-target-4bdcp" (UID: "890ecca9-2a93-47c0-bace-5c5b3d18a55e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:31:55.005888 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:55.005307    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:31:55.005888 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:55.005428    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:31:55.005888 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:55.005534    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:55.005888 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:55.005644    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:31:56.003705 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:56.003661    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:56.004141 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:56.003820    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:31:57.006168 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:57.005666    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:31:57.006168 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:57.005795    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:31:57.006990 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:57.006834    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:57.006990 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:57.006948    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:31:58.004007 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:58.003966    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:31:58.004182 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:58.004086    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:31:59.003635 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:59.003605    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:31:59.004025 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:59.003715    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:31:59.004025 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:31:59.003802    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:31:59.004025 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:31:59.003909    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:32:00.003953 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:00.003910    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:32:00.004455 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:00.004078    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:32:01.003994 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:01.003953    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:01.004476 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:01.004084    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:32:01.004476 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:01.004124    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:01.004476 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:01.004223    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:32:02.003664 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:02.003631    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:32:02.003868 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:02.003768    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:32:02.746680 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:02.746643    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgk5b\" (UniqueName: \"kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b\") pod \"network-check-target-4bdcp\" (UID: \"890ecca9-2a93-47c0-bace-5c5b3d18a55e\") " pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:02.746680 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:02.746686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:02.747133 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:02.746712    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs\") pod \"network-metrics-daemon-vzwcn\" (UID: \"b049232f-2f86-4a9a-aed5-5c294c59e33d\") " pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:32:02.747133 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:02.746795    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:32:02.747133 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:02.746811    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:32:02.747133 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:02.746821    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:32:02.747133 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:02.746840    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:32:02.747133 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:02.746847    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs podName:b049232f-2f86-4a9a-aed5-5c294c59e33d nodeName:}" failed. No retries permitted until 2026-07-13 17:32:18.7468333 +0000 UTC m=+34.260008542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs") pod "network-metrics-daemon-vzwcn" (UID: "b049232f-2f86-4a9a-aed5-5c294c59e33d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:32:02.747133 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:02.746851    2564 projected.go:196] Error preparing data for projected volume kube-api-access-kgk5b for pod openshift-network-diagnostics/network-check-target-4bdcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:32:02.747133 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:02.746874    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret podName:25cdc609-cac2-4bf2-9410-a4f48e6f5094 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:18.746855913 +0000 UTC m=+34.260031156 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret") pod "global-pull-secret-syncer-s4xjg" (UID: "25cdc609-cac2-4bf2-9410-a4f48e6f5094") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:32:02.747133 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:02.746894    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b podName:890ecca9-2a93-47c0-bace-5c5b3d18a55e nodeName:}" failed. No retries permitted until 2026-07-13 17:32:18.746884638 +0000 UTC m=+34.260059884 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgk5b" (UniqueName: "kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b") pod "network-check-target-4bdcp" (UID: "890ecca9-2a93-47c0-bace-5c5b3d18a55e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:32:03.004225 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:03.004193    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:03.004447 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:03.004335    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:32:03.004447 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:03.004389    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:03.004563 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:03.004512    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:32:04.004240 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:04.004205    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:32:04.004675 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:04.004350    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:32:05.005027 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:05.004987    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:05.005508 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:05.005103    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:32:05.005508 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:05.005157    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:05.005508 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:05.005303    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:32:06.004531 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:06.004496    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:32:06.004726 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:06.004628    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:32:07.004416 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.004390    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:07.004833 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.004422    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:07.004833 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:07.004529    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:32:07.004833 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:07.004625    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:32:07.217945 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.217668    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8t85k" event={"ID":"1b8b39d1-cf5d-4d5c-a386-1edd084e7e42","Type":"ContainerStarted","Data":"d67d2122cd4f147d91424c9573e681feaa416777cd3bd3d4a1be73e1f4caf5c3"}
Jul 13 17:32:07.219322 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.219234    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7gznh" event={"ID":"26261b52-74ca-405a-98cc-4cd807ec42f4","Type":"ContainerStarted","Data":"75cfb37545581f0fd286358fe3f5a5ad58164b20de351d33ac5d0d4578bf6f5e"}
Jul 13 17:32:07.221035 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.220996    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nx5qk" event={"ID":"e0b0c1eb-d696-4180-bfd9-f7d1d32dec80","Type":"ContainerStarted","Data":"12a9ee9d5e0ba61341d0d3dd8c8fbcd42e462ac4e57fbc6b482b3d6ddda89406"}
Jul 13 17:32:07.222847 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.222806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p58fk" event={"ID":"b8d7f308-9d05-4571-9072-9dadbdf3ccb4","Type":"ContainerStarted","Data":"0d0f46d49f86b7008d26271c6d61ba30796598ddebd9f3af92b3db65a6b5215e"}
Jul 13 17:32:07.225157 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.225113    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qrvn2" event={"ID":"f05dbea2-6cf8-47e0-861c-8045ec151d3c","Type":"ContainerStarted","Data":"e47608ba718d83e98062bb18c31d0ae66ed0089aad4d26a163f21aee4687e9da"}
Jul 13 17:32:07.227330 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.227306    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hwf7p" event={"ID":"5e61016d-5fbf-4809-ab79-1115f7308201","Type":"ContainerStarted","Data":"8cc8b99803c32e13bed395d118441779eef022b41fd3ecfb9c7ea5d857a614b1"}
Jul 13 17:32:07.230533 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.230346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7" event={"ID":"59b522db-1e47-4a2c-a485-a3d78792a661","Type":"ContainerStarted","Data":"b308490118d48fb5c8c762a65ceed5dd7c486b674cf5a1fa3d42c74099f23f2b"}
Jul 13 17:32:07.232340 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.232318    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6" event={"ID":"0e86d56d-6153-46b0-b239-1d02235ce1e3","Type":"ContainerStarted","Data":"a20f92dcdebcb3230dab880e8d208868327d6888758deee4a7a8b92135448897"}
Jul 13 17:32:07.233639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.233591    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8t85k" podStartSLOduration=3.4271139010000002 podStartE2EDuration="22.233537805s" totalImagesPullingTime="18.806423904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:07.233312192 +0000 UTC m=+22.746487454" watchObservedRunningTime="2026-07-13 17:32:07.233537805 +0000 UTC m=+22.746713070"
Jul 13 17:32:07.233888 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.233860    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-223.ec2.internal" podStartSLOduration=21.233852892 podStartE2EDuration="21.233852892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:31:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:31:50.192837842 +0000 UTC m=+5.706013108" watchObservedRunningTime="2026-07-13 17:32:07.233852892 +0000 UTC m=+22.747028158"
Jul 13 17:32:07.248628 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.248013    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nx5qk" podStartSLOduration=3.416411628 podStartE2EDuration="22.247990341s" totalImagesPullingTime="18.831578713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:07.247834581 +0000 UTC m=+22.761009874" watchObservedRunningTime="2026-07-13 17:32:07.247990341 +0000 UTC m=+22.761165606"
Jul 13 17:32:07.265102 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.265058    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qrvn2" podStartSLOduration=7.931815479 podStartE2EDuration="22.265040984s" totalImagesPullingTime="14.333225505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:07.264618332 +0000 UTC m=+22.777793615" watchObservedRunningTime="2026-07-13 17:32:07.265040984 +0000 UTC m=+22.778216248"
Jul 13 17:32:07.285002 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.284955    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hwf7p" podStartSLOduration=3.413326182 podStartE2EDuration="22.284937315s" totalImagesPullingTime="18.871611133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:07.284377653 +0000 UTC m=+22.797552922" watchObservedRunningTime="2026-07-13 17:32:07.284937315 +0000 UTC m=+22.798112576"
Jul 13 17:32:07.317798 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:07.317745    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7gznh" podStartSLOduration=3.492840279 podStartE2EDuration="22.317728616s" totalImagesPullingTime="18.824888337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:07.317543546 +0000 UTC m=+22.830718812" watchObservedRunningTime="2026-07-13 17:32:07.317728616 +0000 UTC m=+22.830903880"
Jul 13 17:32:08.004514 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:08.004430    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:32:08.005376 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:08.004584    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:32:08.235879 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:08.235845    2564 generic.go:356] "Generic (PLEG): container finished" podID="b8d7f308-9d05-4571-9072-9dadbdf3ccb4" containerID="0d0f46d49f86b7008d26271c6d61ba30796598ddebd9f3af92b3db65a6b5215e" exitCode=0
Jul 13 17:32:08.236055 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:08.235924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p58fk" event={"ID":"b8d7f308-9d05-4571-9072-9dadbdf3ccb4","Type":"ContainerDied","Data":"0d0f46d49f86b7008d26271c6d61ba30796598ddebd9f3af92b3db65a6b5215e"}
Jul 13 17:32:08.241731 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:08.241695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7" event={"ID":"59b522db-1e47-4a2c-a485-a3d78792a661","Type":"ContainerStarted","Data":"fe924d53f754f3831f9bb3da3701c32d2b47b27e759a3525b15fe5e6556a61d9"}
Jul 13 17:32:08.241861 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:08.241817    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7" event={"ID":"59b522db-1e47-4a2c-a485-a3d78792a661","Type":"ContainerStarted","Data":"62f612a6833da022b688dced18d2a568231d4355db266b727fb9ea338e183895"}
Jul 13 17:32:08.241913 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:08.241865    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7" event={"ID":"59b522db-1e47-4a2c-a485-a3d78792a661","Type":"ContainerStarted","Data":"863c5fd83ec2c231174178c6a644b213116e66872abc095aabed17621ed6b74a"}
Jul 13 17:32:08.241953 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:08.241910    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7" event={"ID":"59b522db-1e47-4a2c-a485-a3d78792a661","Type":"ContainerStarted","Data":"337b70a6cb7106540ff9d01f8b23fee68f64430860908ca03399e088821d51f9"}
Jul 13 17:32:08.241996 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:08.241958    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7" event={"ID":"59b522db-1e47-4a2c-a485-a3d78792a661","Type":"ContainerStarted","Data":"ab6fdc7eacd22123721066e181c72e58924230944af69ec0dfd64d0599d85f4b"}
Jul 13 17:32:08.502202 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:08.502174    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 17:32:08.980482 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:08.980360    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T17:32:08.502194413Z","UUID":"8b53cbaa-9bdc-4615-9d71-019dcf151f62","Handler":null,"Name":"","Endpoint":""}
Jul 13 17:32:08.982227 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:08.982200    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 17:32:08.982362 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:08.982252    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 17:32:09.004335 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:09.004299    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:09.004516 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:09.004315    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:09.004516 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:09.004423    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:32:09.004869 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:09.004523    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:32:09.246644 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:09.246407    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4stks" event={"ID":"59679176-562f-4d4f-9108-27f65f1efc4b","Type":"ContainerStarted","Data":"82a138682b36b16a411b7cb4bf339b3ea77e9c9c319d0aa4d8a787cf978b7a91"}
Jul 13 17:32:09.249147 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:09.249113    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6" event={"ID":"0e86d56d-6153-46b0-b239-1d02235ce1e3","Type":"ContainerStarted","Data":"3bc721ee5691227dc216c6212660a509703d5b8e9f34c4034ff10ba35a4d2f6c"}
Jul 13 17:32:09.260652 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:09.260599    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4stks" podStartSLOduration=5.439119554 podStartE2EDuration="24.260576596s" totalImagesPullingTime="18.821457042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:09.260238186 +0000 UTC m=+24.773413453" watchObservedRunningTime="2026-07-13 17:32:09.260576596 +0000 UTC m=+24.773751864"
Jul 13 17:32:10.003903 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:10.003632    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:32:10.004087 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:10.004035    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:32:10.254472 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:10.254385    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7" event={"ID":"59b522db-1e47-4a2c-a485-a3d78792a661","Type":"ContainerStarted","Data":"e9148919a6d8a46e326efc05f1d5729328b4e00b72e297e3e8c246e8e631c6a7"}
Jul 13 17:32:10.256380 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:10.256351    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6" event={"ID":"0e86d56d-6153-46b0-b239-1d02235ce1e3","Type":"ContainerStarted","Data":"18d551b116238341bc2eecab2a2a7d71dfdb9d8a39467f1e0d8cf29187ac3bc2"}
Jul 13 17:32:10.273797 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:10.273741    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9bhm6" podStartSLOduration=4.089980137 podStartE2EDuration="25.273712576s" totalImagesPullingTime="21.183732439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:31:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:10.273247475 +0000 UTC m=+25.786422740" watchObservedRunningTime="2026-07-13 17:32:10.273712576 +0000 UTC m=+25.786887841"
Jul 13 17:32:11.004627 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:11.004593    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:11.004822 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:11.004593    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:11.004822 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:11.004720    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:32:11.004822 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:11.004796    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:32:11.491042 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:11.491003    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qrvn2"
Jul 13 17:32:11.491773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:11.491703    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qrvn2"
Jul 13 17:32:12.003970 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:12.003936    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:32:12.004130 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:12.004062    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:32:12.260657 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:12.260563    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qrvn2"
Jul 13 17:32:12.261339 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:12.261321    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qrvn2"
Jul 13 17:32:13.004414 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:13.004380    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:13.004414 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:13.004421    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:13.004904 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:13.004502    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:32:13.004904 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:13.004617    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:32:13.266217 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:13.266110    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7" event={"ID":"59b522db-1e47-4a2c-a485-a3d78792a661","Type":"ContainerStarted","Data":"3d673e7603b26f9f2cc30319134c9a71bdc2044d1d8439b7c3e583475b9d3f9c"}
Jul 13 17:32:13.292065 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:13.292014    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7" podStartSLOduration=9.400222848 podStartE2EDuration="28.291998891s" totalImagesPullingTime="18.891776043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:13.291446096 +0000 UTC m=+28.804621361" watchObservedRunningTime="2026-07-13 17:32:13.291998891 +0000 UTC m=+28.805174155"
Jul 13 17:32:14.004212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:14.004174    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:32:14.004425 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:14.004304    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:32:14.270356 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:14.270260    2564 generic.go:356] "Generic (PLEG): container finished" podID="b8d7f308-9d05-4571-9072-9dadbdf3ccb4" containerID="1ea517cd05abe4b03266f26e027d41310e9e6a7fd1ccb829f57c26a3c2b3855c" exitCode=0
Jul 13 17:32:14.270356 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:14.270303    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p58fk" event={"ID":"b8d7f308-9d05-4571-9072-9dadbdf3ccb4","Type":"ContainerDied","Data":"1ea517cd05abe4b03266f26e027d41310e9e6a7fd1ccb829f57c26a3c2b3855c"}
Jul 13 17:32:14.271117 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:14.270407    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 13 17:32:14.271117 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:14.271072    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:32:14.272087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:14.271143    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:32:14.287148 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:14.287114    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:32:14.287315 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:14.287225    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:32:15.004357 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:15.004318    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:15.004539 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:15.004416    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:32:15.004539 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:15.004499    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:15.004660 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:15.004596    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:32:15.164770 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:15.164743    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4bdcp"]
Jul 13 17:32:15.167727 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:15.167641    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s4xjg"]
Jul 13 17:32:15.168279 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:15.168253    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vzwcn"]
Jul 13 17:32:15.168417 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:15.168398    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:32:15.168552 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:15.168524    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:32:15.274543 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:15.274227    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:15.274934 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:15.274555    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 13 17:32:15.274934 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:15.274555    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:15.274934 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:15.274250    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p58fk" event={"ID":"b8d7f308-9d05-4571-9072-9dadbdf3ccb4","Type":"ContainerStarted","Data":"7d69739f97edef1e5b3c96bcbaf38fbb6cfec4e33b2c276dd3161dd3718d2e86"}
Jul 13 17:32:15.274934 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:15.274639    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:32:15.275113 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:15.275043    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:32:16.278891 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:16.278862    2564 generic.go:356] "Generic (PLEG): container finished" podID="b8d7f308-9d05-4571-9072-9dadbdf3ccb4" containerID="7d69739f97edef1e5b3c96bcbaf38fbb6cfec4e33b2c276dd3161dd3718d2e86" exitCode=0
Jul 13 17:32:16.279343 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:16.278947    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p58fk" event={"ID":"b8d7f308-9d05-4571-9072-9dadbdf3ccb4","Type":"ContainerDied","Data":"7d69739f97edef1e5b3c96bcbaf38fbb6cfec4e33b2c276dd3161dd3718d2e86"}
Jul 13 17:32:16.279343 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:16.279054    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 13 17:32:17.003985 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:17.003943    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:17.004190 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:17.004073    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:32:17.004190 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:17.004093    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:32:17.004190 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:17.003963    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:17.004389 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:17.004190    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:32:17.004389 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:17.004263    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:32:17.125491 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:17.125454    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:32:18.285918 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:18.285883    2564 generic.go:356] "Generic (PLEG): container finished" podID="b8d7f308-9d05-4571-9072-9dadbdf3ccb4" containerID="cd563f504c114fb184887e9d904a9147f16b35345dd1505f6ca9b867c606ebad" exitCode=0
Jul 13 17:32:18.286710 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:18.285943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p58fk" event={"ID":"b8d7f308-9d05-4571-9072-9dadbdf3ccb4","Type":"ContainerDied","Data":"cd563f504c114fb184887e9d904a9147f16b35345dd1505f6ca9b867c606ebad"}
Jul 13 17:32:18.762876 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:18.762837    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgk5b\" (UniqueName: \"kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b\") pod \"network-check-target-4bdcp\" (UID: \"890ecca9-2a93-47c0-bace-5c5b3d18a55e\") " pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:18.763076 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:18.762899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:18.763076 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:18.762950    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs\") pod \"network-metrics-daemon-vzwcn\" (UID: \"b049232f-2f86-4a9a-aed5-5c294c59e33d\") " pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:32:18.763076 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:18.762989    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 17:32:18.763076 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:18.763012    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 17:32:18.763076 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:18.763022    2564 projected.go:196] Error preparing data for projected volume kube-api-access-kgk5b for pod openshift-network-diagnostics/network-check-target-4bdcp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:32:18.763076 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:18.763047    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:32:18.763076 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:18.763078    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b podName:890ecca9-2a93-47c0-bace-5c5b3d18a55e nodeName:}" failed. No retries permitted until 2026-07-13 17:32:50.763059452 +0000 UTC m=+66.276234709 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kgk5b" (UniqueName: "kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b") pod "network-check-target-4bdcp" (UID: "890ecca9-2a93-47c0-bace-5c5b3d18a55e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 17:32:18.763393 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:18.763102    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs podName:b049232f-2f86-4a9a-aed5-5c294c59e33d nodeName:}" failed. No retries permitted until 2026-07-13 17:32:50.763084593 +0000 UTC m=+66.276259842 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs") pod "network-metrics-daemon-vzwcn" (UID: "b049232f-2f86-4a9a-aed5-5c294c59e33d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 17:32:18.763393 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:18.763048    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 17:32:18.763393 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:18.763137    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret podName:25cdc609-cac2-4bf2-9410-a4f48e6f5094 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:50.76312769 +0000 UTC m=+66.276302937 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret") pod "global-pull-secret-syncer-s4xjg" (UID: "25cdc609-cac2-4bf2-9410-a4f48e6f5094") : object "kube-system"/"original-pull-secret" not registered
Jul 13 17:32:19.003746 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:19.003704    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:19.003746 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:19.003748    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:32:19.003967 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:19.003704    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:19.003967 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:19.003849    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4bdcp" podUID="890ecca9-2a93-47c0-bace-5c5b3d18a55e"
Jul 13 17:32:19.003967 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:19.003955    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s4xjg" podUID="25cdc609-cac2-4bf2-9410-a4f48e6f5094"
Jul 13 17:32:19.004123 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:19.004055    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzwcn" podUID="b049232f-2f86-4a9a-aed5-5c294c59e33d"
Jul 13 17:32:20.721771 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.721736    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-223.ec2.internal" event="NodeReady"
Jul 13 17:32:20.722357 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.721894    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 17:32:20.755385 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.755298    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8595949878-fcmz2"]
Jul 13 17:32:20.758821 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.758788    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.761084 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.761056    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 17:32:20.761230 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.761141    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 17:32:20.761230 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.761056    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k92hg\""
Jul 13 17:32:20.761374 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.761227    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 17:32:20.769472 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.769446    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 17:32:20.771793 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.771770    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vr8x9"]
Jul 13 17:32:20.775787 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.775765    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wnx5t"]
Jul 13 17:32:20.775895 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.775861    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:20.778391 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.778021    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-225kz\""
Jul 13 17:32:20.778391 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.778227    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 17:32:20.778391 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.778307    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 17:32:20.780459 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.780443    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8595949878-fcmz2"]
Jul 13 17:32:20.780555 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.780519    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wnx5t"
Jul 13 17:32:20.782792 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.782771    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 17:32:20.783116 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.782833    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dnkkg\""
Jul 13 17:32:20.783116 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.782883    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 17:32:20.783116 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.783004    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 17:32:20.785528 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.785496    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wnx5t"]
Jul 13 17:32:20.786150 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.786133    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vr8x9"]
Jul 13 17:32:20.877209 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.877173    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbl98\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-kube-api-access-gbl98\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.877427 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.877244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.877427 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.877293    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:20.877427 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.877317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnw5w\" (UniqueName: \"kubernetes.io/projected/a6d21c8d-0abf-4429-ac79-efa11aa43aec-kube-api-access-dnw5w\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:20.877427 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.877375    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/016bb14e-b960-4f80-9386-38229e9839f8-trusted-ca\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.877642 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.877444    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/016bb14e-b960-4f80-9386-38229e9839f8-image-registry-private-configuration\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.877642 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.877469    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-bound-sa-token\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.877642 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.877494    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c66a8af0-b527-42ae-b24e-fb6f1b1885ea-cert\") pod \"ingress-canary-wnx5t\" (UID: \"c66a8af0-b527-42ae-b24e-fb6f1b1885ea\") " pod="openshift-ingress-canary/ingress-canary-wnx5t"
Jul 13 17:32:20.877642 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.877549    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/016bb14e-b960-4f80-9386-38229e9839f8-installation-pull-secrets\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.877642 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.877582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/016bb14e-b960-4f80-9386-38229e9839f8-ca-trust-extracted\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.877642 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.877607    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6d21c8d-0abf-4429-ac79-efa11aa43aec-config-volume\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:20.877642 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.877634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9cnb\" (UniqueName: \"kubernetes.io/projected/c66a8af0-b527-42ae-b24e-fb6f1b1885ea-kube-api-access-q9cnb\") pod \"ingress-canary-wnx5t\" (UID: \"c66a8af0-b527-42ae-b24e-fb6f1b1885ea\") " pod="openshift-ingress-canary/ingress-canary-wnx5t"
Jul 13 17:32:20.877985 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.877662    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/016bb14e-b960-4f80-9386-38229e9839f8-registry-certificates\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.877985 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.877689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6d21c8d-0abf-4429-ac79-efa11aa43aec-tmp-dir\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:20.914781 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.914747    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qrvn2_f05dbea2-6cf8-47e0-861c-8045ec151d3c/konnectivity-agent/0.log" limit=1024
Jul 13 17:32:20.978726 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.978687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/016bb14e-b960-4f80-9386-38229e9839f8-image-registry-private-configuration\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.978916 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.978732    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-bound-sa-token\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.978916 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.978757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c66a8af0-b527-42ae-b24e-fb6f1b1885ea-cert\") pod \"ingress-canary-wnx5t\" (UID: \"c66a8af0-b527-42ae-b24e-fb6f1b1885ea\") " pod="openshift-ingress-canary/ingress-canary-wnx5t"
Jul 13 17:32:20.978916 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.978876    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/016bb14e-b960-4f80-9386-38229e9839f8-installation-pull-secrets\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.979081 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.978935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/016bb14e-b960-4f80-9386-38229e9839f8-ca-trust-extracted\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.979081 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.978963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6d21c8d-0abf-4429-ac79-efa11aa43aec-config-volume\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:20.979081 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.978991    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9cnb\" (UniqueName: \"kubernetes.io/projected/c66a8af0-b527-42ae-b24e-fb6f1b1885ea-kube-api-access-q9cnb\") pod \"ingress-canary-wnx5t\" (UID: \"c66a8af0-b527-42ae-b24e-fb6f1b1885ea\") " pod="openshift-ingress-canary/ingress-canary-wnx5t"
Jul 13 17:32:20.979081 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.979019    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/016bb14e-b960-4f80-9386-38229e9839f8-registry-certificates\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.979081 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.979045    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6d21c8d-0abf-4429-ac79-efa11aa43aec-tmp-dir\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:20.979081 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.979075    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbl98\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-kube-api-access-gbl98\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.979350 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.979110    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.979350 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.979141    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:20.979350 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.979160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnw5w\" (UniqueName: \"kubernetes.io/projected/a6d21c8d-0abf-4429-ac79-efa11aa43aec-kube-api-access-dnw5w\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:20.979350 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.979182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/016bb14e-b960-4f80-9386-38229e9839f8-trusted-ca\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.980325 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.979545    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6d21c8d-0abf-4429-ac79-efa11aa43aec-config-volume\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:20.980325 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:20.979631    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:32:20.980325 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:20.979703    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls podName:a6d21c8d-0abf-4429-ac79-efa11aa43aec nodeName:}" failed. No retries permitted until 2026-07-13 17:32:21.479685178 +0000 UTC m=+36.992860431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls") pod "dns-default-vr8x9" (UID: "a6d21c8d-0abf-4429-ac79-efa11aa43aec") : secret "dns-default-metrics-tls" not found
Jul 13 17:32:20.980325 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.979816    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/016bb14e-b960-4f80-9386-38229e9839f8-ca-trust-extracted\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.980325 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:20.979900    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:32:20.980325 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:20.979914    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8595949878-fcmz2: secret "image-registry-tls" not found
Jul 13 17:32:20.980325 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:20.979969    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls podName:016bb14e-b960-4f80-9386-38229e9839f8 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:21.47995351 +0000 UTC m=+36.993128758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls") pod "image-registry-8595949878-fcmz2" (UID: "016bb14e-b960-4f80-9386-38229e9839f8") : secret "image-registry-tls" not found
Jul 13 17:32:20.980325 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.980258    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/016bb14e-b960-4f80-9386-38229e9839f8-trusted-ca\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.980325 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.980264    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6d21c8d-0abf-4429-ac79-efa11aa43aec-tmp-dir\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:20.980325 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.980304    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/016bb14e-b960-4f80-9386-38229e9839f8-registry-certificates\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.983931 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.983906    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/016bb14e-b960-4f80-9386-38229e9839f8-installation-pull-secrets\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.984052 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.983906    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/016bb14e-b960-4f80-9386-38229e9839f8-image-registry-private-configuration\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.984376 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.984357    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c66a8af0-b527-42ae-b24e-fb6f1b1885ea-cert\") pod \"ingress-canary-wnx5t\" (UID: \"c66a8af0-b527-42ae-b24e-fb6f1b1885ea\") " pod="openshift-ingress-canary/ingress-canary-wnx5t"
Jul 13 17:32:20.987498 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.987475    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-bound-sa-token\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:20.988313 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.988289    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9cnb\" (UniqueName: \"kubernetes.io/projected/c66a8af0-b527-42ae-b24e-fb6f1b1885ea-kube-api-access-q9cnb\") pod \"ingress-canary-wnx5t\" (UID: \"c66a8af0-b527-42ae-b24e-fb6f1b1885ea\") " pod="openshift-ingress-canary/ingress-canary-wnx5t"
Jul 13 17:32:20.989198 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.989177    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnw5w\" (UniqueName: \"kubernetes.io/projected/a6d21c8d-0abf-4429-ac79-efa11aa43aec-kube-api-access-dnw5w\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:20.989595 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:20.989578    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbl98\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-kube-api-access-gbl98\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:21.004597 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:21.004561    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:21.004755 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:21.004569    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:32:21.004755 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:21.004695    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:21.007030 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:21.006952    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 17:32:21.007030 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:21.006970    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 17:32:21.007030 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:21.007002    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 17:32:21.007265 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:21.006971    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vn7td\""
Jul 13 17:32:21.007265 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:21.006977    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 17:32:21.007384 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:21.007342    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4jvwf\""
Jul 13 17:32:21.073017 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:21.072976    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qrvn2_f05dbea2-6cf8-47e0-861c-8045ec151d3c/konnectivity-agent/0.log" limit=1024
Jul 13 17:32:21.093337 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:21.093310    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wnx5t"
Jul 13 17:32:21.235889 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:21.235668    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wnx5t"]
Jul 13 17:32:21.483835 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:21.483790    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:21.484030 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:21.483849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:21.484030 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:21.483959    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:32:21.484030 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:21.483965    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:32:21.484030 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:21.483986    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8595949878-fcmz2: secret "image-registry-tls" not found
Jul 13 17:32:21.484030 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:21.484024    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls podName:a6d21c8d-0abf-4429-ac79-efa11aa43aec nodeName:}" failed. No retries permitted until 2026-07-13 17:32:22.484006553 +0000 UTC m=+37.997181818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls") pod "dns-default-vr8x9" (UID: "a6d21c8d-0abf-4429-ac79-efa11aa43aec") : secret "dns-default-metrics-tls" not found
Jul 13 17:32:21.484230 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:21.484044    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls podName:016bb14e-b960-4f80-9386-38229e9839f8 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:22.484033888 +0000 UTC m=+37.997209136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls") pod "image-registry-8595949878-fcmz2" (UID: "016bb14e-b960-4f80-9386-38229e9839f8") : secret "image-registry-tls" not found
Jul 13 17:32:22.492761 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:22.492722    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:22.493193 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:22.492775    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:22.493193 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:22.492889    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:32:22.493193 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:22.492908    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8595949878-fcmz2: secret "image-registry-tls" not found
Jul 13 17:32:22.493193 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:22.492920    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:32:22.493193 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:22.492962    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls podName:016bb14e-b960-4f80-9386-38229e9839f8 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:24.492947475 +0000 UTC m=+40.006122721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls") pod "image-registry-8595949878-fcmz2" (UID: "016bb14e-b960-4f80-9386-38229e9839f8") : secret "image-registry-tls" not found
Jul 13 17:32:22.493193 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:22.492974    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls podName:a6d21c8d-0abf-4429-ac79-efa11aa43aec nodeName:}" failed. No retries permitted until 2026-07-13 17:32:24.492968493 +0000 UTC m=+40.006143735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls") pod "dns-default-vr8x9" (UID: "a6d21c8d-0abf-4429-ac79-efa11aa43aec") : secret "dns-default-metrics-tls" not found
Jul 13 17:32:22.638666 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:32:22.638634    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc66a8af0_b527_42ae_b24e_fb6f1b1885ea.slice/crio-2df9bc9fce37c6435598ba3cfa24812ecdc8c9f0670f78bf3578706495376ff3 WatchSource:0}: Error finding container 2df9bc9fce37c6435598ba3cfa24812ecdc8c9f0670f78bf3578706495376ff3: Status 404 returned error can't find the container with id 2df9bc9fce37c6435598ba3cfa24812ecdc8c9f0670f78bf3578706495376ff3
Jul 13 17:32:23.301749 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:23.301708    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wnx5t" event={"ID":"c66a8af0-b527-42ae-b24e-fb6f1b1885ea","Type":"ContainerStarted","Data":"2df9bc9fce37c6435598ba3cfa24812ecdc8c9f0670f78bf3578706495376ff3"}
Jul 13 17:32:23.304949 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:23.304918    2564 generic.go:356] "Generic (PLEG): container finished" podID="b8d7f308-9d05-4571-9072-9dadbdf3ccb4" containerID="4a533ac7aa8e1921646e2014f082e08fd78afcd8de7e034fb1d8834c934daef5" exitCode=0
Jul 13 17:32:23.305107 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:23.304957    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p58fk" event={"ID":"b8d7f308-9d05-4571-9072-9dadbdf3ccb4","Type":"ContainerDied","Data":"4a533ac7aa8e1921646e2014f082e08fd78afcd8de7e034fb1d8834c934daef5"}
Jul 13 17:32:24.311718 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:24.311453    2564 generic.go:356] "Generic (PLEG): container finished" podID="b8d7f308-9d05-4571-9072-9dadbdf3ccb4" containerID="9be3dc503ed2b4d6a9603c25e7fc5d04b52210f2b350fa2f9c47151a14a1ec1e" exitCode=0
Jul 13 17:32:24.311718 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:24.311525    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p58fk" event={"ID":"b8d7f308-9d05-4571-9072-9dadbdf3ccb4","Type":"ContainerDied","Data":"9be3dc503ed2b4d6a9603c25e7fc5d04b52210f2b350fa2f9c47151a14a1ec1e"}
Jul 13 17:32:24.508967 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:24.508928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:24.508967 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:24.508970    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:24.509185 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:24.509084    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:32:24.509185 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:24.509085    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:32:24.509185 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:24.509107    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8595949878-fcmz2: secret "image-registry-tls" not found
Jul 13 17:32:24.509185 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:24.509134    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls podName:a6d21c8d-0abf-4429-ac79-efa11aa43aec nodeName:}" failed. No retries permitted until 2026-07-13 17:32:28.509121798 +0000 UTC m=+44.022297041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls") pod "dns-default-vr8x9" (UID: "a6d21c8d-0abf-4429-ac79-efa11aa43aec") : secret "dns-default-metrics-tls" not found
Jul 13 17:32:24.509185 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:24.509167    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls podName:016bb14e-b960-4f80-9386-38229e9839f8 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:28.509154036 +0000 UTC m=+44.022329279 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls") pod "image-registry-8595949878-fcmz2" (UID: "016bb14e-b960-4f80-9386-38229e9839f8") : secret "image-registry-tls" not found
Jul 13 17:32:25.318889 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:25.318853    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p58fk" event={"ID":"b8d7f308-9d05-4571-9072-9dadbdf3ccb4","Type":"ContainerStarted","Data":"569ce4670e826825d1ae241aab758a72b406a03fdffd6d3138495a637c36b97f"}
Jul 13 17:32:25.344314 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:25.344234    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p58fk" podStartSLOduration=9.945401084 podStartE2EDuration="40.344212068s" totalImagesPullingTime="30.398810984s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:31:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:25.343761093 +0000 UTC m=+40.856936359" watchObservedRunningTime="2026-07-13 17:32:25.344212068 +0000 UTC m=+40.857387337"
Jul 13 17:32:26.323126 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:26.323095    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wnx5t" event={"ID":"c66a8af0-b527-42ae-b24e-fb6f1b1885ea","Type":"ContainerStarted","Data":"fa6a257e7978e79cddcc21b1c9f8133b2c6491f51fed601e62d97b427a6b8880"}
Jul 13 17:32:26.338403 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:26.338352    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wnx5t" podStartSLOduration=2.963503969 podStartE2EDuration="6.338333061s" totalImagesPullingTime="3.374829092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:26.337130298 +0000 UTC m=+41.850305585" watchObservedRunningTime="2026-07-13 17:32:26.338333061 +0000 UTC m=+41.851508326"
Jul 13 17:32:28.543322 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:28.543265    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:28.543322 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:28.543324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:28.543741 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:28.543442    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:32:28.543741 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:28.543464    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8595949878-fcmz2: secret "image-registry-tls" not found
Jul 13 17:32:28.543741 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:28.543484    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:32:28.543741 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:28.543519    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls podName:016bb14e-b960-4f80-9386-38229e9839f8 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:36.543504146 +0000 UTC m=+52.056679388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls") pod "image-registry-8595949878-fcmz2" (UID: "016bb14e-b960-4f80-9386-38229e9839f8") : secret "image-registry-tls" not found
Jul 13 17:32:28.543741 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:28.543532    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls podName:a6d21c8d-0abf-4429-ac79-efa11aa43aec nodeName:}" failed. No retries permitted until 2026-07-13 17:32:36.543526568 +0000 UTC m=+52.056701811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls") pod "dns-default-vr8x9" (UID: "a6d21c8d-0abf-4429-ac79-efa11aa43aec") : secret "dns-default-metrics-tls" not found
Jul 13 17:32:29.379006 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.378968    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-gdgjm"]
Jul 13 17:32:29.421290 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.421244    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fm4k8"]
Jul 13 17:32:29.421442 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.421365    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gdgjm"
Jul 13 17:32:29.425809 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.425778    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9xh9s\""
Jul 13 17:32:29.439177 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.439146    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-gdgjm"]
Jul 13 17:32:29.439349 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.439189    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj"]
Jul 13 17:32:29.439349 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.439257    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fm4k8"
Jul 13 17:32:29.441383 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.441364    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 13 17:32:29.441492 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.441365    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:32:29.441492 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.441425    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gl88w\""
Jul 13 17:32:29.455343 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.455316    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"]
Jul 13 17:32:29.455497 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.455425    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj"
Jul 13 17:32:29.457976 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.457942    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 13 17:32:29.458108 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.458008    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:32:29.458108 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.458062    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dzvgd\""
Jul 13 17:32:29.458108 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.458064    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 13 17:32:29.458309 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.458103    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 13 17:32:29.469427 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.469399    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fm4k8"]
Jul 13 17:32:29.469427 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.469432    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"]
Jul 13 17:32:29.469638 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.469449    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj"]
Jul 13 17:32:29.469638 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.469537    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"
Jul 13 17:32:29.471518 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.471495    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:32:29.471613 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.471601    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 13 17:32:29.471723 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.471707    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 13 17:32:29.471757 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.471744    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-97lnd\""
Jul 13 17:32:29.480161 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.480139    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf"]
Jul 13 17:32:29.495501 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.495468    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-8878b"]
Jul 13 17:32:29.495633 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.495603    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf"
Jul 13 17:32:29.497771 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.497747    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 13 17:32:29.497906 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.497775    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:32:29.497906 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.497824    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 13 17:32:29.497906 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.497758    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 13 17:32:29.497906 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.497853    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-kmvkd\""
Jul 13 17:32:29.509669 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.509638    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"]
Jul 13 17:32:29.509812 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.509773    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:29.512192 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.512165    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:32:29.512441 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.512176    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 13 17:32:29.512539 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.512480    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qq8gk\""
Jul 13 17:32:29.512539 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.512191    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 13 17:32:29.512639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.512232    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 13 17:32:29.516783 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.516760    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 13 17:32:29.531644 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.531612    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-s57lt"]
Jul 13 17:32:29.531785 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.531727    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:32:29.534381 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.534354    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 17:32:29.534545 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.534397    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 13 17:32:29.535908 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.535544    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 17:32:29.536080 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.535966    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 13 17:32:29.536080 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.535970    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qdx42\""
Jul 13 17:32:29.551860 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.551829    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62d8c92a-b95e-4cb5-ba78-83f4e808eb65-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-brczj\" (UID: \"62d8c92a-b95e-4cb5-ba78-83f4e808eb65\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj"
Jul 13 17:32:29.552210 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.551864    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw8n7\" (UniqueName: \"kubernetes.io/projected/62d8c92a-b95e-4cb5-ba78-83f4e808eb65-kube-api-access-jw8n7\") pod \"kube-storage-version-migrator-operator-799cb7f958-brczj\" (UID: \"62d8c92a-b95e-4cb5-ba78-83f4e808eb65\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj"
Jul 13 17:32:29.552210 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.551888    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsznv\" (UniqueName: \"kubernetes.io/projected/248c7fa4-25fb-43d6-87af-7a563810a23c-kube-api-access-qsznv\") pod \"network-check-source-869dcfcdcd-gdgjm\" (UID: \"248c7fa4-25fb-43d6-87af-7a563810a23c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gdgjm"
Jul 13 17:32:29.552210 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.551991    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k5r7\" (UniqueName: \"kubernetes.io/projected/bd6391f8-ce94-4677-92d6-047514b9479f-kube-api-access-6k5r7\") pod \"volume-data-source-validator-78495597f6-fm4k8\" (UID: \"bd6391f8-ce94-4677-92d6-047514b9479f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fm4k8"
Jul 13 17:32:29.552210 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.552055    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62d8c92a-b95e-4cb5-ba78-83f4e808eb65-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-brczj\" (UID: \"62d8c92a-b95e-4cb5-ba78-83f4e808eb65\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj"
Jul 13 17:32:29.553995 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.553973    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf"]
Jul 13 17:32:29.554042 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.554004    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-8878b"]
Jul 13 17:32:29.554042 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.554018    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"]
Jul 13 17:32:29.554042 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.554031    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-s57lt"]
Jul 13 17:32:29.554123 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.554056    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.555966 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.555936    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 13 17:32:29.555966 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.555967    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4fhgj\""
Jul 13 17:32:29.556215 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.556169    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 17:32:29.556374 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.556359    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 13 17:32:29.556441 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.556383    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 17:32:29.560190 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.560147    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 13 17:32:29.584011 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.583968    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-75c8cd656-p548p"]
Jul 13 17:32:29.609935 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.609894    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75c8cd656-p548p"]
Jul 13 17:32:29.610070 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.610000    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:29.612400 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.612375    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 13 17:32:29.612620 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.612482    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 13 17:32:29.612779 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.612723    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rlnrv\""
Jul 13 17:32:29.612779 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.612725    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 17:32:29.612779 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.612736    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 13 17:32:29.612929 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.612828    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 13 17:32:29.612929 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.612875    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 17:32:29.652824 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.652729    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsznv\" (UniqueName: \"kubernetes.io/projected/248c7fa4-25fb-43d6-87af-7a563810a23c-kube-api-access-qsznv\") pod \"network-check-source-869dcfcdcd-gdgjm\" (UID: \"248c7fa4-25fb-43d6-87af-7a563810a23c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gdgjm"
Jul 13 17:32:29.652824 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.652771    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/329cf01d-c819-4c38-b6d4-7d071e9c0b3f-config\") pod \"service-ca-operator-7695fc6c8c-5v4vf\" (UID: \"329cf01d-c819-4c38-b6d4-7d071e9c0b3f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf"
Jul 13 17:32:29.653014 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.652830    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szrbl\" (UniqueName: \"kubernetes.io/projected/6f849f14-833f-410f-91c5-5443acaf27ee-kube-api-access-szrbl\") pod \"cluster-samples-operator-65db858894-9mv9z\" (UID: \"6f849f14-833f-410f-91c5-5443acaf27ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"
Jul 13 17:32:29.653014 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.652873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62d8c92a-b95e-4cb5-ba78-83f4e808eb65-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-brczj\" (UID: \"62d8c92a-b95e-4cb5-ba78-83f4e808eb65\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj"
Jul 13 17:32:29.653014 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.652896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw8n7\" (UniqueName: \"kubernetes.io/projected/62d8c92a-b95e-4cb5-ba78-83f4e808eb65-kube-api-access-jw8n7\") pod \"kube-storage-version-migrator-operator-799cb7f958-brczj\" (UID: \"62d8c92a-b95e-4cb5-ba78-83f4e808eb65\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj"
Jul 13 17:32:29.653014 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.652978    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpxxk\" (UniqueName: \"kubernetes.io/projected/111b636e-36d8-4c99-ac23-631505961170-kube-api-access-rpxxk\") pod \"console-operator-7866497494-8878b\" (UID: \"111b636e-36d8-4c99-ac23-631505961170\") " pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:29.653152 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653020    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/111b636e-36d8-4c99-ac23-631505961170-trusted-ca\") pod \"console-operator-7866497494-8878b\" (UID: \"111b636e-36d8-4c99-ac23-631505961170\") " pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:29.653152 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/195b11af-642d-4fef-87c1-dfc75d1cf13a-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-fgtjc\" (UID: \"195b11af-642d-4fef-87c1-dfc75d1cf13a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:32:29.653152 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fgtjc\" (UID: \"195b11af-642d-4fef-87c1-dfc75d1cf13a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:32:29.653152 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653120    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/111b636e-36d8-4c99-ac23-631505961170-config\") pod \"console-operator-7866497494-8878b\" (UID: \"111b636e-36d8-4c99-ac23-631505961170\") " pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:29.653301 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89jv7\" (UniqueName: \"kubernetes.io/projected/1d2776c4-1aa1-4631-840a-8dbf875b62a8-kube-api-access-89jv7\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.653301 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1d2776c4-1aa1-4631-840a-8dbf875b62a8-snapshots\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.653381 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2776c4-1aa1-4631-840a-8dbf875b62a8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.653410 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653379    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9mv9z\" (UID: \"6f849f14-833f-410f-91c5-5443acaf27ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"
Jul 13 17:32:29.653447 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653421    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k5r7\" (UniqueName: \"kubernetes.io/projected/bd6391f8-ce94-4677-92d6-047514b9479f-kube-api-access-6k5r7\") pod \"volume-data-source-validator-78495597f6-fm4k8\" (UID: \"bd6391f8-ce94-4677-92d6-047514b9479f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fm4k8"
Jul 13 17:32:29.653485 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653447    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2776c4-1aa1-4631-840a-8dbf875b62a8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.653485 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653475    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d2776c4-1aa1-4631-840a-8dbf875b62a8-serving-cert\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.653572 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653502    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d2776c4-1aa1-4631-840a-8dbf875b62a8-tmp\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.653572 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653537    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp9pj\" (UniqueName: \"kubernetes.io/projected/329cf01d-c819-4c38-b6d4-7d071e9c0b3f-kube-api-access-jp9pj\") pod \"service-ca-operator-7695fc6c8c-5v4vf\" (UID: \"329cf01d-c819-4c38-b6d4-7d071e9c0b3f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf"
Jul 13 17:32:29.653572 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653554    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/111b636e-36d8-4c99-ac23-631505961170-serving-cert\") pod \"console-operator-7866497494-8878b\" (UID: \"111b636e-36d8-4c99-ac23-631505961170\") " pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:29.653702 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62d8c92a-b95e-4cb5-ba78-83f4e808eb65-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-brczj\" (UID: \"62d8c92a-b95e-4cb5-ba78-83f4e808eb65\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj"
Jul 13 17:32:29.653702 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653599    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/329cf01d-c819-4c38-b6d4-7d071e9c0b3f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-5v4vf\" (UID: \"329cf01d-c819-4c38-b6d4-7d071e9c0b3f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf"
Jul 13 17:32:29.653702 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.653615    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4mw5\" (UniqueName: \"kubernetes.io/projected/195b11af-642d-4fef-87c1-dfc75d1cf13a-kube-api-access-w4mw5\") pod \"cluster-monitoring-operator-5f7f494dd4-fgtjc\" (UID: \"195b11af-642d-4fef-87c1-dfc75d1cf13a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:32:29.654106 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.654084    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62d8c92a-b95e-4cb5-ba78-83f4e808eb65-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-brczj\" (UID: \"62d8c92a-b95e-4cb5-ba78-83f4e808eb65\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj"
Jul 13 17:32:29.657049 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.657031    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62d8c92a-b95e-4cb5-ba78-83f4e808eb65-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-brczj\" (UID: \"62d8c92a-b95e-4cb5-ba78-83f4e808eb65\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj"
Jul 13 17:32:29.660806 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.660777    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw8n7\" (UniqueName: \"kubernetes.io/projected/62d8c92a-b95e-4cb5-ba78-83f4e808eb65-kube-api-access-jw8n7\") pod \"kube-storage-version-migrator-operator-799cb7f958-brczj\" (UID: \"62d8c92a-b95e-4cb5-ba78-83f4e808eb65\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj"
Jul 13 17:32:29.660935 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.660868    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsznv\" (UniqueName: \"kubernetes.io/projected/248c7fa4-25fb-43d6-87af-7a563810a23c-kube-api-access-qsznv\") pod \"network-check-source-869dcfcdcd-gdgjm\" (UID: \"248c7fa4-25fb-43d6-87af-7a563810a23c\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gdgjm"
Jul 13 17:32:29.661566 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.661541    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k5r7\" (UniqueName: \"kubernetes.io/projected/bd6391f8-ce94-4677-92d6-047514b9479f-kube-api-access-6k5r7\") pod \"volume-data-source-validator-78495597f6-fm4k8\" (UID: \"bd6391f8-ce94-4677-92d6-047514b9479f\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fm4k8"
Jul 13 17:32:29.733399 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.733357    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gdgjm"
Jul 13 17:32:29.747578 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.747548    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fm4k8"
Jul 13 17:32:29.754355 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754318    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2776c4-1aa1-4631-840a-8dbf875b62a8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.754480 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754361    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9mv9z\" (UID: \"6f849f14-833f-410f-91c5-5443acaf27ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"
Jul 13 17:32:29.754480 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjldr\" (UniqueName: \"kubernetes.io/projected/4c7a9e1c-535f-4468-a0cb-68454f647ea3-kube-api-access-xjldr\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:29.754480 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754427    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2776c4-1aa1-4631-840a-8dbf875b62a8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.754480 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d2776c4-1aa1-4631-840a-8dbf875b62a8-serving-cert\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.754696 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754486    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d2776c4-1aa1-4631-840a-8dbf875b62a8-tmp\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.754696 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:29.754490    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 17:32:29.754696 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp9pj\" (UniqueName: \"kubernetes.io/projected/329cf01d-c819-4c38-b6d4-7d071e9c0b3f-kube-api-access-jp9pj\") pod \"service-ca-operator-7695fc6c8c-5v4vf\" (UID: \"329cf01d-c819-4c38-b6d4-7d071e9c0b3f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf"
Jul 13 17:32:29.754696 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/111b636e-36d8-4c99-ac23-631505961170-serving-cert\") pod \"console-operator-7866497494-8878b\" (UID: \"111b636e-36d8-4c99-ac23-631505961170\") " pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:29.754696 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:29.754572    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls podName:6f849f14-833f-410f-91c5-5443acaf27ee nodeName:}" failed. No retries permitted until 2026-07-13 17:32:30.254552596 +0000 UTC m=+45.767727846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls") pod "cluster-samples-operator-65db858894-9mv9z" (UID: "6f849f14-833f-410f-91c5-5443acaf27ee") : secret "samples-operator-tls" not found
Jul 13 17:32:29.754696 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754600    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/329cf01d-c819-4c38-b6d4-7d071e9c0b3f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-5v4vf\" (UID: \"329cf01d-c819-4c38-b6d4-7d071e9c0b3f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf"
Jul 13 17:32:29.754696 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754633    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4mw5\" (UniqueName: \"kubernetes.io/projected/195b11af-642d-4fef-87c1-dfc75d1cf13a-kube-api-access-w4mw5\") pod \"cluster-monitoring-operator-5f7f494dd4-fgtjc\" (UID: \"195b11af-642d-4fef-87c1-dfc75d1cf13a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:32:29.754696 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/329cf01d-c819-4c38-b6d4-7d071e9c0b3f-config\") pod \"service-ca-operator-7695fc6c8c-5v4vf\" (UID: \"329cf01d-c819-4c38-b6d4-7d071e9c0b3f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf"
Jul 13 17:32:29.755457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754745    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-stats-auth\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:29.755457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754776    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szrbl\" (UniqueName: \"kubernetes.io/projected/6f849f14-833f-410f-91c5-5443acaf27ee-kube-api-access-szrbl\") pod \"cluster-samples-operator-65db858894-9mv9z\" (UID: \"6f849f14-833f-410f-91c5-5443acaf27ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"
Jul 13 17:32:29.755457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754822    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-default-certificate\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:29.755457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxxk\" (UniqueName: \"kubernetes.io/projected/111b636e-36d8-4c99-ac23-631505961170-kube-api-access-rpxxk\") pod \"console-operator-7866497494-8878b\" (UID: \"111b636e-36d8-4c99-ac23-631505961170\") " pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:29.755457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754881    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/111b636e-36d8-4c99-ac23-631505961170-trusted-ca\") pod \"console-operator-7866497494-8878b\" (UID: \"111b636e-36d8-4c99-ac23-631505961170\") " pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:29.755457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754920    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/195b11af-642d-4fef-87c1-dfc75d1cf13a-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-fgtjc\" (UID: \"195b11af-642d-4fef-87c1-dfc75d1cf13a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:32:29.755457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754947    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fgtjc\" (UID: \"195b11af-642d-4fef-87c1-dfc75d1cf13a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:32:29.755457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/111b636e-36d8-4c99-ac23-631505961170-config\") pod \"console-operator-7866497494-8878b\" (UID: \"111b636e-36d8-4c99-ac23-631505961170\") " pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:29.755457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2776c4-1aa1-4631-840a-8dbf875b62a8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.755457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.754998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89jv7\" (UniqueName: \"kubernetes.io/projected/1d2776c4-1aa1-4631-840a-8dbf875b62a8-kube-api-access-89jv7\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.755457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.755022    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:29.755457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.755058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1d2776c4-1aa1-4631-840a-8dbf875b62a8-snapshots\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.755457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.755083    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:29.755457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.755214    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d2776c4-1aa1-4631-840a-8dbf875b62a8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.755457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.755265    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d2776c4-1aa1-4631-840a-8dbf875b62a8-tmp\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.756073 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:29.755621    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 17:32:29.756073 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:29.755683    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls podName:195b11af-642d-4fef-87c1-dfc75d1cf13a nodeName:}" failed. No retries permitted until 2026-07-13 17:32:30.255666453 +0000 UTC m=+45.768841711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fgtjc" (UID: "195b11af-642d-4fef-87c1-dfc75d1cf13a") : secret "cluster-monitoring-operator-tls" not found
Jul 13 17:32:29.756073 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.755999    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1d2776c4-1aa1-4631-840a-8dbf875b62a8-snapshots\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.756219 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.756180    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/111b636e-36d8-4c99-ac23-631505961170-config\") pod \"console-operator-7866497494-8878b\" (UID: \"111b636e-36d8-4c99-ac23-631505961170\") " pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:29.756303 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.756219    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/111b636e-36d8-4c99-ac23-631505961170-trusted-ca\") pod \"console-operator-7866497494-8878b\" (UID: \"111b636e-36d8-4c99-ac23-631505961170\") " pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:29.756524 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.756498    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/195b11af-642d-4fef-87c1-dfc75d1cf13a-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-fgtjc\" (UID: \"195b11af-642d-4fef-87c1-dfc75d1cf13a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:32:29.756782 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.756757    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/329cf01d-c819-4c38-b6d4-7d071e9c0b3f-config\") pod \"service-ca-operator-7695fc6c8c-5v4vf\" (UID: \"329cf01d-c819-4c38-b6d4-7d071e9c0b3f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf"
Jul 13 17:32:29.757283 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.757248    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/111b636e-36d8-4c99-ac23-631505961170-serving-cert\") pod \"console-operator-7866497494-8878b\" (UID: \"111b636e-36d8-4c99-ac23-631505961170\") " pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:29.758348 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.758318    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/329cf01d-c819-4c38-b6d4-7d071e9c0b3f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-5v4vf\" (UID: \"329cf01d-c819-4c38-b6d4-7d071e9c0b3f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf"
Jul 13 17:32:29.758455 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.758327    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d2776c4-1aa1-4631-840a-8dbf875b62a8-serving-cert\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.763639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.763610    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp9pj\" (UniqueName: \"kubernetes.io/projected/329cf01d-c819-4c38-b6d4-7d071e9c0b3f-kube-api-access-jp9pj\") pod \"service-ca-operator-7695fc6c8c-5v4vf\" (UID: \"329cf01d-c819-4c38-b6d4-7d071e9c0b3f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf"
Jul 13 17:32:29.763755 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.763711    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89jv7\" (UniqueName: \"kubernetes.io/projected/1d2776c4-1aa1-4631-840a-8dbf875b62a8-kube-api-access-89jv7\") pod \"insights-operator-68d9dd94cf-s57lt\" (UID: \"1d2776c4-1aa1-4631-840a-8dbf875b62a8\") " pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.763865 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.763848    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj"
Jul 13 17:32:29.764195 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.764179    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpxxk\" (UniqueName: \"kubernetes.io/projected/111b636e-36d8-4c99-ac23-631505961170-kube-api-access-rpxxk\") pod \"console-operator-7866497494-8878b\" (UID: \"111b636e-36d8-4c99-ac23-631505961170\") " pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:29.764438 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.764418    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szrbl\" (UniqueName: \"kubernetes.io/projected/6f849f14-833f-410f-91c5-5443acaf27ee-kube-api-access-szrbl\") pod \"cluster-samples-operator-65db858894-9mv9z\" (UID: \"6f849f14-833f-410f-91c5-5443acaf27ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"
Jul 13 17:32:29.771972 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.771945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4mw5\" (UniqueName: \"kubernetes.io/projected/195b11af-642d-4fef-87c1-dfc75d1cf13a-kube-api-access-w4mw5\") pod \"cluster-monitoring-operator-5f7f494dd4-fgtjc\" (UID: \"195b11af-642d-4fef-87c1-dfc75d1cf13a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:32:29.804833 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.804803    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf"
Jul 13 17:32:29.821375 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.821238    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:29.868087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.863059    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-s57lt"
Jul 13 17:32:29.868087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.863665    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-stats-auth\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:29.868087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.863717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-default-certificate\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:29.868087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.863769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:29.868087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.863801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:29.868087 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.863857    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjldr\" (UniqueName: \"kubernetes.io/projected/4c7a9e1c-535f-4468-a0cb-68454f647ea3-kube-api-access-xjldr\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:29.868087 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:29.867087    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 17:32:29.868087 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:29.867180    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs podName:4c7a9e1c-535f-4468-a0cb-68454f647ea3 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:30.367157666 +0000 UTC m=+45.880332912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs") pod "router-default-75c8cd656-p548p" (UID: "4c7a9e1c-535f-4468-a0cb-68454f647ea3") : secret "router-metrics-certs-default" not found
Jul 13 17:32:29.868087 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:29.867903    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle podName:4c7a9e1c-535f-4468-a0cb-68454f647ea3 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:30.367884493 +0000 UTC m=+45.881059750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle") pod "router-default-75c8cd656-p548p" (UID: "4c7a9e1c-535f-4468-a0cb-68454f647ea3") : configmap references non-existent config key: service-ca.crt
Jul 13 17:32:29.877400 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.877299    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-default-certificate\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:29.880360 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.880289    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjldr\" (UniqueName: \"kubernetes.io/projected/4c7a9e1c-535f-4468-a0cb-68454f647ea3-kube-api-access-xjldr\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:29.881915 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.881838    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-stats-auth\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:29.888183 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.888141    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-847pm"]
Jul 13 17:32:29.916860 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.915809    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-847pm"]
Jul 13 17:32:29.916860 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.915959    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm"
Jul 13 17:32:29.920443 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.920115    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 13 17:32:29.920443 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.920206    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-brld9\""
Jul 13 17:32:29.920760 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.920744    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 13 17:32:29.937478 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.937404    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-gdgjm"]
Jul 13 17:32:29.943920 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:32:29.943871    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248c7fa4_25fb_43d6_87af_7a563810a23c.slice/crio-753292c058e411e3b85828c95243f16cbf855f24f381ef849e4d32622dd02714 WatchSource:0}: Error finding container 753292c058e411e3b85828c95243f16cbf855f24f381ef849e4d32622dd02714: Status 404 returned error can't find the container with id 753292c058e411e3b85828c95243f16cbf855f24f381ef849e4d32622dd02714
Jul 13 17:32:29.980295 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:29.980205    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fm4k8"]
Jul 13 17:32:29.998305 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:32:29.998158    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd6391f8_ce94_4677_92d6_047514b9479f.slice/crio-8dd12535ba6fa7d9711337b81ebcb378f6fd5781ddf25ddbe2d0953b569a4fad WatchSource:0}: Error finding container 8dd12535ba6fa7d9711337b81ebcb378f6fd5781ddf25ddbe2d0953b569a4fad: Status 404 returned error can't find the container with id 8dd12535ba6fa7d9711337b81ebcb378f6fd5781ddf25ddbe2d0953b569a4fad
Jul 13 17:32:30.021239 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.021030    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj"]
Jul 13 17:32:30.024452 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:32:30.024405    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d8c92a_b95e_4cb5_ba78_83f4e808eb65.slice/crio-bd7178b32af84111430bc6b428f3f12532a316738d1e5002865c6d02d7f9aa9c WatchSource:0}: Error finding container bd7178b32af84111430bc6b428f3f12532a316738d1e5002865c6d02d7f9aa9c: Status 404 returned error can't find the container with id bd7178b32af84111430bc6b428f3f12532a316738d1e5002865c6d02d7f9aa9c
Jul 13 17:32:30.046942 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.046899    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf"]
Jul 13 17:32:30.054897 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:32:30.054865    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329cf01d_c819_4c38_b6d4_7d071e9c0b3f.slice/crio-ccd5ef01e709792139319a7b7018951bbe432071b03074e297c679cef315ac49 WatchSource:0}: Error finding container ccd5ef01e709792139319a7b7018951bbe432071b03074e297c679cef315ac49: Status 404 returned error can't find the container with id ccd5ef01e709792139319a7b7018951bbe432071b03074e297c679cef315ac49
Jul 13 17:32:30.066902 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.066868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-847pm\" (UID: \"d386326b-6631-4ece-9a9e-dff8ace68f97\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm"
Jul 13 17:32:30.067029 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.066986    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d386326b-6631-4ece-9a9e-dff8ace68f97-nginx-conf\") pod \"networking-console-plugin-6cf856758c-847pm\" (UID: \"d386326b-6631-4ece-9a9e-dff8ace68f97\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm"
Jul 13 17:32:30.074493 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.074230    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-8878b"]
Jul 13 17:32:30.076955 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:32:30.076929    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111b636e_36d8_4c99_ac23_631505961170.slice/crio-936b075dae378a26dfe45a023d9bba169eb26d4eea7b3e96d13c466621122780 WatchSource:0}: Error finding container 936b075dae378a26dfe45a023d9bba169eb26d4eea7b3e96d13c466621122780: Status 404 returned error can't find the container with id 936b075dae378a26dfe45a023d9bba169eb26d4eea7b3e96d13c466621122780
Jul 13 17:32:30.084704 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.084674    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-s57lt"]
Jul 13 17:32:30.087742 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:32:30.087718    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2776c4_1aa1_4631_840a_8dbf875b62a8.slice/crio-87dee7e76a32bee87e404dd6297c9786c47065fd8c6c490f9fdfc34e0f711d11 WatchSource:0}: Error finding container 87dee7e76a32bee87e404dd6297c9786c47065fd8c6c490f9fdfc34e0f711d11: Status 404 returned error can't find the container with id 87dee7e76a32bee87e404dd6297c9786c47065fd8c6c490f9fdfc34e0f711d11
Jul 13 17:32:30.168227 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.168121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d386326b-6631-4ece-9a9e-dff8ace68f97-nginx-conf\") pod \"networking-console-plugin-6cf856758c-847pm\" (UID: \"d386326b-6631-4ece-9a9e-dff8ace68f97\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm"
Jul 13 17:32:30.168452 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.168249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-847pm\" (UID: \"d386326b-6631-4ece-9a9e-dff8ace68f97\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm"
Jul 13 17:32:30.168452 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:30.168408    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 17:32:30.168549 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:30.168480    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert podName:d386326b-6631-4ece-9a9e-dff8ace68f97 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:30.668465527 +0000 UTC m=+46.181640770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-847pm" (UID: "d386326b-6631-4ece-9a9e-dff8ace68f97") : secret "networking-console-plugin-cert" not found
Jul 13 17:32:30.168850 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.168831    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d386326b-6631-4ece-9a9e-dff8ace68f97-nginx-conf\") pod \"networking-console-plugin-6cf856758c-847pm\" (UID: \"d386326b-6631-4ece-9a9e-dff8ace68f97\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm"
Jul 13 17:32:30.268792 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.268749    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fgtjc\" (UID: \"195b11af-642d-4fef-87c1-dfc75d1cf13a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:32:30.268979 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.268823    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9mv9z\" (UID: \"6f849f14-833f-410f-91c5-5443acaf27ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"
Jul 13 17:32:30.268979 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:30.268891    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 17:32:30.268979 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:30.268913    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 17:32:30.268979 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:30.268958    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls podName:6f849f14-833f-410f-91c5-5443acaf27ee nodeName:}" failed. No retries permitted until 2026-07-13 17:32:31.268945333 +0000 UTC m=+46.782120577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls") pod "cluster-samples-operator-65db858894-9mv9z" (UID: "6f849f14-833f-410f-91c5-5443acaf27ee") : secret "samples-operator-tls" not found
Jul 13 17:32:30.268979 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:30.268977    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls podName:195b11af-642d-4fef-87c1-dfc75d1cf13a nodeName:}" failed. No retries permitted until 2026-07-13 17:32:31.26896707 +0000 UTC m=+46.782142315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fgtjc" (UID: "195b11af-642d-4fef-87c1-dfc75d1cf13a") : secret "cluster-monitoring-operator-tls" not found
Jul 13 17:32:30.334017 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.333962    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-s57lt" event={"ID":"1d2776c4-1aa1-4631-840a-8dbf875b62a8","Type":"ContainerStarted","Data":"87dee7e76a32bee87e404dd6297c9786c47065fd8c6c490f9fdfc34e0f711d11"}
Jul 13 17:32:30.335071 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.335044    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gdgjm" event={"ID":"248c7fa4-25fb-43d6-87af-7a563810a23c","Type":"ContainerStarted","Data":"753292c058e411e3b85828c95243f16cbf855f24f381ef849e4d32622dd02714"}
Jul 13 17:32:30.336114 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.336089    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf" event={"ID":"329cf01d-c819-4c38-b6d4-7d071e9c0b3f","Type":"ContainerStarted","Data":"ccd5ef01e709792139319a7b7018951bbe432071b03074e297c679cef315ac49"}
Jul 13 17:32:30.337172 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.337150    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj" event={"ID":"62d8c92a-b95e-4cb5-ba78-83f4e808eb65","Type":"ContainerStarted","Data":"bd7178b32af84111430bc6b428f3f12532a316738d1e5002865c6d02d7f9aa9c"}
Jul 13 17:32:30.338347 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.338324    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fm4k8" event={"ID":"bd6391f8-ce94-4677-92d6-047514b9479f","Type":"ContainerStarted","Data":"8dd12535ba6fa7d9711337b81ebcb378f6fd5781ddf25ddbe2d0953b569a4fad"}
Jul 13 17:32:30.339306 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.339289    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8878b" event={"ID":"111b636e-36d8-4c99-ac23-631505961170","Type":"ContainerStarted","Data":"936b075dae378a26dfe45a023d9bba169eb26d4eea7b3e96d13c466621122780"}
Jul 13 17:32:30.369826 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.369792    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:30.369949 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.369835    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:30.369985 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:30.369948    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 17:32:30.370029 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:30.370017    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle podName:4c7a9e1c-535f-4468-a0cb-68454f647ea3 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:31.369999223 +0000 UTC m=+46.883174466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle") pod "router-default-75c8cd656-p548p" (UID: "4c7a9e1c-535f-4468-a0cb-68454f647ea3") : configmap references non-existent config key: service-ca.crt
Jul 13 17:32:30.370076 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:30.370040    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs podName:4c7a9e1c-535f-4468-a0cb-68454f647ea3 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:31.370032294 +0000 UTC m=+46.883207537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs") pod "router-default-75c8cd656-p548p" (UID: "4c7a9e1c-535f-4468-a0cb-68454f647ea3") : secret "router-metrics-certs-default" not found
Jul 13 17:32:30.672901 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:30.672761    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-847pm\" (UID: \"d386326b-6631-4ece-9a9e-dff8ace68f97\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm"
Jul 13 17:32:30.672901 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:30.672901    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 17:32:30.673470 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:30.672971    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert podName:d386326b-6631-4ece-9a9e-dff8ace68f97 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:31.672951733 +0000 UTC m=+47.186126978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-847pm" (UID: "d386326b-6631-4ece-9a9e-dff8ace68f97") : secret "networking-console-plugin-cert" not found
Jul 13 17:32:31.279247 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:31.278306    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fgtjc\" (UID: \"195b11af-642d-4fef-87c1-dfc75d1cf13a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:32:31.279247 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:31.278406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9mv9z\" (UID: \"6f849f14-833f-410f-91c5-5443acaf27ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"
Jul 13 17:32:31.279247 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:31.278547    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 17:32:31.279247 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:31.278608    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls podName:6f849f14-833f-410f-91c5-5443acaf27ee nodeName:}" failed. No retries permitted until 2026-07-13 17:32:33.278589294 +0000 UTC m=+48.791764543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls") pod "cluster-samples-operator-65db858894-9mv9z" (UID: "6f849f14-833f-410f-91c5-5443acaf27ee") : secret "samples-operator-tls" not found
Jul 13 17:32:31.279247 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:31.279161    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 17:32:31.279247 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:31.279215    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls podName:195b11af-642d-4fef-87c1-dfc75d1cf13a nodeName:}" failed. No retries permitted until 2026-07-13 17:32:33.279197738 +0000 UTC m=+48.792372985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fgtjc" (UID: "195b11af-642d-4fef-87c1-dfc75d1cf13a") : secret "cluster-monitoring-operator-tls" not found
Jul 13 17:32:31.379741 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:31.378929    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:31.379741 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:31.379025    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:31.379741 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:31.379214    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle podName:4c7a9e1c-535f-4468-a0cb-68454f647ea3 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:33.379194102 +0000 UTC m=+48.892369348 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle") pod "router-default-75c8cd656-p548p" (UID: "4c7a9e1c-535f-4468-a0cb-68454f647ea3") : configmap references non-existent config key: service-ca.crt
Jul 13 17:32:31.379741 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:31.379633    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 17:32:31.379741 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:31.379685    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs podName:4c7a9e1c-535f-4468-a0cb-68454f647ea3 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:33.37967058 +0000 UTC m=+48.892845826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs") pod "router-default-75c8cd656-p548p" (UID: "4c7a9e1c-535f-4468-a0cb-68454f647ea3") : secret "router-metrics-certs-default" not found
Jul 13 17:32:31.682993 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:31.682364    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-847pm\" (UID: \"d386326b-6631-4ece-9a9e-dff8ace68f97\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm"
Jul 13 17:32:31.682993 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:31.682544    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 17:32:31.682993 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:31.682612    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert podName:d386326b-6631-4ece-9a9e-dff8ace68f97 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:33.68259039 +0000 UTC m=+49.195765636 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-847pm" (UID: "d386326b-6631-4ece-9a9e-dff8ace68f97") : secret "networking-console-plugin-cert" not found
Jul 13 17:32:33.300175 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:33.300133    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fgtjc\" (UID: \"195b11af-642d-4fef-87c1-dfc75d1cf13a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:32:33.300580 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:33.300217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9mv9z\" (UID: \"6f849f14-833f-410f-91c5-5443acaf27ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"
Jul 13 17:32:33.300580 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:33.300320    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 17:32:33.300580 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:33.300376    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls podName:6f849f14-833f-410f-91c5-5443acaf27ee nodeName:}" failed. No retries permitted until 2026-07-13 17:32:37.300361906 +0000 UTC m=+52.813537149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls") pod "cluster-samples-operator-65db858894-9mv9z" (UID: "6f849f14-833f-410f-91c5-5443acaf27ee") : secret "samples-operator-tls" not found
Jul 13 17:32:33.300580 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:33.300321    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 17:32:33.300580 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:33.300447    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls podName:195b11af-642d-4fef-87c1-dfc75d1cf13a nodeName:}" failed. No retries permitted until 2026-07-13 17:32:37.300436219 +0000 UTC m=+52.813611468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fgtjc" (UID: "195b11af-642d-4fef-87c1-dfc75d1cf13a") : secret "cluster-monitoring-operator-tls" not found
Jul 13 17:32:33.401237 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:33.401196    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:33.401237 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:33.401240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:33.401501 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:33.401376    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle podName:4c7a9e1c-535f-4468-a0cb-68454f647ea3 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:37.401359586 +0000 UTC m=+52.914534829 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle") pod "router-default-75c8cd656-p548p" (UID: "4c7a9e1c-535f-4468-a0cb-68454f647ea3") : configmap references non-existent config key: service-ca.crt
Jul 13 17:32:33.401501 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:33.401379    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 17:32:33.401501 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:33.401441    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs podName:4c7a9e1c-535f-4468-a0cb-68454f647ea3 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:37.401423926 +0000 UTC m=+52.914599169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs") pod "router-default-75c8cd656-p548p" (UID: "4c7a9e1c-535f-4468-a0cb-68454f647ea3") : secret "router-metrics-certs-default" not found
Jul 13 17:32:33.703919 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:33.703873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-847pm\" (UID: \"d386326b-6631-4ece-9a9e-dff8ace68f97\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm"
Jul 13 17:32:33.704126 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:33.704046    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 17:32:33.704195 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:33.704132    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert podName:d386326b-6631-4ece-9a9e-dff8ace68f97 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:37.704105801 +0000 UTC m=+53.217281046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-847pm" (UID: "d386326b-6631-4ece-9a9e-dff8ace68f97") : secret "networking-console-plugin-cert" not found
Jul 13 17:32:36.361154 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:36.361097    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf" event={"ID":"329cf01d-c819-4c38-b6d4-7d071e9c0b3f","Type":"ContainerStarted","Data":"ffb4efc627a3fef314e19f61546042f4788059fd8cb202a72178992ebc64a8c7"}
Jul 13 17:32:36.363052 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:36.363028    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fm4k8" event={"ID":"bd6391f8-ce94-4677-92d6-047514b9479f","Type":"ContainerStarted","Data":"abfd845ac3f5ac72000d7fc30d5641eba36e0d1914d77357747dcf2c38fa785d"}
Jul 13 17:32:36.365726 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:36.365688    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-s57lt" event={"ID":"1d2776c4-1aa1-4631-840a-8dbf875b62a8","Type":"ContainerStarted","Data":"79ab37251ce5ce8418a6ed147c41a5b1ca6f2bd03a0454a4a8e17c00331c5f25"}
Jul 13 17:32:36.410998 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:36.410931    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fm4k8" podStartSLOduration=5.469263665 podStartE2EDuration="7.410908062s" totalImagesPullingTime="1.941644397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:36.380369029 +0000 UTC m=+51.893544312" watchObservedRunningTime="2026-07-13 17:32:36.410908062 +0000 UTC m=+51.924083331"
Jul 13 17:32:36.628708 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:36.628603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:36.628872 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:36.628755    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:36.628872 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:36.628773    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 17:32:36.628872 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:36.628851    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls podName:a6d21c8d-0abf-4429-ac79-efa11aa43aec nodeName:}" failed. No retries permitted until 2026-07-13 17:32:52.628827421 +0000 UTC m=+68.142002677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls") pod "dns-default-vr8x9" (UID: "a6d21c8d-0abf-4429-ac79-efa11aa43aec") : secret "dns-default-metrics-tls" not found
Jul 13 17:32:36.629092 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:36.628919    2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 17:32:36.629092 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:36.628941    2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8595949878-fcmz2: secret "image-registry-tls" not found
Jul 13 17:32:36.629092 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:36.628991    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls podName:016bb14e-b960-4f80-9386-38229e9839f8 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:52.628974986 +0000 UTC m=+68.142150231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls") pod "image-registry-8595949878-fcmz2" (UID: "016bb14e-b960-4f80-9386-38229e9839f8") : secret "image-registry-tls" not found
Jul 13 17:32:37.334544 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.334503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9mv9z\" (UID: \"6f849f14-833f-410f-91c5-5443acaf27ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"
Jul 13 17:32:37.334724 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.334645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fgtjc\" (UID: \"195b11af-642d-4fef-87c1-dfc75d1cf13a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:32:37.334724 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:37.334676    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 17:32:37.334834 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:37.334757    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls podName:6f849f14-833f-410f-91c5-5443acaf27ee nodeName:}" failed. No retries permitted until 2026-07-13 17:32:45.334736595 +0000 UTC m=+60.847911852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls") pod "cluster-samples-operator-65db858894-9mv9z" (UID: "6f849f14-833f-410f-91c5-5443acaf27ee") : secret "samples-operator-tls" not found
Jul 13 17:32:37.334834 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:37.334801    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 17:32:37.334936 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:37.334874    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls podName:195b11af-642d-4fef-87c1-dfc75d1cf13a nodeName:}" failed. No retries permitted until 2026-07-13 17:32:45.334857008 +0000 UTC m=+60.848032264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fgtjc" (UID: "195b11af-642d-4fef-87c1-dfc75d1cf13a") : secret "cluster-monitoring-operator-tls" not found
Jul 13 17:32:37.370880 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.370852    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/0.log"
Jul 13 17:32:37.370880 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.370897    2564 generic.go:356] "Generic (PLEG): container finished" podID="111b636e-36d8-4c99-ac23-631505961170" containerID="a72512c8ed1142b54f917906e75fc9675031b88e4bc45fff8cef71db1e0f9df6" exitCode=255
Jul 13 17:32:37.371504 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.370932    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8878b" event={"ID":"111b636e-36d8-4c99-ac23-631505961170","Type":"ContainerDied","Data":"a72512c8ed1142b54f917906e75fc9675031b88e4bc45fff8cef71db1e0f9df6"}
Jul 13 17:32:37.371504 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.371251    2564 scope.go:117] "RemoveContainer" containerID="a72512c8ed1142b54f917906e75fc9675031b88e4bc45fff8cef71db1e0f9df6"
Jul 13 17:32:37.373193 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.373166    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gdgjm" event={"ID":"248c7fa4-25fb-43d6-87af-7a563810a23c","Type":"ContainerStarted","Data":"0dda141ed3ea940dc80a974ae80d76e05173b2ec7b8843b044e211e859665b3b"}
Jul 13 17:32:37.374918 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.374883    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj" event={"ID":"62d8c92a-b95e-4cb5-ba78-83f4e808eb65","Type":"ContainerStarted","Data":"3df19f6b5c3736365e655a4a57e5247e8002c3ce1242fea5c9f3333450900d75"}
Jul 13 17:32:37.388292 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.387602    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-s57lt" podStartSLOduration=2.250681163 podStartE2EDuration="8.387579269s" totalImagesPullingTime="6.136898106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:36.411610304 +0000 UTC m=+51.924785570" watchObservedRunningTime="2026-07-13 17:32:37.387579269 +0000 UTC m=+52.900754532"
Jul 13 17:32:37.407697 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.407629    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj" podStartSLOduration=2.207031832 podStartE2EDuration="8.407612213s" totalImagesPullingTime="6.200580381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:37.406665314 +0000 UTC m=+52.919840580" watchObservedRunningTime="2026-07-13 17:32:37.407612213 +0000 UTC m=+52.920787479"
Jul 13 17:32:37.421795 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.421739    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-gdgjm" podStartSLOduration=2.131422934 podStartE2EDuration="8.421723487s" totalImagesPullingTime="6.290300553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:37.4208138 +0000 UTC m=+52.933989089" watchObservedRunningTime="2026-07-13 17:32:37.421723487 +0000 UTC m=+52.934898753"
Jul 13 17:32:37.436843 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.436772    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:37.436843 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.436844    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:37.444813 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:37.439316    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 17:32:37.444813 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:37.439964    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs podName:4c7a9e1c-535f-4468-a0cb-68454f647ea3 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:45.439933011 +0000 UTC m=+60.953108257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs") pod "router-default-75c8cd656-p548p" (UID: "4c7a9e1c-535f-4468-a0cb-68454f647ea3") : secret "router-metrics-certs-default" not found
Jul 13 17:32:37.444813 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:37.440524    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle podName:4c7a9e1c-535f-4468-a0cb-68454f647ea3 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:45.440506778 +0000 UTC m=+60.953682026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle") pod "router-default-75c8cd656-p548p" (UID: "4c7a9e1c-535f-4468-a0cb-68454f647ea3") : configmap references non-existent config key: service-ca.crt
Jul 13 17:32:37.444813 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.441635    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf" podStartSLOduration=2.271104371 podStartE2EDuration="8.441613516s" totalImagesPullingTime="6.170509145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:37.441217931 +0000 UTC m=+52.954393196" watchObservedRunningTime="2026-07-13 17:32:37.441613516 +0000 UTC m=+52.954788782"
Jul 13 17:32:37.741790 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.741235    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-847pm\" (UID: \"d386326b-6631-4ece-9a9e-dff8ace68f97\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm"
Jul 13 17:32:37.741790 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:37.741510    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 17:32:37.741790 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:37.741591    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert podName:d386326b-6631-4ece-9a9e-dff8ace68f97 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:45.741569287 +0000 UTC m=+61.254744544 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-847pm" (UID: "d386326b-6631-4ece-9a9e-dff8ace68f97") : secret "networking-console-plugin-cert" not found
Jul 13 17:32:37.828382 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.828351    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4lfw8"]
Jul 13 17:32:37.846420 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.846380    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4lfw8"]
Jul 13 17:32:37.846585 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.846530    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:37.848760 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.848725    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 17:32:37.848760 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.848721    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 17:32:37.848955 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.848832    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6jxkx\""
Jul 13 17:32:37.942654 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.942616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:37.942861 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.942698    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:37.942861 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.942728    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-crio-socket\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:37.942861 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.942754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drc2s\" (UniqueName: \"kubernetes.io/projected/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-api-access-drc2s\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:37.943040 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:37.942907    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-data-volume\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:38.043761 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.043718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-data-volume\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:38.043761 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.043766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:38.044110 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.043809    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:38.044110 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.043830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-crio-socket\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:38.044110 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.043855    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drc2s\" (UniqueName: \"kubernetes.io/projected/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-api-access-drc2s\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:38.044110 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:38.043941    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 17:32:38.044110 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.043969    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-crio-socket\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:38.044110 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:38.043945    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:32:38.044110 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:38.044009    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm podName:ccd9d90d-a5ea-4a96-8573-5fad19a087b2 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:38.543991843 +0000 UTC m=+54.057167090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4lfw8" (UID: "ccd9d90d-a5ea-4a96-8573-5fad19a087b2") : configmap "kube-rbac-proxy" not found
Jul 13 17:32:38.044110 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:38.044083    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls podName:ccd9d90d-a5ea-4a96-8573-5fad19a087b2 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:38.544057212 +0000 UTC m=+54.057232456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4lfw8" (UID: "ccd9d90d-a5ea-4a96-8573-5fad19a087b2") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:32:38.044415 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.044138    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-data-volume\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:38.059442 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.059409    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drc2s\" (UniqueName: \"kubernetes.io/projected/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-api-access-drc2s\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:38.379723 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.379693    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 17:32:38.380140 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.380096    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/0.log"
Jul 13 17:32:38.380140 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.380129    2564 generic.go:356] "Generic (PLEG): container finished" podID="111b636e-36d8-4c99-ac23-631505961170" containerID="27630b58c40f5630c0998eb461c58219ca792d4f2824a00c9ee214729226cf16" exitCode=255
Jul 13 17:32:38.380243 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.380170    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8878b" event={"ID":"111b636e-36d8-4c99-ac23-631505961170","Type":"ContainerDied","Data":"27630b58c40f5630c0998eb461c58219ca792d4f2824a00c9ee214729226cf16"}
Jul 13 17:32:38.380243 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.380233    2564 scope.go:117] "RemoveContainer" containerID="a72512c8ed1142b54f917906e75fc9675031b88e4bc45fff8cef71db1e0f9df6"
Jul 13 17:32:38.380713 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.380695    2564 scope.go:117] "RemoveContainer" containerID="27630b58c40f5630c0998eb461c58219ca792d4f2824a00c9ee214729226cf16"
Jul 13 17:32:38.380896 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:38.380876    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-8878b_openshift-console-operator(111b636e-36d8-4c99-ac23-631505961170)\"" pod="openshift-console-operator/console-operator-7866497494-8878b" podUID="111b636e-36d8-4c99-ac23-631505961170"
Jul 13 17:32:38.548841 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.548793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:38.549013 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:38.548883    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:38.549013 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:38.548914    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 17:32:38.549013 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:38.548978    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm podName:ccd9d90d-a5ea-4a96-8573-5fad19a087b2 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:39.548961397 +0000 UTC m=+55.062136641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4lfw8" (UID: "ccd9d90d-a5ea-4a96-8573-5fad19a087b2") : configmap "kube-rbac-proxy" not found
Jul 13 17:32:38.549013 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:38.548996    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:32:38.549205 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:38.549055    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls podName:ccd9d90d-a5ea-4a96-8573-5fad19a087b2 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:39.549039948 +0000 UTC m=+55.062215192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4lfw8" (UID: "ccd9d90d-a5ea-4a96-8573-5fad19a087b2") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:32:39.385161 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:39.385127    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 17:32:39.385582 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:39.385472    2564 scope.go:117] "RemoveContainer" containerID="27630b58c40f5630c0998eb461c58219ca792d4f2824a00c9ee214729226cf16"
Jul 13 17:32:39.385651 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:39.385633    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-8878b_openshift-console-operator(111b636e-36d8-4c99-ac23-631505961170)\"" pod="openshift-console-operator/console-operator-7866497494-8878b" podUID="111b636e-36d8-4c99-ac23-631505961170"
Jul 13 17:32:39.557349 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:39.557312    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:39.557528 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:39.557470    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:32:39.557566 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:39.557534    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls podName:ccd9d90d-a5ea-4a96-8573-5fad19a087b2 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:41.557516944 +0000 UTC m=+57.070692186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4lfw8" (UID: "ccd9d90d-a5ea-4a96-8573-5fad19a087b2") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:32:39.557612 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:39.557569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:39.557654 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:39.557643    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 17:32:39.557690 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:39.557676    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm podName:ccd9d90d-a5ea-4a96-8573-5fad19a087b2 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:41.557664524 +0000 UTC m=+57.070839770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4lfw8" (UID: "ccd9d90d-a5ea-4a96-8573-5fad19a087b2") : configmap "kube-rbac-proxy" not found
Jul 13 17:32:39.821842 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:39.821743    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:39.821842 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:39.821816    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:40.009929 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:40.009899    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7gznh_26261b52-74ca-405a-98cc-4cd807ec42f4/dns-node-resolver/0.log"
Jul 13 17:32:40.389074 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:40.389043    2564 scope.go:117] "RemoveContainer" containerID="27630b58c40f5630c0998eb461c58219ca792d4f2824a00c9ee214729226cf16"
Jul 13 17:32:40.389481 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:40.389211    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-8878b_openshift-console-operator(111b636e-36d8-4c99-ac23-631505961170)\"" pod="openshift-console-operator/console-operator-7866497494-8878b" podUID="111b636e-36d8-4c99-ac23-631505961170"
Jul 13 17:32:41.411236 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:41.411202    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nx5qk_e0b0c1eb-d696-4180-bfd9-f7d1d32dec80/node-ca/0.log"
Jul 13 17:32:41.575376 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:41.575322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:41.575559 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:41.575486    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:32:41.575559 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:41.575522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:41.575559 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:41.575557    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls podName:ccd9d90d-a5ea-4a96-8573-5fad19a087b2 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:45.57553826 +0000 UTC m=+61.088713508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4lfw8" (UID: "ccd9d90d-a5ea-4a96-8573-5fad19a087b2") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:32:41.575668 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:41.575581    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 17:32:41.575668 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:41.575619    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm podName:ccd9d90d-a5ea-4a96-8573-5fad19a087b2 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:45.57560798 +0000 UTC m=+61.088783239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4lfw8" (UID: "ccd9d90d-a5ea-4a96-8573-5fad19a087b2") : configmap "kube-rbac-proxy" not found
Jul 13 17:32:42.011013 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:42.010980    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wnx5t_c66a8af0-b527-42ae-b24e-fb6f1b1885ea/serve-healthcheck-canary/0.log"
Jul 13 17:32:42.612493 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:42.612463    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-brczj_62d8c92a-b95e-4cb5-ba78-83f4e808eb65/kube-storage-version-migrator-operator/0.log"
Jul 13 17:32:45.410404 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:45.410358    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9mv9z\" (UID: \"6f849f14-833f-410f-91c5-5443acaf27ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"
Jul 13 17:32:45.410872 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:45.410523    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 17:32:45.410872 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:45.410541    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fgtjc\" (UID: \"195b11af-642d-4fef-87c1-dfc75d1cf13a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:32:45.410872 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:45.410593    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls podName:6f849f14-833f-410f-91c5-5443acaf27ee nodeName:}" failed. No retries permitted until 2026-07-13 17:33:01.410575695 +0000 UTC m=+76.923750938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls") pod "cluster-samples-operator-65db858894-9mv9z" (UID: "6f849f14-833f-410f-91c5-5443acaf27ee") : secret "samples-operator-tls" not found
Jul 13 17:32:45.410872 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:45.410649    2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 17:32:45.410872 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:45.410709    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls podName:195b11af-642d-4fef-87c1-dfc75d1cf13a nodeName:}" failed. No retries permitted until 2026-07-13 17:33:01.410692067 +0000 UTC m=+76.923867311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fgtjc" (UID: "195b11af-642d-4fef-87c1-dfc75d1cf13a") : secret "cluster-monitoring-operator-tls" not found
Jul 13 17:32:45.511427 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:45.511387    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:45.511427 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:45.511429    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:32:45.511689 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:45.511551    2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 17:32:45.511689 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:45.511618    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs podName:4c7a9e1c-535f-4468-a0cb-68454f647ea3 nodeName:}" failed. No retries permitted until 2026-07-13 17:33:01.511598867 +0000 UTC m=+77.024774114 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs") pod "router-default-75c8cd656-p548p" (UID: "4c7a9e1c-535f-4468-a0cb-68454f647ea3") : secret "router-metrics-certs-default" not found
Jul 13 17:32:45.511689 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:45.511659    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle podName:4c7a9e1c-535f-4468-a0cb-68454f647ea3 nodeName:}" failed. No retries permitted until 2026-07-13 17:33:01.511648648 +0000 UTC m=+77.024823891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle") pod "router-default-75c8cd656-p548p" (UID: "4c7a9e1c-535f-4468-a0cb-68454f647ea3") : configmap references non-existent config key: service-ca.crt
Jul 13 17:32:45.613163 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:45.613122    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:45.613402 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:45.613205    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:45.613402 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:45.613243    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 17:32:45.613402 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:45.613328    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm podName:ccd9d90d-a5ea-4a96-8573-5fad19a087b2 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:53.613312066 +0000 UTC m=+69.126487310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4lfw8" (UID: "ccd9d90d-a5ea-4a96-8573-5fad19a087b2") : configmap "kube-rbac-proxy" not found
Jul 13 17:32:45.613402 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:45.613363    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:32:45.613572 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:45.613428    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls podName:ccd9d90d-a5ea-4a96-8573-5fad19a087b2 nodeName:}" failed. No retries permitted until 2026-07-13 17:32:53.61341252 +0000 UTC m=+69.126587764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4lfw8" (UID: "ccd9d90d-a5ea-4a96-8573-5fad19a087b2") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:32:45.814489 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:45.814391    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-847pm\" (UID: \"d386326b-6631-4ece-9a9e-dff8ace68f97\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm"
Jul 13 17:32:45.814638 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:45.814534    2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 17:32:45.814638 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:45.814600    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert podName:d386326b-6631-4ece-9a9e-dff8ace68f97 nodeName:}" failed. No retries permitted until 2026-07-13 17:33:01.814585791 +0000 UTC m=+77.327761034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-847pm" (UID: "d386326b-6631-4ece-9a9e-dff8ace68f97") : secret "networking-console-plugin-cert" not found
Jul 13 17:32:47.297978 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:47.297943    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w54x7"
Jul 13 17:32:50.860459 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:50.860422    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:50.860925 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:50.860599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs\") pod \"network-metrics-daemon-vzwcn\" (UID: \"b049232f-2f86-4a9a-aed5-5c294c59e33d\") " pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:32:50.860925 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:50.860634    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgk5b\" (UniqueName: \"kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b\") pod \"network-check-target-4bdcp\" (UID: \"890ecca9-2a93-47c0-bace-5c5b3d18a55e\") " pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:50.862652 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:50.862623    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 17:32:50.862828 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:50.862807    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 17:32:50.863212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:50.863195    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgk5b\" (UniqueName: \"kubernetes.io/projected/890ecca9-2a93-47c0-bace-5c5b3d18a55e-kube-api-access-kgk5b\") pod \"network-check-target-4bdcp\" (UID: \"890ecca9-2a93-47c0-bace-5c5b3d18a55e\") " pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:50.871478 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:50.871448    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 17:32:50.871631 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:50.871528    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs podName:b049232f-2f86-4a9a-aed5-5c294c59e33d nodeName:}" failed. No retries permitted until 2026-07-13 17:33:54.871510717 +0000 UTC m=+130.384685963 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs") pod "network-metrics-daemon-vzwcn" (UID: "b049232f-2f86-4a9a-aed5-5c294c59e33d") : secret "metrics-daemon-secret" not found
Jul 13 17:32:50.873633 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:50.873610    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/25cdc609-cac2-4bf2-9410-a4f48e6f5094-original-pull-secret\") pod \"global-pull-secret-syncer-s4xjg\" (UID: \"25cdc609-cac2-4bf2-9410-a4f48e6f5094\") " pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:51.015029 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:51.014989    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s4xjg"
Jul 13 17:32:51.027760 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:51.027731    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vn7td\""
Jul 13 17:32:51.036445 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:51.036415    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:51.152938 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:51.152751    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s4xjg"]
Jul 13 17:32:51.155681 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:32:51.155654    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25cdc609_cac2_4bf2_9410_a4f48e6f5094.slice/crio-128dd6b5f0262d6fc4b7c94c0a1e8bbbf2c83ee894c06d39fdc3ea4cf139c888 WatchSource:0}: Error finding container 128dd6b5f0262d6fc4b7c94c0a1e8bbbf2c83ee894c06d39fdc3ea4cf139c888: Status 404 returned error can't find the container with id 128dd6b5f0262d6fc4b7c94c0a1e8bbbf2c83ee894c06d39fdc3ea4cf139c888
Jul 13 17:32:51.178128 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:51.178094    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4bdcp"]
Jul 13 17:32:51.180771 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:32:51.180745    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod890ecca9_2a93_47c0_bace_5c5b3d18a55e.slice/crio-6e4403543b7d86cd6915904c485998469d4189dcb172bb409ba567f1aca41e1c WatchSource:0}: Error finding container 6e4403543b7d86cd6915904c485998469d4189dcb172bb409ba567f1aca41e1c: Status 404 returned error can't find the container with id 6e4403543b7d86cd6915904c485998469d4189dcb172bb409ba567f1aca41e1c
Jul 13 17:32:51.427570 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:51.427486    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4bdcp" event={"ID":"890ecca9-2a93-47c0-bace-5c5b3d18a55e","Type":"ContainerStarted","Data":"1e8259b80c9dfe2350abc07810e0270eda8acf5089104ef4507ea43773ac0476"}
Jul 13 17:32:51.427570 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:51.427538    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4bdcp" event={"ID":"890ecca9-2a93-47c0-bace-5c5b3d18a55e","Type":"ContainerStarted","Data":"6e4403543b7d86cd6915904c485998469d4189dcb172bb409ba567f1aca41e1c"}
Jul 13 17:32:51.427794 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:51.427581    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:32:51.428636 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:51.428613    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s4xjg" event={"ID":"25cdc609-cac2-4bf2-9410-a4f48e6f5094","Type":"ContainerStarted","Data":"128dd6b5f0262d6fc4b7c94c0a1e8bbbf2c83ee894c06d39fdc3ea4cf139c888"}
Jul 13 17:32:51.459848 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:51.459789    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4bdcp" podStartSLOduration=66.459771889 podStartE2EDuration="1m6.459771889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:31:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:51.458209456 +0000 UTC m=+66.971384715" watchObservedRunningTime="2026-07-13 17:32:51.459771889 +0000 UTC m=+66.972947148"
Jul 13 17:32:52.678060 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:52.678016    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:52.678559 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:52.678138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:52.681458 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:52.681432    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6d21c8d-0abf-4429-ac79-efa11aa43aec-metrics-tls\") pod \"dns-default-vr8x9\" (UID: \"a6d21c8d-0abf-4429-ac79-efa11aa43aec\") " pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:52.681715 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:52.681693    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls\") pod \"image-registry-8595949878-fcmz2\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") " pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:52.874737 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:52.874704    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k92hg\""
Jul 13 17:32:52.883778 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:52.883747    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:52.888587 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:52.888557    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-225kz\""
Jul 13 17:32:52.897412 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:52.897383    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:53.005252 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:53.005225    2564 scope.go:117] "RemoveContainer" containerID="27630b58c40f5630c0998eb461c58219ca792d4f2824a00c9ee214729226cf16"
Jul 13 17:32:53.048109 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:53.048078    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8595949878-fcmz2"]
Jul 13 17:32:53.051096 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:32:53.051064    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016bb14e_b960_4f80_9386_38229e9839f8.slice/crio-2790f0aca1a3319eb4dd3a0045b34c9c511883361a0a9b3502aa1299f3ebe6e3 WatchSource:0}: Error finding container 2790f0aca1a3319eb4dd3a0045b34c9c511883361a0a9b3502aa1299f3ebe6e3: Status 404 returned error can't find the container with id 2790f0aca1a3319eb4dd3a0045b34c9c511883361a0a9b3502aa1299f3ebe6e3
Jul 13 17:32:53.061893 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:53.061871    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vr8x9"]
Jul 13 17:32:53.065056 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:32:53.065025    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d21c8d_0abf_4429_ac79_efa11aa43aec.slice/crio-65cd7840cce6fc93525bd9e5dba06ed7bd11ed32a68d49ec9893c9f18d1bd59c WatchSource:0}: Error finding container 65cd7840cce6fc93525bd9e5dba06ed7bd11ed32a68d49ec9893c9f18d1bd59c: Status 404 returned error can't find the container with id 65cd7840cce6fc93525bd9e5dba06ed7bd11ed32a68d49ec9893c9f18d1bd59c
Jul 13 17:32:53.439722 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:53.439689    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 17:32:53.439899 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:53.439826    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-8878b" event={"ID":"111b636e-36d8-4c99-ac23-631505961170","Type":"ContainerStarted","Data":"c873f01bc31de3d5765fa3ed28eb6742b43bb177f3237192360116e2f41034da"}
Jul 13 17:32:53.440324 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:53.440140    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:53.441233 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:53.441210    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vr8x9" event={"ID":"a6d21c8d-0abf-4429-ac79-efa11aa43aec","Type":"ContainerStarted","Data":"65cd7840cce6fc93525bd9e5dba06ed7bd11ed32a68d49ec9893c9f18d1bd59c"}
Jul 13 17:32:53.442665 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:53.442643    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8595949878-fcmz2" event={"ID":"016bb14e-b960-4f80-9386-38229e9839f8","Type":"ContainerStarted","Data":"35c03ae4a61e880e460d2812b30e5d37c3ef78f8fa6cb9af65506d64d4ac1251"}
Jul 13 17:32:53.442771 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:53.442683    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8595949878-fcmz2" event={"ID":"016bb14e-b960-4f80-9386-38229e9839f8","Type":"ContainerStarted","Data":"2790f0aca1a3319eb4dd3a0045b34c9c511883361a0a9b3502aa1299f3ebe6e3"}
Jul 13 17:32:53.442817 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:53.442791    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:32:53.455567 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:53.455394    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-8878b" podStartSLOduration=18.307188911 podStartE2EDuration="24.455373053s" totalImagesPullingTime="6.148184142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:53.454894683 +0000 UTC m=+68.968069972" watchObservedRunningTime="2026-07-13 17:32:53.455373053 +0000 UTC m=+68.968548319"
Jul 13 17:32:53.478832 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:53.478772    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8595949878-fcmz2" podStartSLOduration=68.478750082 podStartE2EDuration="1m8.478750082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:31:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:53.478333177 +0000 UTC m=+68.991508457" watchObservedRunningTime="2026-07-13 17:32:53.478750082 +0000 UTC m=+68.991925349"
Jul 13 17:32:53.689187 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:53.689145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:53.689599 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:53.689237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:53.689599 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:53.689377    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 17:32:53.689599 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:32:53.689483    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls podName:ccd9d90d-a5ea-4a96-8573-5fad19a087b2 nodeName:}" failed. No retries permitted until 2026-07-13 17:33:09.689458785 +0000 UTC m=+85.202634030 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4lfw8" (UID: "ccd9d90d-a5ea-4a96-8573-5fad19a087b2") : secret "insights-runtime-extractor-tls" not found
Jul 13 17:32:53.689784 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:53.689738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:32:54.440644 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:54.440571    2564 patch_prober.go:28] interesting pod/console-operator-7866497494-8878b container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.14:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 17:32:54.440861 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:54.440647    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7866497494-8878b" podUID="111b636e-36d8-4c99-ac23-631505961170" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.14:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 13 17:32:54.690190 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:54.690161    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-8878b"
Jul 13 17:32:56.456354 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:56.456308    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s4xjg" event={"ID":"25cdc609-cac2-4bf2-9410-a4f48e6f5094","Type":"ContainerStarted","Data":"c7ba986015ffca3b0d2a2d60af89a5b3b1645c28578c6444694888e1c92ee562"}
Jul 13 17:32:56.458123 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:56.458100    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vr8x9" event={"ID":"a6d21c8d-0abf-4429-ac79-efa11aa43aec","Type":"ContainerStarted","Data":"64cc72ae89756eb5052e5391a4a5a68f8ea8a318589b9c3303d56042a315ac14"}
Jul 13 17:32:56.458226 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:56.458146    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vr8x9" event={"ID":"a6d21c8d-0abf-4429-ac79-efa11aa43aec","Type":"ContainerStarted","Data":"1bb0f9ad48be3084f2d6ed7e59061437356cbe6e0c0b56cf4812a2be5afdf53c"}
Jul 13 17:32:56.458282 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:56.458221    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:32:56.475666 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:56.475622    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s4xjg" podStartSLOduration=66.558807462 podStartE2EDuration="1m11.475605895s" totalImagesPullingTime="4.916798433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:56.473926257 +0000 UTC m=+71.987101521" watchObservedRunningTime="2026-07-13 17:32:56.475605895 +0000 UTC m=+71.988781159"
Jul 13 17:32:56.488609 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:56.488562    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vr8x9" podStartSLOduration=33.486058503 podStartE2EDuration="36.488542816s" totalImagesPullingTime="3.002484313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:32:56.488443499 +0000 UTC m=+72.001618790" watchObservedRunningTime="2026-07-13 17:32:56.488542816 +0000 UTC m=+72.001718063"
Jul 13 17:32:59.264371 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.264335    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"]
Jul 13 17:32:59.269417 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.269389    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.271643 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.271616    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 13 17:32:59.271769 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.271736    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 13 17:32:59.271934 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.271921    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 13 17:32:59.272615 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.272588    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 13 17:32:59.272615 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.272612    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 13 17:32:59.272773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.272626    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 13 17:32:59.272773 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.272611    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 13 17:32:59.289463 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.289430    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"]
Jul 13 17:32:59.443805 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.443768    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/51c683de-4f37-4098-81d6-cd20f42ba8fd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.443982 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.443883    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/51c683de-4f37-4098-81d6-cd20f42ba8fd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.443982 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.443917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvkgl\" (UniqueName: \"kubernetes.io/projected/51c683de-4f37-4098-81d6-cd20f42ba8fd-kube-api-access-xvkgl\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.443982 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.443960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/51c683de-4f37-4098-81d6-cd20f42ba8fd-ca\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.443982 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.443978    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/51c683de-4f37-4098-81d6-cd20f42ba8fd-hub\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.444119 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.443994    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51c683de-4f37-4098-81d6-cd20f42ba8fd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.544915 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.544821    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/51c683de-4f37-4098-81d6-cd20f42ba8fd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.544915 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.544858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvkgl\" (UniqueName: \"kubernetes.io/projected/51c683de-4f37-4098-81d6-cd20f42ba8fd-kube-api-access-xvkgl\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.544915 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.544885    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/51c683de-4f37-4098-81d6-cd20f42ba8fd-ca\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.544915 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.544901    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/51c683de-4f37-4098-81d6-cd20f42ba8fd-hub\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.544915 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.544916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51c683de-4f37-4098-81d6-cd20f42ba8fd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.545234 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.544987    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/51c683de-4f37-4098-81d6-cd20f42ba8fd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.545807 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.545779    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/51c683de-4f37-4098-81d6-cd20f42ba8fd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.547519 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.547493    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/51c683de-4f37-4098-81d6-cd20f42ba8fd-hub\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.547638 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.547527    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/51c683de-4f37-4098-81d6-cd20f42ba8fd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.547778 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.547760    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/51c683de-4f37-4098-81d6-cd20f42ba8fd-ca\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.547946 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.547926    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51c683de-4f37-4098-81d6-cd20f42ba8fd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.559657 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.559627    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvkgl\" (UniqueName: \"kubernetes.io/projected/51c683de-4f37-4098-81d6-cd20f42ba8fd-kube-api-access-xvkgl\") pod \"cluster-proxy-proxy-agent-7fd9956468-nvrhn\" (UID: \"51c683de-4f37-4098-81d6-cd20f42ba8fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.595455 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.595419    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"
Jul 13 17:32:59.732145 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:32:59.732073    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn"]
Jul 13 17:32:59.734851 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:32:59.734825    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51c683de_4f37_4098_81d6_cd20f42ba8fd.slice/crio-a66e2d96af9ad25346505d5eadda5372e56e8733520a247a775f208f01ae0e42 WatchSource:0}: Error finding container a66e2d96af9ad25346505d5eadda5372e56e8733520a247a775f208f01ae0e42: Status 404 returned error can't find the container with id a66e2d96af9ad25346505d5eadda5372e56e8733520a247a775f208f01ae0e42
Jul 13 17:33:00.472760 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:00.472668    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn" event={"ID":"51c683de-4f37-4098-81d6-cd20f42ba8fd","Type":"ContainerStarted","Data":"a66e2d96af9ad25346505d5eadda5372e56e8733520a247a775f208f01ae0e42"}
Jul 13 17:33:01.462160 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.462121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fgtjc\" (UID: \"195b11af-642d-4fef-87c1-dfc75d1cf13a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:33:01.462410 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.462221    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9mv9z\" (UID: \"6f849f14-833f-410f-91c5-5443acaf27ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"
Jul 13 17:33:01.465490 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.465443    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/195b11af-642d-4fef-87c1-dfc75d1cf13a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fgtjc\" (UID: \"195b11af-642d-4fef-87c1-dfc75d1cf13a\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:33:01.465664 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.465513    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f849f14-833f-410f-91c5-5443acaf27ee-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-9mv9z\" (UID: \"6f849f14-833f-410f-91c5-5443acaf27ee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"
Jul 13 17:33:01.563844 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.563798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:33:01.564332 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.563854    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:33:01.564735 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.564697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c7a9e1c-535f-4468-a0cb-68454f647ea3-service-ca-bundle\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:33:01.567375 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.567342    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c7a9e1c-535f-4468-a0cb-68454f647ea3-metrics-certs\") pod \"router-default-75c8cd656-p548p\" (UID: \"4c7a9e1c-535f-4468-a0cb-68454f647ea3\") " pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:33:01.580791 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.580753    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-97lnd\""
Jul 13 17:33:01.589072 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.589033    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"
Jul 13 17:33:01.647216 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.647183    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qdx42\""
Jul 13 17:33:01.655728 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.655638    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"
Jul 13 17:33:01.721674 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.721594    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rlnrv\""
Jul 13 17:33:01.730601 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.730565    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:33:01.866815 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.866729    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-847pm\" (UID: \"d386326b-6631-4ece-9a9e-dff8ace68f97\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm"
Jul 13 17:33:01.870020 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:01.869984    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d386326b-6631-4ece-9a9e-dff8ace68f97-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-847pm\" (UID: \"d386326b-6631-4ece-9a9e-dff8ace68f97\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm"
Jul 13 17:33:02.047530 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:02.047254    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-brld9\""
Jul 13 17:33:02.055527 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:02.055488    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm"
Jul 13 17:33:02.124759 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:02.124111    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75c8cd656-p548p"]
Jul 13 17:33:02.130646 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:33:02.130490    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7a9e1c_535f_4468_a0cb_68454f647ea3.slice/crio-a746d267710c517554b1cd680e7d787af61e3f6e050248e67ed5aee7d0234955 WatchSource:0}: Error finding container a746d267710c517554b1cd680e7d787af61e3f6e050248e67ed5aee7d0234955: Status 404 returned error can't find the container with id a746d267710c517554b1cd680e7d787af61e3f6e050248e67ed5aee7d0234955
Jul 13 17:33:02.149339 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:02.149079    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z"]
Jul 13 17:33:02.154864 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:02.154833    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc"]
Jul 13 17:33:02.157715 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:33:02.157685    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod195b11af_642d_4fef_87c1_dfc75d1cf13a.slice/crio-f9bd2855c02a1af9e40dbce49d1f60878eceacce623775d3bd5bff164a64aaec WatchSource:0}: Error finding container f9bd2855c02a1af9e40dbce49d1f60878eceacce623775d3bd5bff164a64aaec: Status 404 returned error can't find the container with id f9bd2855c02a1af9e40dbce49d1f60878eceacce623775d3bd5bff164a64aaec
Jul 13 17:33:02.235492 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:02.235443    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-847pm"]
Jul 13 17:33:02.238917 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:33:02.238880    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd386326b_6631_4ece_9a9e_dff8ace68f97.slice/crio-6476f599087ba7aa0c575b1eba7dd5f69cfde63d6800faed52338183d352c604 WatchSource:0}: Error finding container 6476f599087ba7aa0c575b1eba7dd5f69cfde63d6800faed52338183d352c604: Status 404 returned error can't find the container with id 6476f599087ba7aa0c575b1eba7dd5f69cfde63d6800faed52338183d352c604
Jul 13 17:33:02.484719 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:02.484680    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z" event={"ID":"6f849f14-833f-410f-91c5-5443acaf27ee","Type":"ContainerStarted","Data":"4ff8211abc1bf73ef08d8d7e57096426c5139900e54573080672ffcce58c959f"}
Jul 13 17:33:02.486059 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:02.486023    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc" event={"ID":"195b11af-642d-4fef-87c1-dfc75d1cf13a","Type":"ContainerStarted","Data":"f9bd2855c02a1af9e40dbce49d1f60878eceacce623775d3bd5bff164a64aaec"}
Jul 13 17:33:02.487781 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:02.487706    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75c8cd656-p548p" event={"ID":"4c7a9e1c-535f-4468-a0cb-68454f647ea3","Type":"ContainerStarted","Data":"2beb93fe6ebe5018eb419cc4ddb80a21e914b41824bdabacafeaf1d3a410a3f5"}
Jul 13 17:33:02.487781 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:02.487769    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75c8cd656-p548p" event={"ID":"4c7a9e1c-535f-4468-a0cb-68454f647ea3","Type":"ContainerStarted","Data":"a746d267710c517554b1cd680e7d787af61e3f6e050248e67ed5aee7d0234955"}
Jul 13 17:33:02.488892 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:02.488869    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm" event={"ID":"d386326b-6631-4ece-9a9e-dff8ace68f97","Type":"ContainerStarted","Data":"6476f599087ba7aa0c575b1eba7dd5f69cfde63d6800faed52338183d352c604"}
Jul 13 17:33:02.507635 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:02.507585    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-75c8cd656-p548p" podStartSLOduration=33.50756734 podStartE2EDuration="33.50756734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:02.506677303 +0000 UTC m=+78.019852569" watchObservedRunningTime="2026-07-13 17:33:02.50756734 +0000 UTC m=+78.020742605"
Jul 13 17:33:02.731794 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:02.731758    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:33:02.734772 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:02.734696    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:33:03.496598 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:03.495248    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:33:03.498373 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:03.498342    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-75c8cd656-p548p"
Jul 13 17:33:04.500352 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:04.500315    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn" event={"ID":"51c683de-4f37-4098-81d6-cd20f42ba8fd","Type":"ContainerStarted","Data":"8937f756269a7dd04d71dfc98e08266023b4cff0d3ca700acdf4c78d4c05a216"}
Jul 13 17:33:04.500823 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:04.500366    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn" event={"ID":"51c683de-4f37-4098-81d6-cd20f42ba8fd","Type":"ContainerStarted","Data":"9c7f6428694045ade022ea1fc1a53b9d5550c1b8dda973fce5c9336de3b7161b"}
Jul 13 17:33:04.500823 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:04.500384    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn" event={"ID":"51c683de-4f37-4098-81d6-cd20f42ba8fd","Type":"ContainerStarted","Data":"df19e42fc2662df28915a89fe4751733c610091675268c6fb4ffad3b319ca7ac"}
Jul 13 17:33:04.522070 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:04.521982    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fd9956468-nvrhn" podStartSLOduration=1.6667765270000001 podStartE2EDuration="5.5219656s" totalImagesPullingTime="3.855189073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:04.520192418 +0000 UTC m=+80.033367682" watchObservedRunningTime="2026-07-13 17:33:04.5219656 +0000 UTC m=+80.035140865"
Jul 13 17:33:05.506308 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:05.506249    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm" event={"ID":"d386326b-6631-4ece-9a9e-dff8ace68f97","Type":"ContainerStarted","Data":"ce440e8e6e8e73b97d163468d47f866f2bca1cba900262a83411480e81e9a73d"}
Jul 13 17:33:05.522198 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:05.522141    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-847pm" podStartSLOduration=34.190536965 podStartE2EDuration="36.522124088s" totalImagesPullingTime="2.331587123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:05.520764998 +0000 UTC m=+81.033940254" watchObservedRunningTime="2026-07-13 17:33:05.522124088 +0000 UTC m=+81.035299445"
Jul 13 17:33:06.463437 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:06.463403    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vr8x9"
Jul 13 17:33:06.512244 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:06.512204    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z" event={"ID":"6f849f14-833f-410f-91c5-5443acaf27ee","Type":"ContainerStarted","Data":"18acec575ea6b9b6cf182ffe635a2078b6af0627cc4150ede10e698ad9213bd2"}
Jul 13 17:33:06.512724 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:06.512284    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z" event={"ID":"6f849f14-833f-410f-91c5-5443acaf27ee","Type":"ContainerStarted","Data":"a1343ab572b718e51edcdba194f7b06c44442b0b97c6d99d5e37a3e45ab28ac3"}
Jul 13 17:33:06.513899 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:06.513864    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc" event={"ID":"195b11af-642d-4fef-87c1-dfc75d1cf13a","Type":"ContainerStarted","Data":"3b1266b5eac46bb2281de7ae79bebc48a64794e0aeb2c08c3cbf363e32fb78d5"}
Jul 13 17:33:06.531178 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:06.530354    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-9mv9z" podStartSLOduration=34.076984079 podStartE2EDuration="37.53032849s" totalImagesPullingTime="3.453344411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:06.5271905 +0000 UTC m=+82.040365783" watchObservedRunningTime="2026-07-13 17:33:06.53032849 +0000 UTC m=+82.043503755"
Jul 13 17:33:06.546844 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:06.546775    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fgtjc" podStartSLOduration=34.038497101 podStartE2EDuration="37.546753814s" totalImagesPullingTime="3.508256713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:06.546288045 +0000 UTC m=+82.059463320" watchObservedRunningTime="2026-07-13 17:33:06.546753814 +0000 UTC m=+82.059929080"
Jul 13 17:33:09.736623 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:09.736581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:33:09.739012 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:09.738988    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ccd9d90d-a5ea-4a96-8573-5fad19a087b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4lfw8\" (UID: \"ccd9d90d-a5ea-4a96-8573-5fad19a087b2\") " pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:33:09.958909 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:09.958875    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6jxkx\""
Jul 13 17:33:09.967549 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:09.967523    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4lfw8"
Jul 13 17:33:10.124170 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:10.124135    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4lfw8"]
Jul 13 17:33:10.126283 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:33:10.126247    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd9d90d_a5ea_4a96_8573_5fad19a087b2.slice/crio-73374c33a67c44e9994dabe6a9cbcc02a580369f86eef054f9d16b8173ef71ff WatchSource:0}: Error finding container 73374c33a67c44e9994dabe6a9cbcc02a580369f86eef054f9d16b8173ef71ff: Status 404 returned error can't find the container with id 73374c33a67c44e9994dabe6a9cbcc02a580369f86eef054f9d16b8173ef71ff
Jul 13 17:33:10.528512 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:10.528481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4lfw8" event={"ID":"ccd9d90d-a5ea-4a96-8573-5fad19a087b2","Type":"ContainerStarted","Data":"73374c33a67c44e9994dabe6a9cbcc02a580369f86eef054f9d16b8173ef71ff"}
Jul 13 17:33:12.888973 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:12.888936    2564 patch_prober.go:28] interesting pod/image-registry-8595949878-fcmz2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 17:33:12.889414 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:12.888991    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8595949878-fcmz2" podUID="016bb14e-b960-4f80-9386-38229e9839f8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 17:33:14.452831 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:14.452757    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:33:14.544896 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:14.544854    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4lfw8" event={"ID":"ccd9d90d-a5ea-4a96-8573-5fad19a087b2","Type":"ContainerStarted","Data":"7359eba0b325b4c90822c8cd30406fad6766cd54f4480ac3ce05dd4221da9346"}
Jul 13 17:33:15.551768 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:15.551727    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4lfw8" event={"ID":"ccd9d90d-a5ea-4a96-8573-5fad19a087b2","Type":"ContainerStarted","Data":"44b7e04d40d5bb4ea65d4ae1cc58ceb4745ffb208e219644c744cb91b7194a80"}
Jul 13 17:33:18.566181 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:18.566143    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4lfw8" event={"ID":"ccd9d90d-a5ea-4a96-8573-5fad19a087b2","Type":"ContainerStarted","Data":"3bf5f7c7099b4bd05ff2633f41f4cebbccc2fcb30c70208940a71d4a0c73e12e"}
Jul 13 17:33:18.583681 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:18.583630    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4lfw8" podStartSLOduration=34.251504078 podStartE2EDuration="41.583615039s" totalImagesPullingTime="7.332110961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 17:32:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:18.582066314 +0000 UTC m=+94.095241578" watchObservedRunningTime="2026-07-13 17:33:18.583615039 +0000 UTC m=+94.096790304"
Jul 13 17:33:21.610813 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:21.610772    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8595949878-fcmz2"]
Jul 13 17:33:22.435984 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.435957    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4bdcp"
Jul 13 17:33:22.647675 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.647643    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t846p"]
Jul 13 17:33:22.651243 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.651217    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.653899 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.653871    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 17:33:22.653899 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.653892    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 17:33:22.654097 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.653913    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 17:33:22.654097 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.653963    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 17:33:22.654097 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.654047    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vzcd9\""
Jul 13 17:33:22.750801 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.750706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-sys\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.750801 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.750744    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-root\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.750801 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.750767    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-accelerators-collector-config\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.751050 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.750809    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-tls\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.751050 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.750865    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-textfile\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.751050 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.750947    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-wtmp\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.751050 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.750978    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.751050 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.751006    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-metrics-client-ca\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.751050 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.751044    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hhcn\" (UniqueName: \"kubernetes.io/projected/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-kube-api-access-9hhcn\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.851680 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.851621    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-wtmp\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.851680 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.851672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.851922 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.851696    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-metrics-client-ca\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.851922 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.851721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hhcn\" (UniqueName: \"kubernetes.io/projected/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-kube-api-access-9hhcn\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.851922 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.851771    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-sys\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.851922 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.851796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-root\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.851922 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.851830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-accelerators-collector-config\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.851922 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.851842    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-wtmp\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.851922 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.851897    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-root\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.851922 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.851912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-tls\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.852249 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.851963    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-sys\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.852249 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.851964    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-textfile\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.852249 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:33:22.852005    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 13 17:33:22.852249 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:33:22.852076    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-tls podName:e2c6377b-2866-4d0e-aebc-4eb7d6d47828 nodeName:}" failed. No retries permitted until 2026-07-13 17:33:23.352056867 +0000 UTC m=+98.865232111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-tls") pod "node-exporter-t846p" (UID: "e2c6377b-2866-4d0e-aebc-4eb7d6d47828") : secret "node-exporter-tls" not found
Jul 13 17:33:22.852249 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.852229    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-textfile\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.852488 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.852458    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-metrics-client-ca\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.852564 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.852512    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-accelerators-collector-config\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.854005 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.853987    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:22.869466 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:22.869426    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hhcn\" (UniqueName: \"kubernetes.io/projected/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-kube-api-access-9hhcn\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:23.356998 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:23.356960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-tls\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:23.359223 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:23.359202    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e2c6377b-2866-4d0e-aebc-4eb7d6d47828-node-exporter-tls\") pod \"node-exporter-t846p\" (UID: \"e2c6377b-2866-4d0e-aebc-4eb7d6d47828\") " pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:23.564580 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:23.564537    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t846p"
Jul 13 17:33:23.578434 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:33:23.578403    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c6377b_2866_4d0e_aebc_4eb7d6d47828.slice/crio-25ad740bc3360f0c73fa026a38b3932997e21fad94dbc41cfe4aa0768f0fedc6 WatchSource:0}: Error finding container 25ad740bc3360f0c73fa026a38b3932997e21fad94dbc41cfe4aa0768f0fedc6: Status 404 returned error can't find the container with id 25ad740bc3360f0c73fa026a38b3932997e21fad94dbc41cfe4aa0768f0fedc6
Jul 13 17:33:23.584883 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:23.584853    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t846p" event={"ID":"e2c6377b-2866-4d0e-aebc-4eb7d6d47828","Type":"ContainerStarted","Data":"25ad740bc3360f0c73fa026a38b3932997e21fad94dbc41cfe4aa0768f0fedc6"}
Jul 13 17:33:25.594520 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:25.594484    2564 generic.go:356] "Generic (PLEG): container finished" podID="e2c6377b-2866-4d0e-aebc-4eb7d6d47828" containerID="2358931260b36a0fc8f9703ab6b562ec74e218a1cd22bc0c8e65ee7373370fbc" exitCode=0
Jul 13 17:33:25.594916 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:25.594571    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t846p" event={"ID":"e2c6377b-2866-4d0e-aebc-4eb7d6d47828","Type":"ContainerDied","Data":"2358931260b36a0fc8f9703ab6b562ec74e218a1cd22bc0c8e65ee7373370fbc"}
Jul 13 17:33:26.600933 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:26.600903    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t846p" event={"ID":"e2c6377b-2866-4d0e-aebc-4eb7d6d47828","Type":"ContainerStarted","Data":"7fc5935ff18bbaafa24e0c43979349120348fbc2e14779c915fb896632002e48"}
Jul 13 17:33:26.601309 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:26.600955    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t846p" event={"ID":"e2c6377b-2866-4d0e-aebc-4eb7d6d47828","Type":"ContainerStarted","Data":"c970a93296156252d351a50d43b9638cdf8cec92d3beeb03afff689a9bec189b"}
Jul 13 17:33:26.624661 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:26.624594    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t846p" podStartSLOduration=3.447699338 podStartE2EDuration="4.624566747s" totalImagesPullingTime="1.110942814s" totalInitContainerRuntime="65.924595ms" isStatefulPod=true podCreationTimestamp="2026-07-13 17:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:26.623748591 +0000 UTC m=+102.136923857" watchObservedRunningTime="2026-07-13 17:33:26.624566747 +0000 UTC m=+102.137742023"
Jul 13 17:33:46.631390 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.631325    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8595949878-fcmz2" podUID="016bb14e-b960-4f80-9386-38229e9839f8" containerName="registry" containerID="cri-o://35c03ae4a61e880e460d2812b30e5d37c3ef78f8fa6cb9af65506d64d4ac1251" gracePeriod=30
Jul 13 17:33:46.871877 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.871846    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:33:46.955846 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.955742    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-bound-sa-token\") pod \"016bb14e-b960-4f80-9386-38229e9839f8\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") "
Jul 13 17:33:46.955846 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.955783    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/016bb14e-b960-4f80-9386-38229e9839f8-trusted-ca\") pod \"016bb14e-b960-4f80-9386-38229e9839f8\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") "
Jul 13 17:33:46.955846 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.955820    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbl98\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-kube-api-access-gbl98\") pod \"016bb14e-b960-4f80-9386-38229e9839f8\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") "
Jul 13 17:33:46.955846 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.955844    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/016bb14e-b960-4f80-9386-38229e9839f8-registry-certificates\") pod \"016bb14e-b960-4f80-9386-38229e9839f8\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") "
Jul 13 17:33:46.956147 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.955882    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/016bb14e-b960-4f80-9386-38229e9839f8-installation-pull-secrets\") pod \"016bb14e-b960-4f80-9386-38229e9839f8\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") "
Jul 13 17:33:46.956147 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.955932    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/016bb14e-b960-4f80-9386-38229e9839f8-ca-trust-extracted\") pod \"016bb14e-b960-4f80-9386-38229e9839f8\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") "
Jul 13 17:33:46.956147 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.956051    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls\") pod \"016bb14e-b960-4f80-9386-38229e9839f8\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") "
Jul 13 17:33:46.956147 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.956120    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/016bb14e-b960-4f80-9386-38229e9839f8-image-registry-private-configuration\") pod \"016bb14e-b960-4f80-9386-38229e9839f8\" (UID: \"016bb14e-b960-4f80-9386-38229e9839f8\") "
Jul 13 17:33:46.956362 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.956342    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/016bb14e-b960-4f80-9386-38229e9839f8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "016bb14e-b960-4f80-9386-38229e9839f8" (UID: "016bb14e-b960-4f80-9386-38229e9839f8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:33:46.956451 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.956436    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/016bb14e-b960-4f80-9386-38229e9839f8-trusted-ca\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:33:46.956593 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.956560    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/016bb14e-b960-4f80-9386-38229e9839f8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "016bb14e-b960-4f80-9386-38229e9839f8" (UID: "016bb14e-b960-4f80-9386-38229e9839f8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:33:46.958582 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.958523    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016bb14e-b960-4f80-9386-38229e9839f8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "016bb14e-b960-4f80-9386-38229e9839f8" (UID: "016bb14e-b960-4f80-9386-38229e9839f8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:33:46.958741 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.958708    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-kube-api-access-gbl98" (OuterVolumeSpecName: "kube-api-access-gbl98") pod "016bb14e-b960-4f80-9386-38229e9839f8" (UID: "016bb14e-b960-4f80-9386-38229e9839f8"). InnerVolumeSpecName "kube-api-access-gbl98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:33:46.958741 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.958714    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/016bb14e-b960-4f80-9386-38229e9839f8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "016bb14e-b960-4f80-9386-38229e9839f8" (UID: "016bb14e-b960-4f80-9386-38229e9839f8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:33:46.958847 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.958790    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "016bb14e-b960-4f80-9386-38229e9839f8" (UID: "016bb14e-b960-4f80-9386-38229e9839f8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:33:46.958914 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.958894    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "016bb14e-b960-4f80-9386-38229e9839f8" (UID: "016bb14e-b960-4f80-9386-38229e9839f8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:33:46.964619 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:46.964593    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/016bb14e-b960-4f80-9386-38229e9839f8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "016bb14e-b960-4f80-9386-38229e9839f8" (UID: "016bb14e-b960-4f80-9386-38229e9839f8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:33:47.057800 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.057756    2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-bound-sa-token\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:33:47.057800 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.057787    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbl98\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-kube-api-access-gbl98\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:33:47.057800 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.057797    2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/016bb14e-b960-4f80-9386-38229e9839f8-registry-certificates\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:33:47.057800 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.057806    2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/016bb14e-b960-4f80-9386-38229e9839f8-installation-pull-secrets\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:33:47.058064 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.057815    2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/016bb14e-b960-4f80-9386-38229e9839f8-ca-trust-extracted\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:33:47.058064 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.057824    2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/016bb14e-b960-4f80-9386-38229e9839f8-registry-tls\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:33:47.058064 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.057834    2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/016bb14e-b960-4f80-9386-38229e9839f8-image-registry-private-configuration\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:33:47.679069 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.679036    2564 generic.go:356] "Generic (PLEG): container finished" podID="62d8c92a-b95e-4cb5-ba78-83f4e808eb65" containerID="3df19f6b5c3736365e655a4a57e5247e8002c3ce1242fea5c9f3333450900d75" exitCode=0
Jul 13 17:33:47.679466 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.679109    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj" event={"ID":"62d8c92a-b95e-4cb5-ba78-83f4e808eb65","Type":"ContainerDied","Data":"3df19f6b5c3736365e655a4a57e5247e8002c3ce1242fea5c9f3333450900d75"}
Jul 13 17:33:47.679521 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.679484    2564 scope.go:117] "RemoveContainer" containerID="3df19f6b5c3736365e655a4a57e5247e8002c3ce1242fea5c9f3333450900d75"
Jul 13 17:33:47.680791 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.680743    2564 generic.go:356] "Generic (PLEG): container finished" podID="329cf01d-c819-4c38-b6d4-7d071e9c0b3f" containerID="ffb4efc627a3fef314e19f61546042f4788059fd8cb202a72178992ebc64a8c7" exitCode=0
Jul 13 17:33:47.680853 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.680805    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf" event={"ID":"329cf01d-c819-4c38-b6d4-7d071e9c0b3f","Type":"ContainerDied","Data":"ffb4efc627a3fef314e19f61546042f4788059fd8cb202a72178992ebc64a8c7"}
Jul 13 17:33:47.681091 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.681072    2564 scope.go:117] "RemoveContainer" containerID="ffb4efc627a3fef314e19f61546042f4788059fd8cb202a72178992ebc64a8c7"
Jul 13 17:33:47.682146 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.682067    2564 generic.go:356] "Generic (PLEG): container finished" podID="016bb14e-b960-4f80-9386-38229e9839f8" containerID="35c03ae4a61e880e460d2812b30e5d37c3ef78f8fa6cb9af65506d64d4ac1251" exitCode=0
Jul 13 17:33:47.682146 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.682121    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8595949878-fcmz2"
Jul 13 17:33:47.682236 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.682180    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8595949878-fcmz2" event={"ID":"016bb14e-b960-4f80-9386-38229e9839f8","Type":"ContainerDied","Data":"35c03ae4a61e880e460d2812b30e5d37c3ef78f8fa6cb9af65506d64d4ac1251"}
Jul 13 17:33:47.682360 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.682224    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8595949878-fcmz2" event={"ID":"016bb14e-b960-4f80-9386-38229e9839f8","Type":"ContainerDied","Data":"2790f0aca1a3319eb4dd3a0045b34c9c511883361a0a9b3502aa1299f3ebe6e3"}
Jul 13 17:33:47.682360 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.682284    2564 scope.go:117] "RemoveContainer" containerID="35c03ae4a61e880e460d2812b30e5d37c3ef78f8fa6cb9af65506d64d4ac1251"
Jul 13 17:33:47.692454 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.692435    2564 scope.go:117] "RemoveContainer" containerID="35c03ae4a61e880e460d2812b30e5d37c3ef78f8fa6cb9af65506d64d4ac1251"
Jul 13 17:33:47.692890 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:33:47.692776    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35c03ae4a61e880e460d2812b30e5d37c3ef78f8fa6cb9af65506d64d4ac1251\": container with ID starting with 35c03ae4a61e880e460d2812b30e5d37c3ef78f8fa6cb9af65506d64d4ac1251 not found: ID does not exist" containerID="35c03ae4a61e880e460d2812b30e5d37c3ef78f8fa6cb9af65506d64d4ac1251"
Jul 13 17:33:47.692890 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.692807    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35c03ae4a61e880e460d2812b30e5d37c3ef78f8fa6cb9af65506d64d4ac1251"} err="failed to get container status \"35c03ae4a61e880e460d2812b30e5d37c3ef78f8fa6cb9af65506d64d4ac1251\": rpc error: code = NotFound desc = could not find container \"35c03ae4a61e880e460d2812b30e5d37c3ef78f8fa6cb9af65506d64d4ac1251\": container with ID starting with 35c03ae4a61e880e460d2812b30e5d37c3ef78f8fa6cb9af65506d64d4ac1251 not found: ID does not exist"
Jul 13 17:33:47.735452 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.735417    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8595949878-fcmz2"]
Jul 13 17:33:47.745030 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:47.745006    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8595949878-fcmz2"]
Jul 13 17:33:48.687042 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:48.687005    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-brczj" event={"ID":"62d8c92a-b95e-4cb5-ba78-83f4e808eb65","Type":"ContainerStarted","Data":"fec603ac32a10025d1e377bdab126b028095fd4a0eb0386b2850ad9c61b386fc"}
Jul 13 17:33:48.688712 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:48.688688    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-5v4vf" event={"ID":"329cf01d-c819-4c38-b6d4-7d071e9c0b3f","Type":"ContainerStarted","Data":"8c04807ffeac883bf2d485fd4a381280cf6e1f6bdb3b297b1e0a6db53620a116"}
Jul 13 17:33:49.009212 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:49.009135    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="016bb14e-b960-4f80-9386-38229e9839f8" path="/var/lib/kubelet/pods/016bb14e-b960-4f80-9386-38229e9839f8/volumes"
Jul 13 17:33:52.704836 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:52.704802    2564 generic.go:356] "Generic (PLEG): container finished" podID="1d2776c4-1aa1-4631-840a-8dbf875b62a8" containerID="79ab37251ce5ce8418a6ed147c41a5b1ca6f2bd03a0454a4a8e17c00331c5f25" exitCode=0
Jul 13 17:33:52.705244 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:52.704874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-s57lt" event={"ID":"1d2776c4-1aa1-4631-840a-8dbf875b62a8","Type":"ContainerDied","Data":"79ab37251ce5ce8418a6ed147c41a5b1ca6f2bd03a0454a4a8e17c00331c5f25"}
Jul 13 17:33:52.705244 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:52.705205    2564 scope.go:117] "RemoveContainer" containerID="79ab37251ce5ce8418a6ed147c41a5b1ca6f2bd03a0454a4a8e17c00331c5f25"
Jul 13 17:33:53.710762 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:53.710724    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-s57lt" event={"ID":"1d2776c4-1aa1-4631-840a-8dbf875b62a8","Type":"ContainerStarted","Data":"39125b89024b4104c160cdf379825bfae0b92c9211c8da6edc80a57205b4cf07"}
Jul 13 17:33:54.927928 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:54.927886    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs\") pod \"network-metrics-daemon-vzwcn\" (UID: \"b049232f-2f86-4a9a-aed5-5c294c59e33d\") " pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:33:54.930250 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:54.930227    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b049232f-2f86-4a9a-aed5-5c294c59e33d-metrics-certs\") pod \"network-metrics-daemon-vzwcn\" (UID: \"b049232f-2f86-4a9a-aed5-5c294c59e33d\") " pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:33:55.223381 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:55.223293    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4jvwf\""
Jul 13 17:33:55.232120 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:55.232092    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzwcn"
Jul 13 17:33:55.373476 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:55.373448    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vzwcn"]
Jul 13 17:33:55.375932 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:33:55.375905    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb049232f_2f86_4a9a_aed5_5c294c59e33d.slice/crio-8508bc3eb2b065d03493b9d2b2b16f9890151cf7f83d2ac70f50849a4a71c369 WatchSource:0}: Error finding container 8508bc3eb2b065d03493b9d2b2b16f9890151cf7f83d2ac70f50849a4a71c369: Status 404 returned error can't find the container with id 8508bc3eb2b065d03493b9d2b2b16f9890151cf7f83d2ac70f50849a4a71c369
Jul 13 17:33:55.720123 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:55.720088    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vzwcn" event={"ID":"b049232f-2f86-4a9a-aed5-5c294c59e33d","Type":"ContainerStarted","Data":"8508bc3eb2b065d03493b9d2b2b16f9890151cf7f83d2ac70f50849a4a71c369"}
Jul 13 17:33:56.726814 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:56.726769    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vzwcn" event={"ID":"b049232f-2f86-4a9a-aed5-5c294c59e33d","Type":"ContainerStarted","Data":"bc788e7f5278e98263bbdf111b6f74789c96f78d7b27c38dfe3ba37167a87cc4"}
Jul 13 17:33:56.727230 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:56.726867    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vzwcn" event={"ID":"b049232f-2f86-4a9a-aed5-5c294c59e33d","Type":"ContainerStarted","Data":"2d091e28aee891e077e6635b83904af7bff25a72f64aa9d41dbb2fa954edb091"}
Jul 13 17:33:56.741635 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:33:56.741586    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vzwcn" podStartSLOduration=130.801209475 podStartE2EDuration="2m11.741569949s" totalImagesPullingTime="940.360474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:33:56.740782958 +0000 UTC m=+132.253958222" watchObservedRunningTime="2026-07-13 17:33:56.741569949 +0000 UTC m=+132.254745246"
Jul 13 17:36:30.231318 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.231263    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"]
Jul 13 17:36:30.231767 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.231561    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016bb14e-b960-4f80-9386-38229e9839f8" containerName="registry"
Jul 13 17:36:30.231767 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.231571    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="016bb14e-b960-4f80-9386-38229e9839f8" containerName="registry"
Jul 13 17:36:30.231767 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.231618    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="016bb14e-b960-4f80-9386-38229e9839f8" containerName="registry"
Jul 13 17:36:30.234490 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.234468    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.236758 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.236734    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 17:36:30.237180 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.237031    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s8bgx\""
Jul 13 17:36:30.237180 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.237035    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 17:36:30.237180 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.237086    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 17:36:30.237465 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.237410    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 17:36:30.250201 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.250164    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"]
Jul 13 17:36:30.341116 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.341067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d7fac46-626a-4eb5-b367-5fb54189570c-webhook-cert\") pod \"opendatahub-operator-controller-manager-59fbf78564-2jfdl\" (UID: \"7d7fac46-626a-4eb5-b367-5fb54189570c\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.341116 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.341108    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d7fac46-626a-4eb5-b367-5fb54189570c-tmp\") pod \"opendatahub-operator-controller-manager-59fbf78564-2jfdl\" (UID: \"7d7fac46-626a-4eb5-b367-5fb54189570c\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.341360 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.341129    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7d7fac46-626a-4eb5-b367-5fb54189570c-manifests\") pod \"opendatahub-operator-controller-manager-59fbf78564-2jfdl\" (UID: \"7d7fac46-626a-4eb5-b367-5fb54189570c\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.341360 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.341197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c882m\" (UniqueName: \"kubernetes.io/projected/7d7fac46-626a-4eb5-b367-5fb54189570c-kube-api-access-c882m\") pod \"opendatahub-operator-controller-manager-59fbf78564-2jfdl\" (UID: \"7d7fac46-626a-4eb5-b367-5fb54189570c\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.341360 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.341221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7d7fac46-626a-4eb5-b367-5fb54189570c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59fbf78564-2jfdl\" (UID: \"7d7fac46-626a-4eb5-b367-5fb54189570c\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.442456 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.442425    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d7fac46-626a-4eb5-b367-5fb54189570c-webhook-cert\") pod \"opendatahub-operator-controller-manager-59fbf78564-2jfdl\" (UID: \"7d7fac46-626a-4eb5-b367-5fb54189570c\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.442456 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.442461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d7fac46-626a-4eb5-b367-5fb54189570c-tmp\") pod \"opendatahub-operator-controller-manager-59fbf78564-2jfdl\" (UID: \"7d7fac46-626a-4eb5-b367-5fb54189570c\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.442728 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.442477    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7d7fac46-626a-4eb5-b367-5fb54189570c-manifests\") pod \"opendatahub-operator-controller-manager-59fbf78564-2jfdl\" (UID: \"7d7fac46-626a-4eb5-b367-5fb54189570c\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.442728 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.442502    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c882m\" (UniqueName: \"kubernetes.io/projected/7d7fac46-626a-4eb5-b367-5fb54189570c-kube-api-access-c882m\") pod \"opendatahub-operator-controller-manager-59fbf78564-2jfdl\" (UID: \"7d7fac46-626a-4eb5-b367-5fb54189570c\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.442728 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.442521    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7d7fac46-626a-4eb5-b367-5fb54189570c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59fbf78564-2jfdl\" (UID: \"7d7fac46-626a-4eb5-b367-5fb54189570c\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.442882 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.442862    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7d7fac46-626a-4eb5-b367-5fb54189570c-manifests\") pod \"opendatahub-operator-controller-manager-59fbf78564-2jfdl\" (UID: \"7d7fac46-626a-4eb5-b367-5fb54189570c\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.444935 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.444910    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d7fac46-626a-4eb5-b367-5fb54189570c-tmp\") pod \"opendatahub-operator-controller-manager-59fbf78564-2jfdl\" (UID: \"7d7fac46-626a-4eb5-b367-5fb54189570c\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.445166 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.445149    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d7fac46-626a-4eb5-b367-5fb54189570c-webhook-cert\") pod \"opendatahub-operator-controller-manager-59fbf78564-2jfdl\" (UID: \"7d7fac46-626a-4eb5-b367-5fb54189570c\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.445643 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.445626    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7d7fac46-626a-4eb5-b367-5fb54189570c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-59fbf78564-2jfdl\" (UID: \"7d7fac46-626a-4eb5-b367-5fb54189570c\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.450180 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.450154    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c882m\" (UniqueName: \"kubernetes.io/projected/7d7fac46-626a-4eb5-b367-5fb54189570c-kube-api-access-c882m\") pod \"opendatahub-operator-controller-manager-59fbf78564-2jfdl\" (UID: \"7d7fac46-626a-4eb5-b367-5fb54189570c\") " pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.544912 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.544820    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:30.692313 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:30.692257    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"]
Jul 13 17:36:30.695822 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:36:30.695780    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d7fac46_626a_4eb5_b367_5fb54189570c.slice/crio-84e65265e4fc8087e3ff1933660e833d4e9f44df1cdef254dd68101ccb71a976 WatchSource:0}: Error finding container 84e65265e4fc8087e3ff1933660e833d4e9f44df1cdef254dd68101ccb71a976: Status 404 returned error can't find the container with id 84e65265e4fc8087e3ff1933660e833d4e9f44df1cdef254dd68101ccb71a976
Jul 13 17:36:31.293253 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:31.293216    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl" event={"ID":"7d7fac46-626a-4eb5-b367-5fb54189570c","Type":"ContainerStarted","Data":"84e65265e4fc8087e3ff1933660e833d4e9f44df1cdef254dd68101ccb71a976"}
Jul 13 17:36:34.309086 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:34.308987    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl" event={"ID":"7d7fac46-626a-4eb5-b367-5fb54189570c","Type":"ContainerStarted","Data":"9cc1c8bfeede03a0d53a5ed1cf9503f98f34a30d50b0d70e691454b4dad22141"}
Jul 13 17:36:35.314777 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:35.314686    2564 generic.go:356] "Generic (PLEG): container finished" podID="7d7fac46-626a-4eb5-b367-5fb54189570c" containerID="9cc1c8bfeede03a0d53a5ed1cf9503f98f34a30d50b0d70e691454b4dad22141" exitCode=0
Jul 13 17:36:35.314777 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:35.314752    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl" event={"ID":"7d7fac46-626a-4eb5-b367-5fb54189570c","Type":"ContainerDied","Data":"9cc1c8bfeede03a0d53a5ed1cf9503f98f34a30d50b0d70e691454b4dad22141"}
Jul 13 17:36:36.320991 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:36.320950    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl" event={"ID":"7d7fac46-626a-4eb5-b367-5fb54189570c","Type":"ContainerStarted","Data":"33e48b205f515b39ae9df56d3eaea65961899a1ef9101109b3d83218005abd82"}
Jul 13 17:36:36.321435 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:36.321087    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:36.340877 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:36.340811    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl" podStartSLOduration=1.652244839 podStartE2EDuration="6.340789145s" totalImagesPullingTime="3.683325826s" totalInitContainerRuntime="1.00521848s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:36:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:36:36.338898637 +0000 UTC m=+291.852073902" watchObservedRunningTime="2026-07-13 17:36:36.340789145 +0000 UTC m=+291.853964413"
Jul 13 17:36:44.909188 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:44.909157    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 17:36:44.912578 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:44.912550    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 17:36:44.928299 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:44.928245    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 17:36:47.327728 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:47.327694    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-59fbf78564-2jfdl"
Jul 13 17:36:50.217092 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.217055    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd"]
Jul 13 17:36:50.219770 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.219746    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd"
Jul 13 17:36:50.222405 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.222377    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 13 17:36:50.223264 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.223238    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 13 17:36:50.223755 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.223729    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xvp8d\""
Jul 13 17:36:50.270104 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.270065    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd"]
Jul 13 17:36:50.303879 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.303841    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e78b1508-5797-43e1-889f-27fc54efcd2d-tmp\") pod \"kube-auth-proxy-545dc9d9cd-ppxzd\" (UID: \"e78b1508-5797-43e1-889f-27fc54efcd2d\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd"
Jul 13 17:36:50.304044 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.303909    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e78b1508-5797-43e1-889f-27fc54efcd2d-tls-certs\") pod \"kube-auth-proxy-545dc9d9cd-ppxzd\" (UID: \"e78b1508-5797-43e1-889f-27fc54efcd2d\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd"
Jul 13 17:36:50.304044 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.303982    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94wrn\" (UniqueName: \"kubernetes.io/projected/e78b1508-5797-43e1-889f-27fc54efcd2d-kube-api-access-94wrn\") pod \"kube-auth-proxy-545dc9d9cd-ppxzd\" (UID: \"e78b1508-5797-43e1-889f-27fc54efcd2d\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd"
Jul 13 17:36:50.379949 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.379917    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vtfm4"]
Jul 13 17:36:50.382242 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.382224    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vtfm4"
Jul 13 17:36:50.386084 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.386060    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 13 17:36:50.386233 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.386202    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-c8vqq\""
Jul 13 17:36:50.398855 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.398828    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vtfm4"]
Jul 13 17:36:50.405101 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.405068    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e78b1508-5797-43e1-889f-27fc54efcd2d-tmp\") pod \"kube-auth-proxy-545dc9d9cd-ppxzd\" (UID: \"e78b1508-5797-43e1-889f-27fc54efcd2d\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd"
Jul 13 17:36:50.405291 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.405164    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2gwt\" (UniqueName: \"kubernetes.io/projected/36c737ac-b0b4-4777-aad6-e252dc3536e0-kube-api-access-v2gwt\") pod \"odh-model-controller-7998c67dc4-vtfm4\" (UID: \"36c737ac-b0b4-4777-aad6-e252dc3536e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-vtfm4"
Jul 13 17:36:50.405291 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.405196    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e78b1508-5797-43e1-889f-27fc54efcd2d-tls-certs\") pod \"kube-auth-proxy-545dc9d9cd-ppxzd\" (UID: \"e78b1508-5797-43e1-889f-27fc54efcd2d\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd"
Jul 13 17:36:50.405291 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.405231    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36c737ac-b0b4-4777-aad6-e252dc3536e0-cert\") pod \"odh-model-controller-7998c67dc4-vtfm4\" (UID: \"36c737ac-b0b4-4777-aad6-e252dc3536e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-vtfm4"
Jul 13 17:36:50.405466 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.405304    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94wrn\" (UniqueName: \"kubernetes.io/projected/e78b1508-5797-43e1-889f-27fc54efcd2d-kube-api-access-94wrn\") pod \"kube-auth-proxy-545dc9d9cd-ppxzd\" (UID: \"e78b1508-5797-43e1-889f-27fc54efcd2d\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd"
Jul 13 17:36:50.407980 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.407955    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e78b1508-5797-43e1-889f-27fc54efcd2d-tmp\") pod \"kube-auth-proxy-545dc9d9cd-ppxzd\" (UID: \"e78b1508-5797-43e1-889f-27fc54efcd2d\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd"
Jul 13 17:36:50.408522 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.408502    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e78b1508-5797-43e1-889f-27fc54efcd2d-tls-certs\") pod \"kube-auth-proxy-545dc9d9cd-ppxzd\" (UID: \"e78b1508-5797-43e1-889f-27fc54efcd2d\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd"
Jul 13 17:36:50.417534 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.417484    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94wrn\" (UniqueName: \"kubernetes.io/projected/e78b1508-5797-43e1-889f-27fc54efcd2d-kube-api-access-94wrn\") pod \"kube-auth-proxy-545dc9d9cd-ppxzd\" (UID: \"e78b1508-5797-43e1-889f-27fc54efcd2d\") " pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd"
Jul 13 17:36:50.505907 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.505798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2gwt\" (UniqueName: \"kubernetes.io/projected/36c737ac-b0b4-4777-aad6-e252dc3536e0-kube-api-access-v2gwt\") pod \"odh-model-controller-7998c67dc4-vtfm4\" (UID: \"36c737ac-b0b4-4777-aad6-e252dc3536e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-vtfm4"
Jul 13 17:36:50.505907 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.505848    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36c737ac-b0b4-4777-aad6-e252dc3536e0-cert\") pod \"odh-model-controller-7998c67dc4-vtfm4\" (UID: \"36c737ac-b0b4-4777-aad6-e252dc3536e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-vtfm4"
Jul 13 17:36:50.506138 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:36:50.505952    2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 13 17:36:50.506138 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:36:50.506016    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c737ac-b0b4-4777-aad6-e252dc3536e0-cert podName:36c737ac-b0b4-4777-aad6-e252dc3536e0 nodeName:}" failed. No retries permitted until 2026-07-13 17:36:51.00599728 +0000 UTC m=+306.519172543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/36c737ac-b0b4-4777-aad6-e252dc3536e0-cert") pod "odh-model-controller-7998c67dc4-vtfm4" (UID: "36c737ac-b0b4-4777-aad6-e252dc3536e0") : secret "odh-model-controller-webhook-cert" not found
Jul 13 17:36:50.516938 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.516901    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2gwt\" (UniqueName: \"kubernetes.io/projected/36c737ac-b0b4-4777-aad6-e252dc3536e0-kube-api-access-v2gwt\") pod \"odh-model-controller-7998c67dc4-vtfm4\" (UID: \"36c737ac-b0b4-4777-aad6-e252dc3536e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-vtfm4"
Jul 13 17:36:50.529592 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.529556    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd"
Jul 13 17:36:50.670470 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.670434    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd"]
Jul 13 17:36:50.673624 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:36:50.673579    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78b1508_5797_43e1_889f_27fc54efcd2d.slice/crio-2d33eed0f4df966683c3b94518229c46da7ece4be5a5521b8564434e44bfff83 WatchSource:0}: Error finding container 2d33eed0f4df966683c3b94518229c46da7ece4be5a5521b8564434e44bfff83: Status 404 returned error can't find the container with id 2d33eed0f4df966683c3b94518229c46da7ece4be5a5521b8564434e44bfff83
Jul 13 17:36:50.675567 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:50.675549    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:36:51.008889 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.008854    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36c737ac-b0b4-4777-aad6-e252dc3536e0-cert\") pod \"odh-model-controller-7998c67dc4-vtfm4\" (UID: \"36c737ac-b0b4-4777-aad6-e252dc3536e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-vtfm4"
Jul 13 17:36:51.009071 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:36:51.008996    2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 13 17:36:51.009071 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:36:51.009051    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36c737ac-b0b4-4777-aad6-e252dc3536e0-cert podName:36c737ac-b0b4-4777-aad6-e252dc3536e0 nodeName:}" failed. No retries permitted until 2026-07-13 17:36:52.009036457 +0000 UTC m=+307.522211700 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/36c737ac-b0b4-4777-aad6-e252dc3536e0-cert") pod "odh-model-controller-7998c67dc4-vtfm4" (UID: "36c737ac-b0b4-4777-aad6-e252dc3536e0") : secret "odh-model-controller-webhook-cert" not found
Jul 13 17:36:51.189094 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.189051    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qtcg6"]
Jul 13 17:36:51.193142 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.193117    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qtcg6"
Jul 13 17:36:51.195230 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.195209    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 13 17:36:51.195379 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.195237    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-bhrjd\""
Jul 13 17:36:51.200760 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.200685    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qtcg6"]
Jul 13 17:36:51.211358 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.211330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7df6d337-3a48-47a9-ac5c-337b0c82214f-tls-certs\") pod \"model-serving-api-54d89bd5fc-qtcg6\" (UID: \"7df6d337-3a48-47a9-ac5c-337b0c82214f\") " pod="opendatahub/model-serving-api-54d89bd5fc-qtcg6"
Jul 13 17:36:51.211518 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.211381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk459\" (UniqueName: \"kubernetes.io/projected/7df6d337-3a48-47a9-ac5c-337b0c82214f-kube-api-access-qk459\") pod \"model-serving-api-54d89bd5fc-qtcg6\" (UID: \"7df6d337-3a48-47a9-ac5c-337b0c82214f\") " pod="opendatahub/model-serving-api-54d89bd5fc-qtcg6"
Jul 13 17:36:51.312289 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.312189    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7df6d337-3a48-47a9-ac5c-337b0c82214f-tls-certs\") pod \"model-serving-api-54d89bd5fc-qtcg6\" (UID: \"7df6d337-3a48-47a9-ac5c-337b0c82214f\") " pod="opendatahub/model-serving-api-54d89bd5fc-qtcg6"
Jul 13 17:36:51.312289 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.312251    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk459\" (UniqueName: \"kubernetes.io/projected/7df6d337-3a48-47a9-ac5c-337b0c82214f-kube-api-access-qk459\") pod \"model-serving-api-54d89bd5fc-qtcg6\" (UID: \"7df6d337-3a48-47a9-ac5c-337b0c82214f\") " pod="opendatahub/model-serving-api-54d89bd5fc-qtcg6"
Jul 13 17:36:51.314622 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.314602    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7df6d337-3a48-47a9-ac5c-337b0c82214f-tls-certs\") pod \"model-serving-api-54d89bd5fc-qtcg6\" (UID: \"7df6d337-3a48-47a9-ac5c-337b0c82214f\") " pod="opendatahub/model-serving-api-54d89bd5fc-qtcg6"
Jul 13 17:36:51.321002 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.320978    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk459\" (UniqueName: \"kubernetes.io/projected/7df6d337-3a48-47a9-ac5c-337b0c82214f-kube-api-access-qk459\") pod \"model-serving-api-54d89bd5fc-qtcg6\" (UID: \"7df6d337-3a48-47a9-ac5c-337b0c82214f\") " pod="opendatahub/model-serving-api-54d89bd5fc-qtcg6"
Jul 13 17:36:51.325552 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.325526    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"]
Jul 13 17:36:51.328599 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.328581    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.330730 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.330700    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 13 17:36:51.330840 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.330739    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 13 17:36:51.330840 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.330744    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 13 17:36:51.330840 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.330743    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 17:36:51.330840 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.330838    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5qfzb\""
Jul 13 17:36:51.339941 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.339916    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"]
Jul 13 17:36:51.382825 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.382781    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd" event={"ID":"e78b1508-5797-43e1-889f-27fc54efcd2d","Type":"ContainerStarted","Data":"2d33eed0f4df966683c3b94518229c46da7ece4be5a5521b8564434e44bfff83"}
Jul 13 17:36:51.413110 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.413072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-token\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.413110 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.413111    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.413345 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.413136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.413345 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.413201    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6m47\" (UniqueName: \"kubernetes.io/projected/e079a3a1-6869-4f66-a77a-dcc207298fd1-kube-api-access-s6m47\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.413345 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.413257    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.413345 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.413323    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e079a3a1-6869-4f66-a77a-dcc207298fd1-local-certs\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.413487 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.413352    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-cacerts\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.504069 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.504036    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qtcg6"
Jul 13 17:36:51.514001 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.513977    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e079a3a1-6869-4f66-a77a-dcc207298fd1-local-certs\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.514071 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.514015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-cacerts\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.514071 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.514059    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-token\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.514168 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.514083    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.514168 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.514130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.514289 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.514182    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6m47\" (UniqueName: \"kubernetes.io/projected/e079a3a1-6869-4f66-a77a-dcc207298fd1-kube-api-access-s6m47\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.514289 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.514215    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.515326 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.515297    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.516858 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.516780    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e079a3a1-6869-4f66-a77a-dcc207298fd1-local-certs\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.517530 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.517503    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.517681 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.517636    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-cacerts\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.517908 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.517888    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.522880 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.522855    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6m47\" (UniqueName: \"kubernetes.io/projected/e079a3a1-6869-4f66-a77a-dcc207298fd1-kube-api-access-s6m47\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.523056 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.523039    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-token\") pod \"istiod-openshift-gateway-7574459656-9s7kw\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.638130 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.638092    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:51.665352 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.665320    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qtcg6"]
Jul 13 17:36:51.668324 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:36:51.668296    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df6d337_3a48_47a9_ac5c_337b0c82214f.slice/crio-50916644d6ced9da40d203c1bc23b01423919299cf3ea270c7a257c0761c1847 WatchSource:0}: Error finding container 50916644d6ced9da40d203c1bc23b01423919299cf3ea270c7a257c0761c1847: Status 404 returned error can't find the container with id 50916644d6ced9da40d203c1bc23b01423919299cf3ea270c7a257c0761c1847
Jul 13 17:36:51.822386 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:51.822294    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"]
Jul 13 17:36:51.826571 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:36:51.826532    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode079a3a1_6869_4f66_a77a_dcc207298fd1.slice/crio-7be90c04ecf5f0887b6111153c4db9b3b177ee7d8631b732aa08911d1ee90cee WatchSource:0}: Error finding container 7be90c04ecf5f0887b6111153c4db9b3b177ee7d8631b732aa08911d1ee90cee: Status 404 returned error can't find the container with id 7be90c04ecf5f0887b6111153c4db9b3b177ee7d8631b732aa08911d1ee90cee
Jul 13 17:36:52.018595 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:52.018546    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36c737ac-b0b4-4777-aad6-e252dc3536e0-cert\") pod \"odh-model-controller-7998c67dc4-vtfm4\" (UID: \"36c737ac-b0b4-4777-aad6-e252dc3536e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-vtfm4"
Jul 13 17:36:52.020923 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:52.020898    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36c737ac-b0b4-4777-aad6-e252dc3536e0-cert\") pod \"odh-model-controller-7998c67dc4-vtfm4\" (UID: \"36c737ac-b0b4-4777-aad6-e252dc3536e0\") " pod="opendatahub/odh-model-controller-7998c67dc4-vtfm4"
Jul 13 17:36:52.194681 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:52.193806    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vtfm4"
Jul 13 17:36:52.347952 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:52.347901    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vtfm4"]
Jul 13 17:36:52.389973 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:52.389924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vtfm4" event={"ID":"36c737ac-b0b4-4777-aad6-e252dc3536e0","Type":"ContainerStarted","Data":"5ab248f58746ae09b87cbec54c851eadbe79300a7aba2f0947ac5a181423ba22"}
Jul 13 17:36:52.391794 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:52.391750    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw" event={"ID":"e079a3a1-6869-4f66-a77a-dcc207298fd1","Type":"ContainerStarted","Data":"7be90c04ecf5f0887b6111153c4db9b3b177ee7d8631b732aa08911d1ee90cee"}
Jul 13 17:36:52.393337 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:52.393310    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qtcg6" event={"ID":"7df6d337-3a48-47a9-ac5c-337b0c82214f","Type":"ContainerStarted","Data":"50916644d6ced9da40d203c1bc23b01423919299cf3ea270c7a257c0761c1847"}
Jul 13 17:36:56.836032 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:56.835986    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Jul 13 17:36:56.836472 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:56.836074    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Jul 13 17:36:57.423666 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:57.423625    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw" event={"ID":"e079a3a1-6869-4f66-a77a-dcc207298fd1","Type":"ContainerStarted","Data":"f87788350b114d4a0ac3f27f0430e3ec5c34fea203829fa176eb627e48c3cb2e"}
Jul 13 17:36:57.423850 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:57.423793    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:36:57.425528 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:57.425484    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qtcg6" event={"ID":"7df6d337-3a48-47a9-ac5c-337b0c82214f","Type":"ContainerStarted","Data":"b5fe1a2e7a1996836e5cadbd93cc60c5142e52a28d24c59053a8f9098dcefdc2"}
Jul 13 17:36:57.425696 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:57.425646    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qtcg6"
Jul 13 17:36:57.425841 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:57.425819    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-9s7kw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 17:36:57.425923 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:57.425865    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw" podUID="e079a3a1-6869-4f66-a77a-dcc207298fd1" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 17:36:57.427327 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:57.427300    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd" event={"ID":"e78b1508-5797-43e1-889f-27fc54efcd2d","Type":"ContainerStarted","Data":"fc18c6f7c42cce73906d373532089beecba4f9c3ef8680fec4ab664b35fb7c74"}
Jul 13 17:36:57.428941 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:57.428917    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vtfm4" event={"ID":"36c737ac-b0b4-4777-aad6-e252dc3536e0","Type":"ContainerStarted","Data":"eead0f79ac2e743db83d0b402f5754761e9d265e9a5ef115658f568e8ac08f43"}
Jul 13 17:36:57.429083 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:57.429063    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-vtfm4"
Jul 13 17:36:57.442994 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:57.442913    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw" podStartSLOduration=1.435987857 podStartE2EDuration="6.442892522s" totalImagesPullingTime="5.006904665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:36:57.441931023 +0000 UTC m=+312.955106290" watchObservedRunningTime="2026-07-13 17:36:57.442892522 +0000 UTC m=+312.956067788"
Jul 13 17:36:57.456539 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:57.456459    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-vtfm4" podStartSLOduration=2.906339316 podStartE2EDuration="7.456435435s" totalImagesPullingTime="4.550096119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:36:57.456128192 +0000 UTC m=+312.969303483" watchObservedRunningTime="2026-07-13 17:36:57.456435435 +0000 UTC m=+312.969610701"
Jul 13 17:36:57.472991 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:57.472926    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qtcg6" podStartSLOduration=1.307687332 podStartE2EDuration="6.472902803s" totalImagesPullingTime="5.165215471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:36:57.471720553 +0000 UTC m=+312.984895801" watchObservedRunningTime="2026-07-13 17:36:57.472902803 +0000 UTC m=+312.986078071"
Jul 13 17:36:57.486800 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:57.486731    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-545dc9d9cd-ppxzd" podStartSLOduration=1.326648056 podStartE2EDuration="7.486709058s" totalImagesPullingTime="6.160061002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:36:57.485570793 +0000 UTC m=+312.998746095" watchObservedRunningTime="2026-07-13 17:36:57.486709058 +0000 UTC m=+312.999884324"
Jul 13 17:36:58.435895 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:58.435859    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-9s7kw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 17:36:58.436372 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:36:58.435916    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw" podUID="e079a3a1-6869-4f66-a77a-dcc207298fd1" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 17:37:01.263634 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.263598    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"]
Jul 13 17:37:01.267224 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.267185    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:37:01.270110 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.270085    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 17:37:01.271340 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.271310    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 13 17:37:01.271481 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.271370    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 17:37:01.271534 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.271521    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qbdvt\""
Jul 13 17:37:01.271655 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.271314    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 13 17:37:01.271721 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.271337    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 13 17:37:01.282512 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.282483    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"]
Jul 13 17:37:01.301731 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.301697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9aca23fd-aaad-4a23-b0c2-fdbff378efc1-metrics-cert\") pod \"lws-controller-manager-84567cbc5f-m4959\" (UID: \"9aca23fd-aaad-4a23-b0c2-fdbff378efc1\") " pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:37:01.301899 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.301801    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9aca23fd-aaad-4a23-b0c2-fdbff378efc1-manager-config\") pod \"lws-controller-manager-84567cbc5f-m4959\" (UID: \"9aca23fd-aaad-4a23-b0c2-fdbff378efc1\") " pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:37:01.301899 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.301879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpzmz\" (UniqueName: \"kubernetes.io/projected/9aca23fd-aaad-4a23-b0c2-fdbff378efc1-kube-api-access-kpzmz\") pod \"lws-controller-manager-84567cbc5f-m4959\" (UID: \"9aca23fd-aaad-4a23-b0c2-fdbff378efc1\") " pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:37:01.301970 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.301913    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9aca23fd-aaad-4a23-b0c2-fdbff378efc1-cert\") pod \"lws-controller-manager-84567cbc5f-m4959\" (UID: \"9aca23fd-aaad-4a23-b0c2-fdbff378efc1\") " pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:37:01.403071 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.403026    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9aca23fd-aaad-4a23-b0c2-fdbff378efc1-cert\") pod \"lws-controller-manager-84567cbc5f-m4959\" (UID: \"9aca23fd-aaad-4a23-b0c2-fdbff378efc1\") " pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:37:01.403255 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.403087    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9aca23fd-aaad-4a23-b0c2-fdbff378efc1-metrics-cert\") pod \"lws-controller-manager-84567cbc5f-m4959\" (UID: \"9aca23fd-aaad-4a23-b0c2-fdbff378efc1\") " pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:37:01.403339 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.403264    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9aca23fd-aaad-4a23-b0c2-fdbff378efc1-manager-config\") pod \"lws-controller-manager-84567cbc5f-m4959\" (UID: \"9aca23fd-aaad-4a23-b0c2-fdbff378efc1\") " pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:37:01.403381 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.403351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpzmz\" (UniqueName: \"kubernetes.io/projected/9aca23fd-aaad-4a23-b0c2-fdbff378efc1-kube-api-access-kpzmz\") pod \"lws-controller-manager-84567cbc5f-m4959\" (UID: \"9aca23fd-aaad-4a23-b0c2-fdbff378efc1\") " pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:37:01.403933 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.403912    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9aca23fd-aaad-4a23-b0c2-fdbff378efc1-manager-config\") pod \"lws-controller-manager-84567cbc5f-m4959\" (UID: \"9aca23fd-aaad-4a23-b0c2-fdbff378efc1\") " pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:37:01.405813 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.405790    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9aca23fd-aaad-4a23-b0c2-fdbff378efc1-cert\") pod \"lws-controller-manager-84567cbc5f-m4959\" (UID: \"9aca23fd-aaad-4a23-b0c2-fdbff378efc1\") " pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:37:01.405923 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.405826    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9aca23fd-aaad-4a23-b0c2-fdbff378efc1-metrics-cert\") pod \"lws-controller-manager-84567cbc5f-m4959\" (UID: \"9aca23fd-aaad-4a23-b0c2-fdbff378efc1\") " pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:37:01.414422 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.414393    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpzmz\" (UniqueName: \"kubernetes.io/projected/9aca23fd-aaad-4a23-b0c2-fdbff378efc1-kube-api-access-kpzmz\") pod \"lws-controller-manager-84567cbc5f-m4959\" (UID: \"9aca23fd-aaad-4a23-b0c2-fdbff378efc1\") " pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:37:01.436408 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.436372    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:37:01.584128 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.584096    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:37:01.777854 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:01.777826    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"]
Jul 13 17:37:01.780792 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:37:01.780760    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aca23fd_aaad_4a23_b0c2_fdbff378efc1.slice/crio-4c9c392d80bd7593054218dd7d87df57470cc37a4841944b38b98812c6304a82 WatchSource:0}: Error finding container 4c9c392d80bd7593054218dd7d87df57470cc37a4841944b38b98812c6304a82: Status 404 returned error can't find the container with id 4c9c392d80bd7593054218dd7d87df57470cc37a4841944b38b98812c6304a82
Jul 13 17:37:02.452152 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:02.452116    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959" event={"ID":"9aca23fd-aaad-4a23-b0c2-fdbff378efc1","Type":"ContainerStarted","Data":"4c9c392d80bd7593054218dd7d87df57470cc37a4841944b38b98812c6304a82"}
Jul 13 17:37:04.462927 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.462897    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959" event={"ID":"9aca23fd-aaad-4a23-b0c2-fdbff378efc1","Type":"ContainerStarted","Data":"fae3415f4833bd0e0cadf1a1cfc03c852efa335bb216c3d076c55296b53a0849"}
Jul 13 17:37:04.463325 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.462957    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:37:04.479185 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.479129    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959" podStartSLOduration=1.02699167 podStartE2EDuration="3.479110325s" totalImagesPullingTime="2.452118655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:37:04.477928372 +0000 UTC m=+319.991103660" watchObservedRunningTime="2026-07-13 17:37:04.479110325 +0000 UTC m=+319.992285590"
Jul 13 17:37:04.640390 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.640352    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"]
Jul 13 17:37:04.640603 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.640549    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw" podUID="e079a3a1-6869-4f66-a77a-dcc207298fd1" containerName="discovery" containerID="cri-o://f87788350b114d4a0ac3f27f0430e3ec5c34fea203829fa176eb627e48c3cb2e" gracePeriod=30
Jul 13 17:37:04.887385 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.887351    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:37:04.938219 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.938124    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-token\") pod \"e079a3a1-6869-4f66-a77a-dcc207298fd1\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") "
Jul 13 17:37:04.938219 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.938169    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-csr-ca-configmap\") pod \"e079a3a1-6869-4f66-a77a-dcc207298fd1\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") "
Jul 13 17:37:04.938219 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.938211    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6m47\" (UniqueName: \"kubernetes.io/projected/e079a3a1-6869-4f66-a77a-dcc207298fd1-kube-api-access-s6m47\") pod \"e079a3a1-6869-4f66-a77a-dcc207298fd1\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") "
Jul 13 17:37:04.938538 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.938336    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-kubeconfig\") pod \"e079a3a1-6869-4f66-a77a-dcc207298fd1\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") "
Jul 13 17:37:04.938538 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.938439    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-csr-dns-cert\") pod \"e079a3a1-6869-4f66-a77a-dcc207298fd1\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") "
Jul 13 17:37:04.938538 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.938482    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-cacerts\") pod \"e079a3a1-6869-4f66-a77a-dcc207298fd1\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") "
Jul 13 17:37:04.938538 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.938523    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e079a3a1-6869-4f66-a77a-dcc207298fd1-local-certs\") pod \"e079a3a1-6869-4f66-a77a-dcc207298fd1\" (UID: \"e079a3a1-6869-4f66-a77a-dcc207298fd1\") "
Jul 13 17:37:04.938789 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.938650    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e079a3a1-6869-4f66-a77a-dcc207298fd1" (UID: "e079a3a1-6869-4f66-a77a-dcc207298fd1"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 17:37:04.938847 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.938788    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-csr-ca-configmap\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:37:04.940997 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.940945    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e079a3a1-6869-4f66-a77a-dcc207298fd1-local-certs" (OuterVolumeSpecName: "local-certs") pod "e079a3a1-6869-4f66-a77a-dcc207298fd1" (UID: "e079a3a1-6869-4f66-a77a-dcc207298fd1"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 17:37:04.941131 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.941006    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e079a3a1-6869-4f66-a77a-dcc207298fd1" (UID: "e079a3a1-6869-4f66-a77a-dcc207298fd1"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:37:04.941131 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.941045    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-cacerts" (OuterVolumeSpecName: "cacerts") pod "e079a3a1-6869-4f66-a77a-dcc207298fd1" (UID: "e079a3a1-6869-4f66-a77a-dcc207298fd1"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:37:04.941131 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.941058    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e079a3a1-6869-4f66-a77a-dcc207298fd1-kube-api-access-s6m47" (OuterVolumeSpecName: "kube-api-access-s6m47") pod "e079a3a1-6869-4f66-a77a-dcc207298fd1" (UID: "e079a3a1-6869-4f66-a77a-dcc207298fd1"). InnerVolumeSpecName "kube-api-access-s6m47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:37:04.941131 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.941093    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-token" (OuterVolumeSpecName: "istio-token") pod "e079a3a1-6869-4f66-a77a-dcc207298fd1" (UID: "e079a3a1-6869-4f66-a77a-dcc207298fd1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:37:04.941294 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:04.941136    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e079a3a1-6869-4f66-a77a-dcc207298fd1" (UID: "e079a3a1-6869-4f66-a77a-dcc207298fd1"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 17:37:05.040227 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:05.040193    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-token\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:37:05.040227 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:05.040224    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6m47\" (UniqueName: \"kubernetes.io/projected/e079a3a1-6869-4f66-a77a-dcc207298fd1-kube-api-access-s6m47\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:37:05.040227 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:05.040236    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-kubeconfig\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:37:05.040539 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:05.040249    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-istio-csr-dns-cert\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:37:05.040539 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:05.040262    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e079a3a1-6869-4f66-a77a-dcc207298fd1-cacerts\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:37:05.040539 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:05.040296    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e079a3a1-6869-4f66-a77a-dcc207298fd1-local-certs\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:37:05.467874 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:05.467839    2564 generic.go:356] "Generic (PLEG): container finished" podID="e079a3a1-6869-4f66-a77a-dcc207298fd1" containerID="f87788350b114d4a0ac3f27f0430e3ec5c34fea203829fa176eb627e48c3cb2e" exitCode=0
Jul 13 17:37:05.468260 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:05.467896    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"
Jul 13 17:37:05.468260 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:05.467919    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw" event={"ID":"e079a3a1-6869-4f66-a77a-dcc207298fd1","Type":"ContainerDied","Data":"f87788350b114d4a0ac3f27f0430e3ec5c34fea203829fa176eb627e48c3cb2e"}
Jul 13 17:37:05.468260 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:05.467969    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw" event={"ID":"e079a3a1-6869-4f66-a77a-dcc207298fd1","Type":"ContainerDied","Data":"7be90c04ecf5f0887b6111153c4db9b3b177ee7d8631b732aa08911d1ee90cee"}
Jul 13 17:37:05.468260 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:05.467990    2564 scope.go:117] "RemoveContainer" containerID="f87788350b114d4a0ac3f27f0430e3ec5c34fea203829fa176eb627e48c3cb2e"
Jul 13 17:37:05.476870 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:05.476848    2564 scope.go:117] "RemoveContainer" containerID="f87788350b114d4a0ac3f27f0430e3ec5c34fea203829fa176eb627e48c3cb2e"
Jul 13 17:37:05.477156 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:37:05.477137    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f87788350b114d4a0ac3f27f0430e3ec5c34fea203829fa176eb627e48c3cb2e\": container with ID starting with f87788350b114d4a0ac3f27f0430e3ec5c34fea203829fa176eb627e48c3cb2e not found: ID does not exist" containerID="f87788350b114d4a0ac3f27f0430e3ec5c34fea203829fa176eb627e48c3cb2e"
Jul 13 17:37:05.477210 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:05.477165    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f87788350b114d4a0ac3f27f0430e3ec5c34fea203829fa176eb627e48c3cb2e"} err="failed to get container status \"f87788350b114d4a0ac3f27f0430e3ec5c34fea203829fa176eb627e48c3cb2e\": rpc error: code = NotFound desc = could not find container \"f87788350b114d4a0ac3f27f0430e3ec5c34fea203829fa176eb627e48c3cb2e\": container with ID starting with f87788350b114d4a0ac3f27f0430e3ec5c34fea203829fa176eb627e48c3cb2e not found: ID does not exist"
Jul 13 17:37:05.486454 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:05.486419    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"]
Jul 13 17:37:05.490336 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:05.490306    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9s7kw"]
Jul 13 17:37:07.009190 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:07.009151    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e079a3a1-6869-4f66-a77a-dcc207298fd1" path="/var/lib/kubelet/pods/e079a3a1-6869-4f66-a77a-dcc207298fd1/volumes"
Jul 13 17:37:08.438394 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:08.438364    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-vtfm4"
Jul 13 17:37:08.438904 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:08.438436    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qtcg6"
Jul 13 17:37:15.471038 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:37:15.471009    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-84567cbc5f-m4959"
Jul 13 17:39:41.606843 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.606808    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:39:41.607289 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.607109    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e079a3a1-6869-4f66-a77a-dcc207298fd1" containerName="discovery"
Jul 13 17:39:41.607289 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.607119    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e079a3a1-6869-4f66-a77a-dcc207298fd1" containerName="discovery"
Jul 13 17:39:41.607289 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.607176    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e079a3a1-6869-4f66-a77a-dcc207298fd1" containerName="discovery"
Jul 13 17:39:41.610009 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.609993    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dh877"
Jul 13 17:39:41.612018 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.611987    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 13 17:39:41.612128 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.612090    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 17:39:41.612744 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.612729    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 17:39:41.612744 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.612737    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l446t\""
Jul 13 17:39:41.618619 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.618595    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:39:41.644596 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.644555    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d373563-4025-44d8-8f50-f5a3f0e9b4f1-config-file\") pod \"limitador-limitador-54d6d988d5-dh877\" (UID: \"5d373563-4025-44d8-8f50-f5a3f0e9b4f1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dh877"
Jul 13 17:39:41.644772 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.644616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n6xc\" (UniqueName: \"kubernetes.io/projected/5d373563-4025-44d8-8f50-f5a3f0e9b4f1-kube-api-access-6n6xc\") pod \"limitador-limitador-54d6d988d5-dh877\" (UID: \"5d373563-4025-44d8-8f50-f5a3f0e9b4f1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dh877"
Jul 13 17:39:41.644930 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.644910    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:39:41.745883 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.745846    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n6xc\" (UniqueName: \"kubernetes.io/projected/5d373563-4025-44d8-8f50-f5a3f0e9b4f1-kube-api-access-6n6xc\") pod \"limitador-limitador-54d6d988d5-dh877\" (UID: \"5d373563-4025-44d8-8f50-f5a3f0e9b4f1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dh877"
Jul 13 17:39:41.746072 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.745924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d373563-4025-44d8-8f50-f5a3f0e9b4f1-config-file\") pod \"limitador-limitador-54d6d988d5-dh877\" (UID: \"5d373563-4025-44d8-8f50-f5a3f0e9b4f1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dh877"
Jul 13 17:39:41.746546 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.746526    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5d373563-4025-44d8-8f50-f5a3f0e9b4f1-config-file\") pod \"limitador-limitador-54d6d988d5-dh877\" (UID: \"5d373563-4025-44d8-8f50-f5a3f0e9b4f1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dh877"
Jul 13 17:39:41.754221 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.754190    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n6xc\" (UniqueName: \"kubernetes.io/projected/5d373563-4025-44d8-8f50-f5a3f0e9b4f1-kube-api-access-6n6xc\") pod \"limitador-limitador-54d6d988d5-dh877\" (UID: \"5d373563-4025-44d8-8f50-f5a3f0e9b4f1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dh877"
Jul 13 17:39:41.920572 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:41.920482    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dh877"
Jul 13 17:39:42.058250 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:42.058213    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:39:42.061743 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:39:42.061706    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d373563_4025_44d8_8f50_f5a3f0e9b4f1.slice/crio-54d9557c20ce525a6eb5093bb7d2686bcc498b36759c206ecb1658c430e6b819 WatchSource:0}: Error finding container 54d9557c20ce525a6eb5093bb7d2686bcc498b36759c206ecb1658c430e6b819: Status 404 returned error can't find the container with id 54d9557c20ce525a6eb5093bb7d2686bcc498b36759c206ecb1658c430e6b819
Jul 13 17:39:42.107170 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:42.107129    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-chpql"]
Jul 13 17:39:42.111517 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:42.111494    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-chpql"
Jul 13 17:39:42.114000 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:42.113974    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-89qfm\""
Jul 13 17:39:42.117892 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:42.117833    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-chpql"]
Jul 13 17:39:42.138447 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:42.138411    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dh877" event={"ID":"5d373563-4025-44d8-8f50-f5a3f0e9b4f1","Type":"ContainerStarted","Data":"54d9557c20ce525a6eb5093bb7d2686bcc498b36759c206ecb1658c430e6b819"}
Jul 13 17:39:42.149955 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:42.149915    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf56r\" (UniqueName: \"kubernetes.io/projected/acd48674-b353-43de-888b-2c5941eaa3b6-kube-api-access-hf56r\") pod \"authorino-58cd955675-chpql\" (UID: \"acd48674-b353-43de-888b-2c5941eaa3b6\") " pod="kuadrant-system/authorino-58cd955675-chpql"
Jul 13 17:39:42.251248 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:42.251151    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf56r\" (UniqueName: \"kubernetes.io/projected/acd48674-b353-43de-888b-2c5941eaa3b6-kube-api-access-hf56r\") pod \"authorino-58cd955675-chpql\" (UID: \"acd48674-b353-43de-888b-2c5941eaa3b6\") " pod="kuadrant-system/authorino-58cd955675-chpql"
Jul 13 17:39:42.259389 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:42.259361    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf56r\" (UniqueName: \"kubernetes.io/projected/acd48674-b353-43de-888b-2c5941eaa3b6-kube-api-access-hf56r\") pod \"authorino-58cd955675-chpql\" (UID: \"acd48674-b353-43de-888b-2c5941eaa3b6\") " pod="kuadrant-system/authorino-58cd955675-chpql"
Jul 13 17:39:42.422468 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:42.422406    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-chpql"
Jul 13 17:39:42.557713 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:42.557683    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-chpql"]
Jul 13 17:39:42.559990 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:39:42.559961    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacd48674_b353_43de_888b_2c5941eaa3b6.slice/crio-33de606366e9909ebc70883c1ebe782ac1a0f92efbb5ac1b0c77aaef990ff9b5 WatchSource:0}: Error finding container 33de606366e9909ebc70883c1ebe782ac1a0f92efbb5ac1b0c77aaef990ff9b5: Status 404 returned error can't find the container with id 33de606366e9909ebc70883c1ebe782ac1a0f92efbb5ac1b0c77aaef990ff9b5
Jul 13 17:39:43.144783 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:43.144737    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-chpql" event={"ID":"acd48674-b353-43de-888b-2c5941eaa3b6","Type":"ContainerStarted","Data":"33de606366e9909ebc70883c1ebe782ac1a0f92efbb5ac1b0c77aaef990ff9b5"}
Jul 13 17:39:47.167362 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:47.167318    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dh877" event={"ID":"5d373563-4025-44d8-8f50-f5a3f0e9b4f1","Type":"ContainerStarted","Data":"6d0f1ad899f5022b8bab88d2e272367858f7e2256b9f88aeabd5154fd523cd34"}
Jul 13 17:39:47.167760 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:47.167557    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dh877"
Jul 13 17:39:47.168839 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:47.168820    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-chpql" event={"ID":"acd48674-b353-43de-888b-2c5941eaa3b6","Type":"ContainerStarted","Data":"4901012c62fe16a538c498cbec3a82cf5ef4926e1104cc9f57b595468822c327"}
Jul 13 17:39:47.188739 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:47.188686    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dh877" podStartSLOduration=1.7459144119999999 podStartE2EDuration="6.188666188s" totalImagesPullingTime="4.442751776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:39:47.187806382 +0000 UTC m=+482.700981673" watchObservedRunningTime="2026-07-13 17:39:47.188666188 +0000 UTC m=+482.701841454"
Jul 13 17:39:47.206834 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:47.206782    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-chpql" podStartSLOduration=1.2029735 podStartE2EDuration="5.206763644s" totalImagesPullingTime="4.003790144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:39:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:39:47.203243933 +0000 UTC m=+482.716419197" watchObservedRunningTime="2026-07-13 17:39:47.206763644 +0000 UTC m=+482.719938908"
Jul 13 17:39:47.888529 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:47.888490    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-chpql"]
Jul 13 17:39:49.177633 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:49.177589    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-chpql" podUID="acd48674-b353-43de-888b-2c5941eaa3b6" containerName="authorino" containerID="cri-o://4901012c62fe16a538c498cbec3a82cf5ef4926e1104cc9f57b595468822c327" gracePeriod=30
Jul 13 17:39:49.422929 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:49.422902    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-chpql"
Jul 13 17:39:49.605718 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:49.605680    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hf56r\" (UniqueName: \"kubernetes.io/projected/acd48674-b353-43de-888b-2c5941eaa3b6-kube-api-access-hf56r\") pod \"acd48674-b353-43de-888b-2c5941eaa3b6\" (UID: \"acd48674-b353-43de-888b-2c5941eaa3b6\") "
Jul 13 17:39:49.607979 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:49.607944    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acd48674-b353-43de-888b-2c5941eaa3b6-kube-api-access-hf56r" (OuterVolumeSpecName: "kube-api-access-hf56r") pod "acd48674-b353-43de-888b-2c5941eaa3b6" (UID: "acd48674-b353-43de-888b-2c5941eaa3b6"). InnerVolumeSpecName "kube-api-access-hf56r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 17:39:49.706431 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:49.706397    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf56r\" (UniqueName: \"kubernetes.io/projected/acd48674-b353-43de-888b-2c5941eaa3b6-kube-api-access-hf56r\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 17:39:50.183694 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:50.183656    2564 generic.go:356] "Generic (PLEG): container finished" podID="acd48674-b353-43de-888b-2c5941eaa3b6" containerID="4901012c62fe16a538c498cbec3a82cf5ef4926e1104cc9f57b595468822c327" exitCode=0
Jul 13 17:39:50.184090 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:50.183715    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-chpql"
Jul 13 17:39:50.184090 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:50.183731    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-chpql" event={"ID":"acd48674-b353-43de-888b-2c5941eaa3b6","Type":"ContainerDied","Data":"4901012c62fe16a538c498cbec3a82cf5ef4926e1104cc9f57b595468822c327"}
Jul 13 17:39:50.184090 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:50.183771    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-chpql" event={"ID":"acd48674-b353-43de-888b-2c5941eaa3b6","Type":"ContainerDied","Data":"33de606366e9909ebc70883c1ebe782ac1a0f92efbb5ac1b0c77aaef990ff9b5"}
Jul 13 17:39:50.184090 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:50.183789    2564 scope.go:117] "RemoveContainer" containerID="4901012c62fe16a538c498cbec3a82cf5ef4926e1104cc9f57b595468822c327"
Jul 13 17:39:50.192239 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:50.192214    2564 scope.go:117] "RemoveContainer" containerID="4901012c62fe16a538c498cbec3a82cf5ef4926e1104cc9f57b595468822c327"
Jul 13 17:39:50.192571 ip-10-0-137-223 kubenswrapper[2564]: E0713 17:39:50.192547    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4901012c62fe16a538c498cbec3a82cf5ef4926e1104cc9f57b595468822c327\": container with ID starting with 4901012c62fe16a538c498cbec3a82cf5ef4926e1104cc9f57b595468822c327 not found: ID does not exist" containerID="4901012c62fe16a538c498cbec3a82cf5ef4926e1104cc9f57b595468822c327"
Jul 13 17:39:50.192639 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:50.192583    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4901012c62fe16a538c498cbec3a82cf5ef4926e1104cc9f57b595468822c327"} err="failed to get container status \"4901012c62fe16a538c498cbec3a82cf5ef4926e1104cc9f57b595468822c327\": rpc error: code = NotFound desc = could not find container \"4901012c62fe16a538c498cbec3a82cf5ef4926e1104cc9f57b595468822c327\": container with ID starting with 4901012c62fe16a538c498cbec3a82cf5ef4926e1104cc9f57b595468822c327 not found: ID does not exist"
Jul 13 17:39:50.203912 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:50.203881    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-chpql"]
Jul 13 17:39:50.207929 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:50.207901    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-chpql"]
Jul 13 17:39:51.009675 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:51.009642    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acd48674-b353-43de-888b-2c5941eaa3b6" path="/var/lib/kubelet/pods/acd48674-b353-43de-888b-2c5941eaa3b6/volumes"
Jul 13 17:39:58.175048 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:39:58.175019    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dh877"
Jul 13 17:40:57.249875 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:40:57.249837    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:41:16.676438 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:16.676402    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:41:30.878171 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:30.878133    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:41:44.942667 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:44.942635    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 17:41:44.948310 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:44.946425    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 17:41:49.979890 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:49.979855    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:41:58.221030 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.221000    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"]
Jul 13 17:41:58.221443 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.221324    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acd48674-b353-43de-888b-2c5941eaa3b6" containerName="authorino"
Jul 13 17:41:58.221443 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.221335    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="acd48674-b353-43de-888b-2c5941eaa3b6" containerName="authorino"
Jul 13 17:41:58.221443 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.221385    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="acd48674-b353-43de-888b-2c5941eaa3b6" containerName="authorino"
Jul 13 17:41:58.224242 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.224223    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.227658 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.227620    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-87j4q\""
Jul 13 17:41:58.227658 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.227642    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 13 17:41:58.227888 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.227769    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 17:41:58.228238 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.228209    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 17:41:58.235826 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.235796    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"]
Jul 13 17:41:58.262596 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.262551    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dc9e7d2-83ba-4d48-ba46-665525e14430-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.262768 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.262599    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpqf7\" (UniqueName: \"kubernetes.io/projected/2dc9e7d2-83ba-4d48-ba46-665525e14430-kube-api-access-fpqf7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.262768 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.262630    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dc9e7d2-83ba-4d48-ba46-665525e14430-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.262768 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.262660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dc9e7d2-83ba-4d48-ba46-665525e14430-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.262768 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.262679    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dc9e7d2-83ba-4d48-ba46-665525e14430-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.262909 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.262787    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dc9e7d2-83ba-4d48-ba46-665525e14430-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.364091 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.364041    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dc9e7d2-83ba-4d48-ba46-665525e14430-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.364091 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.364096    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpqf7\" (UniqueName: \"kubernetes.io/projected/2dc9e7d2-83ba-4d48-ba46-665525e14430-kube-api-access-fpqf7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.364388 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.364119    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dc9e7d2-83ba-4d48-ba46-665525e14430-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.364388 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.364144    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dc9e7d2-83ba-4d48-ba46-665525e14430-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.364388 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.364163    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dc9e7d2-83ba-4d48-ba46-665525e14430-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.364388 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.364240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dc9e7d2-83ba-4d48-ba46-665525e14430-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.364587 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.364529    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dc9e7d2-83ba-4d48-ba46-665525e14430-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.364587 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.364568    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dc9e7d2-83ba-4d48-ba46-665525e14430-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.364688 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.364634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dc9e7d2-83ba-4d48-ba46-665525e14430-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.366460 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.366430    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dc9e7d2-83ba-4d48-ba46-665525e14430-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.366600 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.366583    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dc9e7d2-83ba-4d48-ba46-665525e14430-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.372370 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.372345    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpqf7\" (UniqueName: \"kubernetes.io/projected/2dc9e7d2-83ba-4d48-ba46-665525e14430-kube-api-access-fpqf7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd\" (UID: \"2dc9e7d2-83ba-4d48-ba46-665525e14430\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.538344 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.538242    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:41:58.679520 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.679483    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"]
Jul 13 17:41:58.682775 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:41:58.682743    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc9e7d2_83ba_4d48_ba46_665525e14430.slice/crio-9fb5da8964168421d8bb144baba862a9278741d62426e4d950845b3863dfd2df WatchSource:0}: Error finding container 9fb5da8964168421d8bb144baba862a9278741d62426e4d950845b3863dfd2df: Status 404 returned error can't find the container with id 9fb5da8964168421d8bb144baba862a9278741d62426e4d950845b3863dfd2df
Jul 13 17:41:58.684590 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.684567    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 17:41:58.754979 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:58.754933    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd" event={"ID":"2dc9e7d2-83ba-4d48-ba46-665525e14430","Type":"ContainerStarted","Data":"9fb5da8964168421d8bb144baba862a9278741d62426e4d950845b3863dfd2df"}
Jul 13 17:41:59.784368 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:41:59.784331    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:42:00.765747 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:00.765706    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd" event={"ID":"2dc9e7d2-83ba-4d48-ba46-665525e14430","Type":"ContainerStarted","Data":"3cd5ab7afd5038a863cb858bd06493d876b9abad5707752d3bdd6714131cf1b6"}
Jul 13 17:42:00.781789 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:00.781733    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd" podStartSLOduration=1.705112677 podStartE2EDuration="2.78171667s" totalImagesPullingTime="1.076603993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:42:00.780713906 +0000 UTC m=+616.293889181" watchObservedRunningTime="2026-07-13 17:42:00.78171667 +0000 UTC m=+616.294891934"
Jul 13 17:42:07.885074 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:07.884982    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:42:08.539071 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:08.539030    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:42:08.539262 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:08.539098    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:42:08.551703 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:08.551675    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:42:08.811098 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:08.811019    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd"
Jul 13 17:42:14.419587 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.419555    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"]
Jul 13 17:42:14.422763 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.422740    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.424879 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.424857    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 13 17:42:14.433251 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.433228    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"]
Jul 13 17:42:14.505723 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.505681    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.505723 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.505727    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.505993 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.505752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.505993 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.505846    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.505993 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.505941    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.506115 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.505989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr5rz\" (UniqueName: \"kubernetes.io/projected/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-kube-api-access-nr5rz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.606615 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.606578    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.606615 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.606623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr5rz\" (UniqueName: \"kubernetes.io/projected/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-kube-api-access-nr5rz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.606940 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.606651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.606940 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.606671    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.606940 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.606687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.606940 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.606726    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.607145 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.607119    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.607185 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.607131    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.607540 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.607519    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.608958 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.608930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.609469 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.609448    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.614692 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.614668    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr5rz\" (UniqueName: \"kubernetes.io/projected/7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74-kube-api-access-nr5rz\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs\" (UID: \"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.731265 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.731179    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:14.868843 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:14.868818    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"]
Jul 13 17:42:14.871313 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:42:14.871256    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7eeb9acc_eec1_46b1_a23b_5dfe2c21fe74.slice/crio-367a1bfa3720fd9d198b3db136571dcd05c7622d7b179a996a13be67e2ae1466 WatchSource:0}: Error finding container 367a1bfa3720fd9d198b3db136571dcd05c7622d7b179a996a13be67e2ae1466: Status 404 returned error can't find the container with id 367a1bfa3720fd9d198b3db136571dcd05c7622d7b179a996a13be67e2ae1466
Jul 13 17:42:15.831683 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:15.831641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs" event={"ID":"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74","Type":"ContainerStarted","Data":"ca90d62308a1eb16e67b3ef69cc668327def4a80127b3c113f4abe8ccd09fcd0"}
Jul 13 17:42:15.832082 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:15.831693    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs" event={"ID":"7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74","Type":"ContainerStarted","Data":"367a1bfa3720fd9d198b3db136571dcd05c7622d7b179a996a13be67e2ae1466"}
Jul 13 17:42:15.848080 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:15.848021    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs" podStartSLOduration=1.638812641 podStartE2EDuration="1.84800332s" totalImagesPullingTime="209.190679ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:42:15.847079072 +0000 UTC m=+631.360254337" watchObservedRunningTime="2026-07-13 17:42:15.84800332 +0000 UTC m=+631.361178585"
Jul 13 17:42:16.786378 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:16.786344    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:42:24.731705 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:24.731672    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:24.732023 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:24.731723    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:24.744026 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:24.743990    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:42:24.882004 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:42:24.881977    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs"
Jul 13 17:43:17.011409 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:17.011376    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d6d5984d7-wq9tc"]
Jul 13 17:43:17.014536 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:17.014517    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d6d5984d7-wq9tc"
Jul 13 17:43:17.017641 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:17.017612    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 13 17:43:17.017641 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:17.017629    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-89qfm\""
Jul 13 17:43:17.024524 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:17.024487    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d6d5984d7-wq9tc"]
Jul 13 17:43:17.161677 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:17.161641    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cc36b880-6953-4055-a7cf-da8d67c2f105-tls-cert\") pod \"authorino-7d6d5984d7-wq9tc\" (UID: \"cc36b880-6953-4055-a7cf-da8d67c2f105\") " pod="kuadrant-system/authorino-7d6d5984d7-wq9tc"
Jul 13 17:43:17.161885 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:17.161714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh5pb\" (UniqueName: \"kubernetes.io/projected/cc36b880-6953-4055-a7cf-da8d67c2f105-kube-api-access-mh5pb\") pod \"authorino-7d6d5984d7-wq9tc\" (UID: \"cc36b880-6953-4055-a7cf-da8d67c2f105\") " pod="kuadrant-system/authorino-7d6d5984d7-wq9tc"
Jul 13 17:43:17.262802 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:17.262706    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cc36b880-6953-4055-a7cf-da8d67c2f105-tls-cert\") pod \"authorino-7d6d5984d7-wq9tc\" (UID: \"cc36b880-6953-4055-a7cf-da8d67c2f105\") " pod="kuadrant-system/authorino-7d6d5984d7-wq9tc"
Jul 13 17:43:17.262802 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:17.262766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh5pb\" (UniqueName: \"kubernetes.io/projected/cc36b880-6953-4055-a7cf-da8d67c2f105-kube-api-access-mh5pb\") pod \"authorino-7d6d5984d7-wq9tc\" (UID: \"cc36b880-6953-4055-a7cf-da8d67c2f105\") " pod="kuadrant-system/authorino-7d6d5984d7-wq9tc"
Jul 13 17:43:17.265240 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:17.265206    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cc36b880-6953-4055-a7cf-da8d67c2f105-tls-cert\") pod \"authorino-7d6d5984d7-wq9tc\" (UID: \"cc36b880-6953-4055-a7cf-da8d67c2f105\") " pod="kuadrant-system/authorino-7d6d5984d7-wq9tc"
Jul 13 17:43:17.271678 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:17.271646    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh5pb\" (UniqueName: \"kubernetes.io/projected/cc36b880-6953-4055-a7cf-da8d67c2f105-kube-api-access-mh5pb\") pod \"authorino-7d6d5984d7-wq9tc\" (UID: \"cc36b880-6953-4055-a7cf-da8d67c2f105\") " pod="kuadrant-system/authorino-7d6d5984d7-wq9tc"
Jul 13 17:43:17.323588 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:17.323552    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d6d5984d7-wq9tc"
Jul 13 17:43:17.464030 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:17.464001    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d6d5984d7-wq9tc"]
Jul 13 17:43:17.466698 ip-10-0-137-223 kubenswrapper[2564]: W0713 17:43:17.466665    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc36b880_6953_4055_a7cf_da8d67c2f105.slice/crio-263590215df0049653c0068ec79275b198c8ba913fc9bdfabf8d544db31c0543 WatchSource:0}: Error finding container 263590215df0049653c0068ec79275b198c8ba913fc9bdfabf8d544db31c0543: Status 404 returned error can't find the container with id 263590215df0049653c0068ec79275b198c8ba913fc9bdfabf8d544db31c0543
Jul 13 17:43:18.099035 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:18.099002    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d6d5984d7-wq9tc" event={"ID":"cc36b880-6953-4055-a7cf-da8d67c2f105","Type":"ContainerStarted","Data":"884d1be1080c2ce303664b62a07107b75096da8af5e680f5fed993ba0fc42796"}
Jul 13 17:43:18.099035 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:18.099043    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d6d5984d7-wq9tc" event={"ID":"cc36b880-6953-4055-a7cf-da8d67c2f105","Type":"ContainerStarted","Data":"263590215df0049653c0068ec79275b198c8ba913fc9bdfabf8d544db31c0543"}
Jul 13 17:43:18.116295 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:18.116187    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d6d5984d7-wq9tc" podStartSLOduration=1.690221335 podStartE2EDuration="2.11616429s" totalImagesPullingTime="425.942955ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 17:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 17:43:18.115037675 +0000 UTC m=+693.628212959" watchObservedRunningTime="2026-07-13 17:43:18.11616429 +0000 UTC m=+693.629339555"
Jul 13 17:43:47.988486 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:47.988387    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:43:57.481035 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:43:57.481000    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:44:09.580528 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:44:09.580488    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:44:17.383746 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:44:17.383702    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:44:28.480136 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:44:28.480097    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:44:56.482517 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:44:56.482474    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:45:08.604439 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:45:08.604342    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:45:43.780528 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:45:43.780482    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:45:52.984967 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:45:52.984934    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:46:02.578762 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:46:02.578721    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:46:13.180118 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:46:13.180070    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:46:22.978405 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:46:22.978365    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:46:38.384079 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:46:38.383995    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:46:44.578840 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:46:44.578800    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:46:44.973123 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:46:44.973038    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 17:46:44.973772 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:46:44.973753    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 17:46:54.377942 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:46:54.377908    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:47:16.183606 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:47:16.183556    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:47:25.384182 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:47:25.384127    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:47:48.581188 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:47:48.581141    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:47:59.375190 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:47:59.375149    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:48:14.287623 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:48:14.287583    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:48:25.086744 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:48:25.086705    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:48:34.880418 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:48:34.880380    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:48:44.474290 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:48:44.474225    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:48:53.489297 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:48:53.489251    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:50:45.983401 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:50:45.983363    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:50:57.089656 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:50:57.089622    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:51:05.983457 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:51:05.983421    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:51:18.176804 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:51:18.176767    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:51:28.683385 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:51:28.683348    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:51:40.485181 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:51:40.485144    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:51:44.998968 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:51:44.998939    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 17:51:44.999944 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:51:44.999922    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 17:51:49.485406 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:51:49.485370    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:52:01.177778 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:52:01.177742    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:52:10.581759 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:52:10.581719    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:52:20.779169 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:52:20.779128    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:52:31.283555 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:52:31.283515    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:52:55.386393 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:52:55.386309    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:53:03.182358 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:53:03.182322    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:53:12.780518 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:53:12.780482    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:53:22.389016 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:53:22.388983    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:53:29.578900 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:53:29.578861    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:53:45.097158 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:53:45.097114    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:53:55.580596 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:53:55.580559    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:54:04.283880 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:54:04.283841    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:54:15.817154 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:54:15.817065    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:54:25.184660 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:54:25.184616    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:54:35.380734 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:54:35.380697    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:54:48.189791 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:54:48.189748    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:54:57.479702 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:54:57.479666    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:55:06.885164 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:55:06.885124    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:55:19.883077 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:55:19.883038    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:55:30.984039 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:55:30.984000    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:55:38.201201 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:55:38.201118    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:55:47.285526 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:55:47.285488    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:56:05.987101 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:56:05.987056    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:56:18.682957 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:56:18.682918    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:56:32.386664 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:56:32.386624    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:56:44.285248 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:56:44.285205    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:56:45.025686 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:56:45.025652    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 17:56:45.026937 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:56:45.026918    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 17:56:52.881705 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:56:52.881664    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:57:03.181664 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:57:03.181618    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:58:17.980932 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:58:17.980896    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:58:36.090176 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:58:36.090138    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:59:39.381284 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:59:39.381243    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 17:59:48.773392 ip-10-0-137-223 kubenswrapper[2564]: I0713 17:59:48.773354    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:01:03.080260 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:01:03.080215    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:01:24.780476 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:01:24.780434    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:01:45.050238 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:01:45.050205    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 18:01:45.052888 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:01:45.052863    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 18:02:24.981336 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:02:24.981298    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:04:01.881338 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:04:01.881301    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:04:10.882287 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:04:10.882242    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:04:24.883827 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:04:24.883790    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:04:43.283492 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:04:43.283407    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:05:25.776609 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:25.776575    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:05:32.514709 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.514673    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"]
Jul 13 18:05:32.518114 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.518088    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.520552 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.520531    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ee8b02ac\"/\"kube-root-ca.crt\""
Jul 13 18:05:32.521236 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.521218    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ee8b02ac\"/\"e2e-lifecycle-model-ee8b02ac-kserve-self-signed-certs\""
Jul 13 18:05:32.521324 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.521246    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ee8b02ac\"/\"default-dockercfg-l9hv6\""
Jul 13 18:05:32.521383 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.521342    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ee8b02ac\"/\"openshift-service-ca.crt\""
Jul 13 18:05:32.529891 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.529864    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"]
Jul 13 18:05:32.628043 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.628002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-tls-certs\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.628043 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.628043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-tmp-dir\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.628255 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.628067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmqw2\" (UniqueName: \"kubernetes.io/projected/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-kube-api-access-gmqw2\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.628255 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.628117    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-home\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.628255 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.628231    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-model-cache\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.628379 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.628308    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-dshm\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.729604 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.729554    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-tls-certs\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.729604 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.729610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-tmp-dir\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.729836 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.729641    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmqw2\" (UniqueName: \"kubernetes.io/projected/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-kube-api-access-gmqw2\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.729836 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.729668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-home\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.729836 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.729739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-model-cache\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.729836 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.729791    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-dshm\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.730107 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.730080    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-tmp-dir\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.730107 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.730099    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-model-cache\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.730228 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.730135    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-home\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.732070 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.732048    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-dshm\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.732339 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.732322    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-tls-certs\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.738425 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.738400    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmqw2\" (UniqueName: \"kubernetes.io/projected/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-kube-api-access-gmqw2\") pod \"e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") " pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.827475 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.827441    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:32.959940 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:32.959898    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"]
Jul 13 18:05:32.964124 ip-10-0-137-223 kubenswrapper[2564]: W0713 18:05:32.964096    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17dcc7b3_ba15_4405_9f56_3181c27cbdf0.slice/crio-a95a60a44f4ee0ed7a6d14863f69cc4c775d10da0c1e5566ab51b847423d8615 WatchSource:0}: Error finding container a95a60a44f4ee0ed7a6d14863f69cc4c775d10da0c1e5566ab51b847423d8615: Status 404 returned error can't find the container with id a95a60a44f4ee0ed7a6d14863f69cc4c775d10da0c1e5566ab51b847423d8615
Jul 13 18:05:33.027819 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:33.027792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c" event={"ID":"17dcc7b3-ba15-4405-9f56-3181c27cbdf0","Type":"ContainerStarted","Data":"a95a60a44f4ee0ed7a6d14863f69cc4c775d10da0c1e5566ab51b847423d8615"}
Jul 13 18:05:34.033659 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:34.033620    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c" event={"ID":"17dcc7b3-ba15-4405-9f56-3181c27cbdf0","Type":"ContainerStarted","Data":"bc375074fde7407396d3d31a95ba4f56d8c64c8511d7db6894489f71fab63a64"}
Jul 13 18:05:34.052804 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:34.052744    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c" podStartSLOduration=2.052729543 podStartE2EDuration="2.052729543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:05:34.050984119 +0000 UTC m=+2029.564159415" watchObservedRunningTime="2026-07-13 18:05:34.052729543 +0000 UTC m=+2029.565904809"
Jul 13 18:05:36.294316 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:36.294279    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:05:42.827628 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:42.827583    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:42.828114 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:42.827644    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:42.840175 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:42.840138    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:05:43.082689 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:05:43.082599    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:06:00.876868 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:00.876835    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:06:21.072149 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:21.072045    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:06:27.216083 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:27.216047    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"]
Jul 13 18:06:42.236566 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.236525    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c" podUID="17dcc7b3-ba15-4405-9f56-3181c27cbdf0" containerName="main" containerID="cri-o://bc375074fde7407396d3d31a95ba4f56d8c64c8511d7db6894489f71fab63a64" gracePeriod=45
Jul 13 18:06:42.484752 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.484723    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:06:42.640343 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.640302    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmqw2\" (UniqueName: \"kubernetes.io/projected/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-kube-api-access-gmqw2\") pod \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") "
Jul 13 18:06:42.640524 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.640362    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-dshm\") pod \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") "
Jul 13 18:06:42.640524 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.640405    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-home\") pod \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") "
Jul 13 18:06:42.640524 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.640420    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-model-cache\") pod \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") "
Jul 13 18:06:42.640524 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.640469    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-tmp-dir\") pod \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") "
Jul 13 18:06:42.640524 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.640490    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-tls-certs\") pod \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\" (UID: \"17dcc7b3-ba15-4405-9f56-3181c27cbdf0\") "
Jul 13 18:06:42.640774 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.640729    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-model-cache" (OuterVolumeSpecName: "model-cache") pod "17dcc7b3-ba15-4405-9f56-3181c27cbdf0" (UID: "17dcc7b3-ba15-4405-9f56-3181c27cbdf0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:06:42.640774 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.640742    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-home" (OuterVolumeSpecName: "home") pod "17dcc7b3-ba15-4405-9f56-3181c27cbdf0" (UID: "17dcc7b3-ba15-4405-9f56-3181c27cbdf0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:06:42.640851 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.640764    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "17dcc7b3-ba15-4405-9f56-3181c27cbdf0" (UID: "17dcc7b3-ba15-4405-9f56-3181c27cbdf0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:06:42.642730 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.642700    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-dshm" (OuterVolumeSpecName: "dshm") pod "17dcc7b3-ba15-4405-9f56-3181c27cbdf0" (UID: "17dcc7b3-ba15-4405-9f56-3181c27cbdf0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:06:42.642849 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.642756    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "17dcc7b3-ba15-4405-9f56-3181c27cbdf0" (UID: "17dcc7b3-ba15-4405-9f56-3181c27cbdf0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:06:42.642849 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.642764    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-kube-api-access-gmqw2" (OuterVolumeSpecName: "kube-api-access-gmqw2") pod "17dcc7b3-ba15-4405-9f56-3181c27cbdf0" (UID: "17dcc7b3-ba15-4405-9f56-3181c27cbdf0"). InnerVolumeSpecName "kube-api-access-gmqw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:06:42.741581 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.741538    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmqw2\" (UniqueName: \"kubernetes.io/projected/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-kube-api-access-gmqw2\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:06:42.741581 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.741574    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-dshm\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:06:42.741581 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.741587    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-home\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:06:42.741823 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.741598    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-model-cache\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:06:42.741823 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.741610    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-tmp-dir\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:06:42.741823 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:42.741620    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17dcc7b3-ba15-4405-9f56-3181c27cbdf0-tls-certs\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:06:43.334001 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:43.333963    2564 generic.go:356] "Generic (PLEG): container finished" podID="17dcc7b3-ba15-4405-9f56-3181c27cbdf0" containerID="bc375074fde7407396d3d31a95ba4f56d8c64c8511d7db6894489f71fab63a64" exitCode=0
Jul 13 18:06:43.334001 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:43.334003    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"
Jul 13 18:06:43.334588 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:43.334055    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c" event={"ID":"17dcc7b3-ba15-4405-9f56-3181c27cbdf0","Type":"ContainerDied","Data":"bc375074fde7407396d3d31a95ba4f56d8c64c8511d7db6894489f71fab63a64"}
Jul 13 18:06:43.334588 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:43.334119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c" event={"ID":"17dcc7b3-ba15-4405-9f56-3181c27cbdf0","Type":"ContainerDied","Data":"a95a60a44f4ee0ed7a6d14863f69cc4c775d10da0c1e5566ab51b847423d8615"}
Jul 13 18:06:43.334588 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:43.334144    2564 scope.go:117] "RemoveContainer" containerID="bc375074fde7407396d3d31a95ba4f56d8c64c8511d7db6894489f71fab63a64"
Jul 13 18:06:43.342740 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:43.342721    2564 scope.go:117] "RemoveContainer" containerID="bc375074fde7407396d3d31a95ba4f56d8c64c8511d7db6894489f71fab63a64"
Jul 13 18:06:43.343065 ip-10-0-137-223 kubenswrapper[2564]: E0713 18:06:43.343038    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc375074fde7407396d3d31a95ba4f56d8c64c8511d7db6894489f71fab63a64\": container with ID starting with bc375074fde7407396d3d31a95ba4f56d8c64c8511d7db6894489f71fab63a64 not found: ID does not exist" containerID="bc375074fde7407396d3d31a95ba4f56d8c64c8511d7db6894489f71fab63a64"
Jul 13 18:06:43.343169 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:43.343070    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc375074fde7407396d3d31a95ba4f56d8c64c8511d7db6894489f71fab63a64"} err="failed to get container status \"bc375074fde7407396d3d31a95ba4f56d8c64c8511d7db6894489f71fab63a64\": rpc error: code = NotFound desc = could not find container \"bc375074fde7407396d3d31a95ba4f56d8c64c8511d7db6894489f71fab63a64\": container with ID starting with bc375074fde7407396d3d31a95ba4f56d8c64c8511d7db6894489f71fab63a64 not found: ID does not exist"
Jul 13 18:06:43.351497 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:43.351470    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"]
Jul 13 18:06:43.356573 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:43.356546    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-ee8b02ac/e2e-lifecycle-model-ee8b02ac-kserve-774547c79f-m7v4c"]
Jul 13 18:06:45.009380 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:45.009346    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17dcc7b3-ba15-4405-9f56-3181c27cbdf0" path="/var/lib/kubelet/pods/17dcc7b3-ba15-4405-9f56-3181c27cbdf0/volumes"
Jul 13 18:06:45.075925 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:45.075899    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 18:06:45.078820 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:06:45.078796    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 18:07:48.784672 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:07:48.784590    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:08:03.381228 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:08:03.381186    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:08:50.388549 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:08:50.388511    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:09:04.779643 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:04.779604    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:09:11.201120 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.201030    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"]
Jul 13 18:09:11.201621 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.201385    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17dcc7b3-ba15-4405-9f56-3181c27cbdf0" containerName="main"
Jul 13 18:09:11.201621 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.201396    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="17dcc7b3-ba15-4405-9f56-3181c27cbdf0" containerName="main"
Jul 13 18:09:11.201621 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.201463    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="17dcc7b3-ba15-4405-9f56-3181c27cbdf0" containerName="main"
Jul 13 18:09:11.204429 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.204408    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.206804 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.206780    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d09cc8\"/\"kube-root-ca.crt\""
Jul 13 18:09:11.206926 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.206853    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d09cc8\"/\"openshift-service-ca.crt\""
Jul 13 18:09:11.207649 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.207625    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d09cc8\"/\"test-model-d09cc8-kserve-self-signed-certs\""
Jul 13 18:09:11.207772 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.207661    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d09cc8\"/\"default-dockercfg-95zbp\""
Jul 13 18:09:11.214846 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.214819    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"]
Jul 13 18:09:11.299504 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.299463    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-model-cache\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.299695 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.299517    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-home\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.299695 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.299568    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-tmp-dir\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.299695 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.299654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfttd\" (UniqueName: \"kubernetes.io/projected/5509cd06-e714-486f-b69d-2de167cc8a9c-kube-api-access-dfttd\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.299695 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.299693    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-dshm\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.299862 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.299709    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5509cd06-e714-486f-b69d-2de167cc8a9c-tls-certs\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.400405 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.400363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfttd\" (UniqueName: \"kubernetes.io/projected/5509cd06-e714-486f-b69d-2de167cc8a9c-kube-api-access-dfttd\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.400405 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.400410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-dshm\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.400656 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.400437    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5509cd06-e714-486f-b69d-2de167cc8a9c-tls-certs\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.400656 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.400493    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-model-cache\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.400656 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.400527    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-home\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.400656 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.400548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-tmp-dir\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.400934 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.400910    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-model-cache\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.401076 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.400959    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-tmp-dir\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.401076 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.400979    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-home\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.402677 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.402641    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-dshm\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.402948 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.402932    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5509cd06-e714-486f-b69d-2de167cc8a9c-tls-certs\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.408662 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.408642    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfttd\" (UniqueName: \"kubernetes.io/projected/5509cd06-e714-486f-b69d-2de167cc8a9c-kube-api-access-dfttd\") pod \"test-model-d09cc8-kserve-7759c66bff-cxdmv\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") " pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.514558 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.514467    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:11.649708 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.649680    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"]
Jul 13 18:09:11.651900 ip-10-0-137-223 kubenswrapper[2564]: W0713 18:09:11.651855    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5509cd06_e714_486f_b69d_2de167cc8a9c.slice/crio-0c6b827cbefeba5f363089e643214a0c6b975ffda55da272129a65b8765c8d01 WatchSource:0}: Error finding container 0c6b827cbefeba5f363089e643214a0c6b975ffda55da272129a65b8765c8d01: Status 404 returned error can't find the container with id 0c6b827cbefeba5f363089e643214a0c6b975ffda55da272129a65b8765c8d01
Jul 13 18:09:11.992909 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.992863    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv" event={"ID":"5509cd06-e714-486f-b69d-2de167cc8a9c","Type":"ContainerStarted","Data":"30287f4d9c49d8621cc326d976a60bf92a7f696f68557e363b47c4b88bb86bd6"}
Jul 13 18:09:11.992909 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:11.992908    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv" event={"ID":"5509cd06-e714-486f-b69d-2de167cc8a9c","Type":"ContainerStarted","Data":"0c6b827cbefeba5f363089e643214a0c6b975ffda55da272129a65b8765c8d01"}
Jul 13 18:09:12.009878 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:12.009826    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv" podStartSLOduration=1.00980979 podStartE2EDuration="1.00980979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:09:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:09:12.007865484 +0000 UTC m=+2247.521040765" watchObservedRunningTime="2026-07-13 18:09:12.00980979 +0000 UTC m=+2247.522985055"
Jul 13 18:09:14.676849 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:14.676813    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:09:21.514710 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:21.514673    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:21.515243 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:21.514725    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:21.527338 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:21.527309    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:22.047183 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:22.047144    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:26.521349 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.521318    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"]
Jul 13 18:09:26.524521 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.524503    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.526677 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.526651    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-dc368b\"/\"default-dockercfg-9f7zx\""
Jul 13 18:09:26.527462 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.527439    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-dc368b\"/\"test-model-dc368b-kserve-self-signed-certs\""
Jul 13 18:09:26.527462 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.527446    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-dc368b\"/\"kube-root-ca.crt\""
Jul 13 18:09:26.527647 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.527483    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-dc368b\"/\"openshift-service-ca.crt\""
Jul 13 18:09:26.534864 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.534831    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"]
Jul 13 18:09:26.633097 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.633058    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-dshm\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.633097 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.633095    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-tmp-dir\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.633303 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.633124    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-model-cache\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.633303 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.633185    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-tls-certs\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.633303 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.633253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5hhq\" (UniqueName: \"kubernetes.io/projected/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-kube-api-access-r5hhq\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.633402 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.633325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-home\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.733760 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.733720    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-home\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.733760 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.733760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-dshm\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.734001 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.733775    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-tmp-dir\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.734001 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.733807    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-model-cache\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.734001 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.733830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-tls-certs\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.734001 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.733884    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5hhq\" (UniqueName: \"kubernetes.io/projected/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-kube-api-access-r5hhq\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.734302 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.734251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-model-cache\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.734384 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.734298    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-tmp-dir\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.734384 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.734351    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-home\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.736130 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.736108    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-dshm\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.736366 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.736352    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-tls-certs\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.745993 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.745960    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5hhq\" (UniqueName: \"kubernetes.io/projected/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-kube-api-access-r5hhq\") pod \"test-model-dc368b-kserve-577545d79c-kpf6f\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") " pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.834752 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.834709    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:26.975546 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:26.975519    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"]
Jul 13 18:09:26.978132 ip-10-0-137-223 kubenswrapper[2564]: W0713 18:09:26.978098    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78cb91b7_cac6_4d28_8ae8_e11e51fdf36c.slice/crio-dc68c8bb131ecefe74a4702fa4c57752e73598361831793a0a6227121cff0eee WatchSource:0}: Error finding container dc68c8bb131ecefe74a4702fa4c57752e73598361831793a0a6227121cff0eee: Status 404 returned error can't find the container with id dc68c8bb131ecefe74a4702fa4c57752e73598361831793a0a6227121cff0eee
Jul 13 18:09:27.060503 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:27.060468    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f" event={"ID":"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c","Type":"ContainerStarted","Data":"ca3c28f66040e9267fe0e0ed65be90cca50d40e7d066ca4d1a7ef02f41ced91c"}
Jul 13 18:09:27.060656 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:27.060511    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f" event={"ID":"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c","Type":"ContainerStarted","Data":"dc68c8bb131ecefe74a4702fa4c57752e73598361831793a0a6227121cff0eee"}
Jul 13 18:09:27.075341 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:27.075241    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f" podStartSLOduration=1.075219218 podStartE2EDuration="1.075219218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:09:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:09:27.074857351 +0000 UTC m=+2262.588032632" watchObservedRunningTime="2026-07-13 18:09:27.075219218 +0000 UTC m=+2262.588394485"
Jul 13 18:09:29.683479 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:29.683442    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:09:36.834836 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:36.834797    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:36.835239 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:36.834857    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:36.847859 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:36.847829    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:37.116643 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:37.116553    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:09:44.429546 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:44.429509    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"]
Jul 13 18:09:45.325311 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:45.325246    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"]
Jul 13 18:09:47.684892 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:47.684855    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:09:59.451025 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.450951    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv" podUID="5509cd06-e714-486f-b69d-2de167cc8a9c" containerName="main" containerID="cri-o://30287f4d9c49d8621cc326d976a60bf92a7f696f68557e363b47c4b88bb86bd6" gracePeriod=45
Jul 13 18:09:59.705756 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.705682    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:09:59.721303 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.721251    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5509cd06-e714-486f-b69d-2de167cc8a9c-tls-certs\") pod \"5509cd06-e714-486f-b69d-2de167cc8a9c\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") "
Jul 13 18:09:59.721474 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.721330    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfttd\" (UniqueName: \"kubernetes.io/projected/5509cd06-e714-486f-b69d-2de167cc8a9c-kube-api-access-dfttd\") pod \"5509cd06-e714-486f-b69d-2de167cc8a9c\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") "
Jul 13 18:09:59.721474 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.721358    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-home\") pod \"5509cd06-e714-486f-b69d-2de167cc8a9c\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") "
Jul 13 18:09:59.721474 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.721390    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-tmp-dir\") pod \"5509cd06-e714-486f-b69d-2de167cc8a9c\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") "
Jul 13 18:09:59.721474 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.721427    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-dshm\") pod \"5509cd06-e714-486f-b69d-2de167cc8a9c\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") "
Jul 13 18:09:59.721680 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.721480    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-model-cache\") pod \"5509cd06-e714-486f-b69d-2de167cc8a9c\" (UID: \"5509cd06-e714-486f-b69d-2de167cc8a9c\") "
Jul 13 18:09:59.721735 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.721675    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-home" (OuterVolumeSpecName: "home") pod "5509cd06-e714-486f-b69d-2de167cc8a9c" (UID: "5509cd06-e714-486f-b69d-2de167cc8a9c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:09:59.721785 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.721728    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5509cd06-e714-486f-b69d-2de167cc8a9c" (UID: "5509cd06-e714-486f-b69d-2de167cc8a9c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:09:59.721831 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.721811    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-model-cache" (OuterVolumeSpecName: "model-cache") pod "5509cd06-e714-486f-b69d-2de167cc8a9c" (UID: "5509cd06-e714-486f-b69d-2de167cc8a9c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:09:59.722093 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.722004    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-model-cache\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:09:59.722093 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.722046    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-home\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:09:59.722093 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.722059    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-tmp-dir\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:09:59.724353 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.724321    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5509cd06-e714-486f-b69d-2de167cc8a9c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5509cd06-e714-486f-b69d-2de167cc8a9c" (UID: "5509cd06-e714-486f-b69d-2de167cc8a9c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:09:59.724579 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.724442    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5509cd06-e714-486f-b69d-2de167cc8a9c-kube-api-access-dfttd" (OuterVolumeSpecName: "kube-api-access-dfttd") pod "5509cd06-e714-486f-b69d-2de167cc8a9c" (UID: "5509cd06-e714-486f-b69d-2de167cc8a9c"). InnerVolumeSpecName "kube-api-access-dfttd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:09:59.724739 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.724717    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-dshm" (OuterVolumeSpecName: "dshm") pod "5509cd06-e714-486f-b69d-2de167cc8a9c" (UID: "5509cd06-e714-486f-b69d-2de167cc8a9c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:09:59.822573 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.822524    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5509cd06-e714-486f-b69d-2de167cc8a9c-tls-certs\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:09:59.822573 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.822569    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfttd\" (UniqueName: \"kubernetes.io/projected/5509cd06-e714-486f-b69d-2de167cc8a9c-kube-api-access-dfttd\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:09:59.822781 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:09:59.822584    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5509cd06-e714-486f-b69d-2de167cc8a9c-dshm\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:10:00.206097 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.206062    2564 generic.go:356] "Generic (PLEG): container finished" podID="5509cd06-e714-486f-b69d-2de167cc8a9c" containerID="30287f4d9c49d8621cc326d976a60bf92a7f696f68557e363b47c4b88bb86bd6" exitCode=0
Jul 13 18:10:00.206295 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.206109    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"
Jul 13 18:10:00.206295 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.206148    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv" event={"ID":"5509cd06-e714-486f-b69d-2de167cc8a9c","Type":"ContainerDied","Data":"30287f4d9c49d8621cc326d976a60bf92a7f696f68557e363b47c4b88bb86bd6"}
Jul 13 18:10:00.206295 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.206191    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv" event={"ID":"5509cd06-e714-486f-b69d-2de167cc8a9c","Type":"ContainerDied","Data":"0c6b827cbefeba5f363089e643214a0c6b975ffda55da272129a65b8765c8d01"}
Jul 13 18:10:00.206295 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.206213    2564 scope.go:117] "RemoveContainer" containerID="30287f4d9c49d8621cc326d976a60bf92a7f696f68557e363b47c4b88bb86bd6"
Jul 13 18:10:00.216016 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.215998    2564 scope.go:117] "RemoveContainer" containerID="30287f4d9c49d8621cc326d976a60bf92a7f696f68557e363b47c4b88bb86bd6"
Jul 13 18:10:00.216485 ip-10-0-137-223 kubenswrapper[2564]: E0713 18:10:00.216463    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30287f4d9c49d8621cc326d976a60bf92a7f696f68557e363b47c4b88bb86bd6\": container with ID starting with 30287f4d9c49d8621cc326d976a60bf92a7f696f68557e363b47c4b88bb86bd6 not found: ID does not exist" containerID="30287f4d9c49d8621cc326d976a60bf92a7f696f68557e363b47c4b88bb86bd6"
Jul 13 18:10:00.216553 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.216499    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30287f4d9c49d8621cc326d976a60bf92a7f696f68557e363b47c4b88bb86bd6"} err="failed to get container status \"30287f4d9c49d8621cc326d976a60bf92a7f696f68557e363b47c4b88bb86bd6\": rpc error: code = NotFound desc = could not find container \"30287f4d9c49d8621cc326d976a60bf92a7f696f68557e363b47c4b88bb86bd6\": container with ID starting with 30287f4d9c49d8621cc326d976a60bf92a7f696f68557e363b47c4b88bb86bd6 not found: ID does not exist"
Jul 13 18:10:00.227847 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.227805    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"]
Jul 13 18:10:00.232464 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.232430    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d09cc8/test-model-d09cc8-kserve-7759c66bff-cxdmv"]
Jul 13 18:10:00.345938 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.345896    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f" podUID="78cb91b7-cac6-4d28-8ae8-e11e51fdf36c" containerName="main" containerID="cri-o://ca3c28f66040e9267fe0e0ed65be90cca50d40e7d066ca4d1a7ef02f41ced91c" gracePeriod=45
Jul 13 18:10:00.594474 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.594444    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:10:00.631242 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.631205    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-tmp-dir\") pod \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") "
Jul 13 18:10:00.631435 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.631314    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-tls-certs\") pod \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") "
Jul 13 18:10:00.631435 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.631347    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-home\") pod \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") "
Jul 13 18:10:00.631435 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.631376    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5hhq\" (UniqueName: \"kubernetes.io/projected/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-kube-api-access-r5hhq\") pod \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") "
Jul 13 18:10:00.631435 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.631414    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-dshm\") pod \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") "
Jul 13 18:10:00.631435 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.631430    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-model-cache\") pod \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\" (UID: \"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c\") "
Jul 13 18:10:00.631692 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.631593    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "78cb91b7-cac6-4d28-8ae8-e11e51fdf36c" (UID: "78cb91b7-cac6-4d28-8ae8-e11e51fdf36c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:10:00.631692 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.631665    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-home" (OuterVolumeSpecName: "home") pod "78cb91b7-cac6-4d28-8ae8-e11e51fdf36c" (UID: "78cb91b7-cac6-4d28-8ae8-e11e51fdf36c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:10:00.631798 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.631725    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-model-cache" (OuterVolumeSpecName: "model-cache") pod "78cb91b7-cac6-4d28-8ae8-e11e51fdf36c" (UID: "78cb91b7-cac6-4d28-8ae8-e11e51fdf36c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:10:00.633686 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.633655    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-dshm" (OuterVolumeSpecName: "dshm") pod "78cb91b7-cac6-4d28-8ae8-e11e51fdf36c" (UID: "78cb91b7-cac6-4d28-8ae8-e11e51fdf36c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:10:00.633819 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.633745    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-kube-api-access-r5hhq" (OuterVolumeSpecName: "kube-api-access-r5hhq") pod "78cb91b7-cac6-4d28-8ae8-e11e51fdf36c" (UID: "78cb91b7-cac6-4d28-8ae8-e11e51fdf36c"). InnerVolumeSpecName "kube-api-access-r5hhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:10:00.633819 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.633778    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "78cb91b7-cac6-4d28-8ae8-e11e51fdf36c" (UID: "78cb91b7-cac6-4d28-8ae8-e11e51fdf36c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:10:00.732603 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.732501    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-tmp-dir\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:10:00.732603 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.732540    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-tls-certs\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:10:00.732603 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.732549    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-home\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:10:00.732603 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.732558    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5hhq\" (UniqueName: \"kubernetes.io/projected/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-kube-api-access-r5hhq\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:10:00.732603 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.732566    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-dshm\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:10:00.732603 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:00.732574    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c-model-cache\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:10:01.010027 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:01.009944    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5509cd06-e714-486f-b69d-2de167cc8a9c" path="/var/lib/kubelet/pods/5509cd06-e714-486f-b69d-2de167cc8a9c/volumes"
Jul 13 18:10:01.212571 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:01.212536    2564 generic.go:356] "Generic (PLEG): container finished" podID="78cb91b7-cac6-4d28-8ae8-e11e51fdf36c" containerID="ca3c28f66040e9267fe0e0ed65be90cca50d40e7d066ca4d1a7ef02f41ced91c" exitCode=0
Jul 13 18:10:01.212748 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:01.212579    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"
Jul 13 18:10:01.212748 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:01.212619    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f" event={"ID":"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c","Type":"ContainerDied","Data":"ca3c28f66040e9267fe0e0ed65be90cca50d40e7d066ca4d1a7ef02f41ced91c"}
Jul 13 18:10:01.212748 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:01.212658    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f" event={"ID":"78cb91b7-cac6-4d28-8ae8-e11e51fdf36c","Type":"ContainerDied","Data":"dc68c8bb131ecefe74a4702fa4c57752e73598361831793a0a6227121cff0eee"}
Jul 13 18:10:01.212748 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:01.212674    2564 scope.go:117] "RemoveContainer" containerID="ca3c28f66040e9267fe0e0ed65be90cca50d40e7d066ca4d1a7ef02f41ced91c"
Jul 13 18:10:01.221086 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:01.221063    2564 scope.go:117] "RemoveContainer" containerID="ca3c28f66040e9267fe0e0ed65be90cca50d40e7d066ca4d1a7ef02f41ced91c"
Jul 13 18:10:01.221412 ip-10-0-137-223 kubenswrapper[2564]: E0713 18:10:01.221392    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca3c28f66040e9267fe0e0ed65be90cca50d40e7d066ca4d1a7ef02f41ced91c\": container with ID starting with ca3c28f66040e9267fe0e0ed65be90cca50d40e7d066ca4d1a7ef02f41ced91c not found: ID does not exist" containerID="ca3c28f66040e9267fe0e0ed65be90cca50d40e7d066ca4d1a7ef02f41ced91c"
Jul 13 18:10:01.221480 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:01.221421    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca3c28f66040e9267fe0e0ed65be90cca50d40e7d066ca4d1a7ef02f41ced91c"} err="failed to get container status \"ca3c28f66040e9267fe0e0ed65be90cca50d40e7d066ca4d1a7ef02f41ced91c\": rpc error: code = NotFound desc = could not find container \"ca3c28f66040e9267fe0e0ed65be90cca50d40e7d066ca4d1a7ef02f41ced91c\": container with ID starting with ca3c28f66040e9267fe0e0ed65be90cca50d40e7d066ca4d1a7ef02f41ced91c not found: ID does not exist"
Jul 13 18:10:01.228028 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:01.228003    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"]
Jul 13 18:10:01.234395 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:01.234369    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-dc368b/test-model-dc368b-kserve-577545d79c-kpf6f"]
Jul 13 18:10:02.593443 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:02.593405    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:10:03.009710 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:03.009630    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78cb91b7-cac6-4d28-8ae8-e11e51fdf36c" path="/var/lib/kubelet/pods/78cb91b7-cac6-4d28-8ae8-e11e51fdf36c/volumes"
Jul 13 18:10:24.977655 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:24.977619    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:10:46.202383 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:10:46.202345    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:11:01.180902 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:11:01.180860    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:11:18.983265 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:11:18.983226    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:11:42.184530 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:11:42.184492    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:11:45.101763 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:11:45.101735    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 18:11:45.106595 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:11:45.106569    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 18:12:03.377694 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:03.377651    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:12:18.978757 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:18.978716    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:12:20.142341 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.142310    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"]
Jul 13 18:12:20.142770 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.142668    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5509cd06-e714-486f-b69d-2de167cc8a9c" containerName="main"
Jul 13 18:12:20.142770 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.142680    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5509cd06-e714-486f-b69d-2de167cc8a9c" containerName="main"
Jul 13 18:12:20.142770 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.142702    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78cb91b7-cac6-4d28-8ae8-e11e51fdf36c" containerName="main"
Jul 13 18:12:20.142770 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.142710    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="78cb91b7-cac6-4d28-8ae8-e11e51fdf36c" containerName="main"
Jul 13 18:12:20.142770 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.142763    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="78cb91b7-cac6-4d28-8ae8-e11e51fdf36c" containerName="main"
Jul 13 18:12:20.142770 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.142771    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5509cd06-e714-486f-b69d-2de167cc8a9c" containerName="main"
Jul 13 18:12:20.145864 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.145840    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.148052 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.148030    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a74fcd\"/\"auth-test-model-a74fcd-kserve-self-signed-certs\""
Jul 13 18:12:20.149014 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.148989    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a74fcd\"/\"default-dockercfg-s72l4\""
Jul 13 18:12:20.149203 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.149028    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a74fcd\"/\"openshift-service-ca.crt\""
Jul 13 18:12:20.149374 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.149075    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a74fcd\"/\"kube-root-ca.crt\""
Jul 13 18:12:20.156170 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.156140    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"]
Jul 13 18:12:20.223085 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.223047    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-home\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.223256 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.223091    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-tmp-dir\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.223256 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.223112    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4867b47e-3a18-4704-9109-2636b6a2e139-tls-certs\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.223256 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.223227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-model-cache\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.223414 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.223260    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-dshm\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.223414 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.223313    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9mhw\" (UniqueName: \"kubernetes.io/projected/4867b47e-3a18-4704-9109-2636b6a2e139-kube-api-access-d9mhw\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.324348 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.324302    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-model-cache\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.324348 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.324344    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-dshm\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.324557 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.324460    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9mhw\" (UniqueName: \"kubernetes.io/projected/4867b47e-3a18-4704-9109-2636b6a2e139-kube-api-access-d9mhw\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.324557 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.324511    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-home\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.324557 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.324541    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-tmp-dir\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.324765 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.324723    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4867b47e-3a18-4704-9109-2636b6a2e139-tls-certs\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.324909 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.324791    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-model-cache\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.324909 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.324826    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-tmp-dir\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.324909 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.324840    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-home\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.326620 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.326596    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-dshm\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.326989 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.326974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4867b47e-3a18-4704-9109-2636b6a2e139-tls-certs\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.332869 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.332844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9mhw\" (UniqueName: \"kubernetes.io/projected/4867b47e-3a18-4704-9109-2636b6a2e139-kube-api-access-d9mhw\") pod \"auth-test-model-a74fcd-kserve-85565b7559-q949g\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") " pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.457421 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.457316    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:20.591639 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.591612    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"]
Jul 13 18:12:20.594129 ip-10-0-137-223 kubenswrapper[2564]: W0713 18:12:20.594098    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4867b47e_3a18_4704_9109_2636b6a2e139.slice/crio-520750d56bbca95658aff0e73e71919266d789dd717935880a9fa8fc26cc9d98 WatchSource:0}: Error finding container 520750d56bbca95658aff0e73e71919266d789dd717935880a9fa8fc26cc9d98: Status 404 returned error can't find the container with id 520750d56bbca95658aff0e73e71919266d789dd717935880a9fa8fc26cc9d98
Jul 13 18:12:20.854181 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.854145    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g" event={"ID":"4867b47e-3a18-4704-9109-2636b6a2e139","Type":"ContainerStarted","Data":"80bcf13239507ca3b78d63beb5e03a6605ab67051fe3589b402a437a41174266"}
Jul 13 18:12:20.854418 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.854197    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g" event={"ID":"4867b47e-3a18-4704-9109-2636b6a2e139","Type":"ContainerStarted","Data":"520750d56bbca95658aff0e73e71919266d789dd717935880a9fa8fc26cc9d98"}
Jul 13 18:12:20.883294 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:20.883222    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g" podStartSLOduration=0.883205169 podStartE2EDuration="883.205169ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:12:20.881749791 +0000 UTC m=+2436.394925091" watchObservedRunningTime="2026-07-13 18:12:20.883205169 +0000 UTC m=+2436.396380434"
Jul 13 18:12:29.594625 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:29.594587    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:12:30.458018 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:30.457980    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:30.458212 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:30.458049    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:30.470419 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:30.470392    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:30.911773 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:30.911740    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:12:49.222477 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.222442    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"]
Jul 13 18:12:49.225674 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.225658    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.228616 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.228591    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-762866\"/\"auth-test-model-762866-kserve-self-signed-certs\""
Jul 13 18:12:49.228616 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.228604    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-762866\"/\"default-dockercfg-vf48q\""
Jul 13 18:12:49.228816 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.228632    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-762866\"/\"kube-root-ca.crt\""
Jul 13 18:12:49.228816 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.228610    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-762866\"/\"openshift-service-ca.crt\""
Jul 13 18:12:49.237355 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.237331    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"]
Jul 13 18:12:49.291474 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.291440    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beaf3de7-cd25-4bf1-8818-64f87942576e-tls-certs\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.291474 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.291482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-home\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.291724 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.291502    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlvf8\" (UniqueName: \"kubernetes.io/projected/beaf3de7-cd25-4bf1-8818-64f87942576e-kube-api-access-xlvf8\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.291724 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.291637    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-model-cache\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.291724 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.291690    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-dshm\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.291851 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.291728    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-tmp-dir\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.392914 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.392871    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-model-cache\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.393120 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.392940    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-dshm\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.393120 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.392995    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-tmp-dir\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.393120 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.393067    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beaf3de7-cd25-4bf1-8818-64f87942576e-tls-certs\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.393120 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.393102    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-home\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.393371 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.393130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlvf8\" (UniqueName: \"kubernetes.io/projected/beaf3de7-cd25-4bf1-8818-64f87942576e-kube-api-access-xlvf8\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.393431 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.393390    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-model-cache\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.393502 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.393477    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-tmp-dir\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.393502 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.393495    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-home\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.395258 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.395236    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-dshm\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.395538 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.395522    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beaf3de7-cd25-4bf1-8818-64f87942576e-tls-certs\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.405765 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.405745    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlvf8\" (UniqueName: \"kubernetes.io/projected/beaf3de7-cd25-4bf1-8818-64f87942576e-kube-api-access-xlvf8\") pod \"auth-test-model-762866-kserve-65f68fb7f9-7gvl2\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") " pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.534255 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.534147    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:49.671019 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.669212    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"]
Jul 13 18:12:49.674179 ip-10-0-137-223 kubenswrapper[2564]: W0713 18:12:49.673744    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbeaf3de7_cd25_4bf1_8818_64f87942576e.slice/crio-46733812145adfcaa98c1850788019cd4751e3ecfb634c76a6fb47220e4ece35 WatchSource:0}: Error finding container 46733812145adfcaa98c1850788019cd4751e3ecfb634c76a6fb47220e4ece35: Status 404 returned error can't find the container with id 46733812145adfcaa98c1850788019cd4751e3ecfb634c76a6fb47220e4ece35
Jul 13 18:12:49.983310 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.983262    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2" event={"ID":"beaf3de7-cd25-4bf1-8818-64f87942576e","Type":"ContainerStarted","Data":"729126a2fb4f8e9a13a95a359782d574e326e8f1ed32075ced91a5ad066264bb"}
Jul 13 18:12:49.983468 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:49.983319    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2" event={"ID":"beaf3de7-cd25-4bf1-8818-64f87942576e","Type":"ContainerStarted","Data":"46733812145adfcaa98c1850788019cd4751e3ecfb634c76a6fb47220e4ece35"}
Jul 13 18:12:50.020695 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:50.020642    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2" podStartSLOduration=1.020624176 podStartE2EDuration="1.020624176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:12:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:12:50.01893959 +0000 UTC m=+2465.532114854" watchObservedRunningTime="2026-07-13 18:12:50.020624176 +0000 UTC m=+2465.533799469"
Jul 13 18:12:52.781549 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:52.781514    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:12:59.535114 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:59.535070    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:59.535114 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:59.535126    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:12:59.547923 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:12:59.547895    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:13:00.037763 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:13:00.037721    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:13:09.678182 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:13:09.678141    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:13:27.795145 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:13:27.795111    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:13:44.979185 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:13:44.979109    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:14:01.577937 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:14:01.577892    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:14:16.878120 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:14:16.878082    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:14:34.382572 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:14:34.382527    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:14:51.476378 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:14:51.476343    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:14:55.388012 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:14:55.387975    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"]
Jul 13 18:14:56.347629 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:14:56.347592    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"]
Jul 13 18:15:04.823814 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.823772    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"]
Jul 13 18:15:04.827236 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.827212    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.829422 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.829398    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a74fcd\"/\"sub-test-model-a74fcd-kserve-self-signed-certs\""
Jul 13 18:15:04.839420 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.839389    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"]
Jul 13 18:15:04.890916 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.890882    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-home\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.891122 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.890939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-model-cache\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.891122 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.890985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-tmp-dir\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.891122 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.891013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2f0ec5b-e7dd-4436-820f-006393aea458-tls-certs\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.891122 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.891037    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8r7r\" (UniqueName: \"kubernetes.io/projected/a2f0ec5b-e7dd-4436-820f-006393aea458-kube-api-access-s8r7r\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.891122 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.891056    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-dshm\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.991581 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.991532    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-home\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.991581 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.991586    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-model-cache\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.991833 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.991623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-tmp-dir\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.991833 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.991646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2f0ec5b-e7dd-4436-820f-006393aea458-tls-certs\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.991833 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.991675    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8r7r\" (UniqueName: \"kubernetes.io/projected/a2f0ec5b-e7dd-4436-820f-006393aea458-kube-api-access-s8r7r\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.991833 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.991702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-dshm\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.992044 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.992020    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-home\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.992137 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.992108    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-tmp-dir\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.992137 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.992125    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-model-cache\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.993881 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.993861    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-dshm\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.994225 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.994209    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2f0ec5b-e7dd-4436-820f-006393aea458-tls-certs\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:04.999715 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:04.999687    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8r7r\" (UniqueName: \"kubernetes.io/projected/a2f0ec5b-e7dd-4436-820f-006393aea458-kube-api-access-s8r7r\") pod \"sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") " pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:05.136780 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:05.136678    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:05.271762 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:05.271734    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"]
Jul 13 18:15:05.274391 ip-10-0-137-223 kubenswrapper[2564]: W0713 18:15:05.274360    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2f0ec5b_e7dd_4436_820f_006393aea458.slice/crio-7d90d569909aed371043e87fa131a7c38a9fd3581e65262a4ae5f9b703b9e3f5 WatchSource:0}: Error finding container 7d90d569909aed371043e87fa131a7c38a9fd3581e65262a4ae5f9b703b9e3f5: Status 404 returned error can't find the container with id 7d90d569909aed371043e87fa131a7c38a9fd3581e65262a4ae5f9b703b9e3f5
Jul 13 18:15:05.596059 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:05.596025    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9" event={"ID":"a2f0ec5b-e7dd-4436-820f-006393aea458","Type":"ContainerStarted","Data":"90c871833f743c80b9da9e7fd2b20f941997f22492b5f43989edc0bbbaa6fd75"}
Jul 13 18:15:05.596059 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:05.596065    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9" event={"ID":"a2f0ec5b-e7dd-4436-820f-006393aea458","Type":"ContainerStarted","Data":"7d90d569909aed371043e87fa131a7c38a9fd3581e65262a4ae5f9b703b9e3f5"}
Jul 13 18:15:05.611867 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:05.611806    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9" podStartSLOduration=1.611788089 podStartE2EDuration="1.611788089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:15:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:15:05.610497451 +0000 UTC m=+2601.123672694" watchObservedRunningTime="2026-07-13 18:15:05.611788089 +0000 UTC m=+2601.124963354"
Jul 13 18:15:08.080857 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:08.080764    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:15:10.408991 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.408948    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g" podUID="4867b47e-3a18-4704-9109-2636b6a2e139" containerName="main" containerID="cri-o://80bcf13239507ca3b78d63beb5e03a6605ab67051fe3589b402a437a41174266" gracePeriod=45
Jul 13 18:15:10.632117 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.632084    2564 generic.go:356] "Generic (PLEG): container finished" podID="4867b47e-3a18-4704-9109-2636b6a2e139" containerID="80bcf13239507ca3b78d63beb5e03a6605ab67051fe3589b402a437a41174266" exitCode=0
Jul 13 18:15:10.632285 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.632165    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g" event={"ID":"4867b47e-3a18-4704-9109-2636b6a2e139","Type":"ContainerDied","Data":"80bcf13239507ca3b78d63beb5e03a6605ab67051fe3589b402a437a41174266"}
Jul 13 18:15:10.667643 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.667566    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:15:10.740613 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.740574    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-home\") pod \"4867b47e-3a18-4704-9109-2636b6a2e139\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") "
Jul 13 18:15:10.740810 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.740626    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-dshm\") pod \"4867b47e-3a18-4704-9109-2636b6a2e139\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") "
Jul 13 18:15:10.740810 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.740663    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-model-cache\") pod \"4867b47e-3a18-4704-9109-2636b6a2e139\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") "
Jul 13 18:15:10.740810 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.740692    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-tmp-dir\") pod \"4867b47e-3a18-4704-9109-2636b6a2e139\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") "
Jul 13 18:15:10.740810 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.740717    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9mhw\" (UniqueName: \"kubernetes.io/projected/4867b47e-3a18-4704-9109-2636b6a2e139-kube-api-access-d9mhw\") pod \"4867b47e-3a18-4704-9109-2636b6a2e139\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") "
Jul 13 18:15:10.740810 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.740744    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4867b47e-3a18-4704-9109-2636b6a2e139-tls-certs\") pod \"4867b47e-3a18-4704-9109-2636b6a2e139\" (UID: \"4867b47e-3a18-4704-9109-2636b6a2e139\") "
Jul 13 18:15:10.741034 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.740891    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-home" (OuterVolumeSpecName: "home") pod "4867b47e-3a18-4704-9109-2636b6a2e139" (UID: "4867b47e-3a18-4704-9109-2636b6a2e139"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:15:10.741034 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.740991    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-model-cache" (OuterVolumeSpecName: "model-cache") pod "4867b47e-3a18-4704-9109-2636b6a2e139" (UID: "4867b47e-3a18-4704-9109-2636b6a2e139"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:15:10.741034 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.741008    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4867b47e-3a18-4704-9109-2636b6a2e139" (UID: "4867b47e-3a18-4704-9109-2636b6a2e139"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:15:10.741122 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.741055    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-home\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:15:10.741122 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.741067    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-model-cache\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:15:10.743097 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.743067    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-dshm" (OuterVolumeSpecName: "dshm") pod "4867b47e-3a18-4704-9109-2636b6a2e139" (UID: "4867b47e-3a18-4704-9109-2636b6a2e139"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:15:10.743212 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.743154    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4867b47e-3a18-4704-9109-2636b6a2e139-kube-api-access-d9mhw" (OuterVolumeSpecName: "kube-api-access-d9mhw") pod "4867b47e-3a18-4704-9109-2636b6a2e139" (UID: "4867b47e-3a18-4704-9109-2636b6a2e139"). InnerVolumeSpecName "kube-api-access-d9mhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:15:10.743212 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.743161    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4867b47e-3a18-4704-9109-2636b6a2e139-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4867b47e-3a18-4704-9109-2636b6a2e139" (UID: "4867b47e-3a18-4704-9109-2636b6a2e139"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:15:10.841532 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.841495    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-dshm\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:15:10.841532 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.841526    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4867b47e-3a18-4704-9109-2636b6a2e139-tmp-dir\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:15:10.841532 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.841538    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9mhw\" (UniqueName: \"kubernetes.io/projected/4867b47e-3a18-4704-9109-2636b6a2e139-kube-api-access-d9mhw\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:15:10.841770 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:10.841548    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4867b47e-3a18-4704-9109-2636b6a2e139-tls-certs\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:15:11.369018 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.368977    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2" podUID="beaf3de7-cd25-4bf1-8818-64f87942576e" containerName="main" containerID="cri-o://729126a2fb4f8e9a13a95a359782d574e326e8f1ed32075ced91a5ad066264bb" gracePeriod=45
Jul 13 18:15:11.628017 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.627956    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:15:11.637431 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.637404    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"
Jul 13 18:15:11.637588 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.637405    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g" event={"ID":"4867b47e-3a18-4704-9109-2636b6a2e139","Type":"ContainerDied","Data":"520750d56bbca95658aff0e73e71919266d789dd717935880a9fa8fc26cc9d98"}
Jul 13 18:15:11.637588 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.637526    2564 scope.go:117] "RemoveContainer" containerID="80bcf13239507ca3b78d63beb5e03a6605ab67051fe3589b402a437a41174266"
Jul 13 18:15:11.638747 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.638720    2564 generic.go:356] "Generic (PLEG): container finished" podID="beaf3de7-cd25-4bf1-8818-64f87942576e" containerID="729126a2fb4f8e9a13a95a359782d574e326e8f1ed32075ced91a5ad066264bb" exitCode=0
Jul 13 18:15:11.638834 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.638767    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"
Jul 13 18:15:11.638834 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.638767    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2" event={"ID":"beaf3de7-cd25-4bf1-8818-64f87942576e","Type":"ContainerDied","Data":"729126a2fb4f8e9a13a95a359782d574e326e8f1ed32075ced91a5ad066264bb"}
Jul 13 18:15:11.638834 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.638805    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2" event={"ID":"beaf3de7-cd25-4bf1-8818-64f87942576e","Type":"ContainerDied","Data":"46733812145adfcaa98c1850788019cd4751e3ecfb634c76a6fb47220e4ece35"}
Jul 13 18:15:11.647025 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.646927    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlvf8\" (UniqueName: \"kubernetes.io/projected/beaf3de7-cd25-4bf1-8818-64f87942576e-kube-api-access-xlvf8\") pod \"beaf3de7-cd25-4bf1-8818-64f87942576e\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") "
Jul 13 18:15:11.647025 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.646962    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-tmp-dir\") pod \"beaf3de7-cd25-4bf1-8818-64f87942576e\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") "
Jul 13 18:15:11.647025 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.647001    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-home\") pod \"beaf3de7-cd25-4bf1-8818-64f87942576e\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") "
Jul 13 18:15:11.647196 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.647037    2564 scope.go:117] "RemoveContainer" containerID="729126a2fb4f8e9a13a95a359782d574e326e8f1ed32075ced91a5ad066264bb"
Jul 13 18:15:11.647196 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.647050    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-model-cache\") pod \"beaf3de7-cd25-4bf1-8818-64f87942576e\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") "
Jul 13 18:15:11.647196 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.647099    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-dshm\") pod \"beaf3de7-cd25-4bf1-8818-64f87942576e\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") "
Jul 13 18:15:11.647196 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.647129    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beaf3de7-cd25-4bf1-8818-64f87942576e-tls-certs\") pod \"beaf3de7-cd25-4bf1-8818-64f87942576e\" (UID: \"beaf3de7-cd25-4bf1-8818-64f87942576e\") "
Jul 13 18:15:11.647696 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.647667    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-home" (OuterVolumeSpecName: "home") pod "beaf3de7-cd25-4bf1-8818-64f87942576e" (UID: "beaf3de7-cd25-4bf1-8818-64f87942576e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:15:11.647943 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.647916    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-model-cache" (OuterVolumeSpecName: "model-cache") pod "beaf3de7-cd25-4bf1-8818-64f87942576e" (UID: "beaf3de7-cd25-4bf1-8818-64f87942576e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:15:11.648165 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.648141    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "beaf3de7-cd25-4bf1-8818-64f87942576e" (UID: "beaf3de7-cd25-4bf1-8818-64f87942576e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:15:11.650531 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.650509    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-dshm" (OuterVolumeSpecName: "dshm") pod "beaf3de7-cd25-4bf1-8818-64f87942576e" (UID: "beaf3de7-cd25-4bf1-8818-64f87942576e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:15:11.650628 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.650541    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beaf3de7-cd25-4bf1-8818-64f87942576e-kube-api-access-xlvf8" (OuterVolumeSpecName: "kube-api-access-xlvf8") pod "beaf3de7-cd25-4bf1-8818-64f87942576e" (UID: "beaf3de7-cd25-4bf1-8818-64f87942576e"). InnerVolumeSpecName "kube-api-access-xlvf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:15:11.650628 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.650568    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/beaf3de7-cd25-4bf1-8818-64f87942576e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "beaf3de7-cd25-4bf1-8818-64f87942576e" (UID: "beaf3de7-cd25-4bf1-8818-64f87942576e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:15:11.663499 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.663469    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"]
Jul 13 18:15:11.669021 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.668996    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/auth-test-model-a74fcd-kserve-85565b7559-q949g"]
Jul 13 18:15:11.670853 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.670835    2564 scope.go:117] "RemoveContainer" containerID="729126a2fb4f8e9a13a95a359782d574e326e8f1ed32075ced91a5ad066264bb"
Jul 13 18:15:11.671196 ip-10-0-137-223 kubenswrapper[2564]: E0713 18:15:11.671176    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"729126a2fb4f8e9a13a95a359782d574e326e8f1ed32075ced91a5ad066264bb\": container with ID starting with 729126a2fb4f8e9a13a95a359782d574e326e8f1ed32075ced91a5ad066264bb not found: ID does not exist" containerID="729126a2fb4f8e9a13a95a359782d574e326e8f1ed32075ced91a5ad066264bb"
Jul 13 18:15:11.671249 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.671207    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"729126a2fb4f8e9a13a95a359782d574e326e8f1ed32075ced91a5ad066264bb"} err="failed to get container status \"729126a2fb4f8e9a13a95a359782d574e326e8f1ed32075ced91a5ad066264bb\": rpc error: code = NotFound desc = could not find container \"729126a2fb4f8e9a13a95a359782d574e326e8f1ed32075ced91a5ad066264bb\": container with ID starting with 729126a2fb4f8e9a13a95a359782d574e326e8f1ed32075ced91a5ad066264bb not found: ID does not exist"
Jul 13 18:15:11.748813 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.748770    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlvf8\" (UniqueName: \"kubernetes.io/projected/beaf3de7-cd25-4bf1-8818-64f87942576e-kube-api-access-xlvf8\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:15:11.748813 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.748805    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-tmp-dir\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:15:11.748813 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.748815    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-home\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:15:11.748813 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.748823    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-model-cache\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:15:11.749075 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.748835    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/beaf3de7-cd25-4bf1-8818-64f87942576e-dshm\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:15:11.749075 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.748847    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/beaf3de7-cd25-4bf1-8818-64f87942576e-tls-certs\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:15:11.961068 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.961036    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"]
Jul 13 18:15:11.969131 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:11.969106    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-762866/auth-test-model-762866-kserve-65f68fb7f9-7gvl2"]
Jul 13 18:15:13.009613 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:13.009580    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4867b47e-3a18-4704-9109-2636b6a2e139" path="/var/lib/kubelet/pods/4867b47e-3a18-4704-9109-2636b6a2e139/volumes"
Jul 13 18:15:13.009993 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:13.009965    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beaf3de7-cd25-4bf1-8818-64f87942576e" path="/var/lib/kubelet/pods/beaf3de7-cd25-4bf1-8818-64f87942576e/volumes"
Jul 13 18:15:15.137005 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:15.136957    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:15.137444 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:15.137044    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:15.149736 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:15.149699    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:15.668961 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:15.668933    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:15:19.625339 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.625299    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"]
Jul 13 18:15:19.625791 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.625763    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4867b47e-3a18-4704-9109-2636b6a2e139" containerName="main"
Jul 13 18:15:19.625791 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.625782    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4867b47e-3a18-4704-9109-2636b6a2e139" containerName="main"
Jul 13 18:15:19.625902 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.625811    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beaf3de7-cd25-4bf1-8818-64f87942576e" containerName="main"
Jul 13 18:15:19.625902 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.625824    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="beaf3de7-cd25-4bf1-8818-64f87942576e" containerName="main"
Jul 13 18:15:19.625995 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.625914    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="beaf3de7-cd25-4bf1-8818-64f87942576e" containerName="main"
Jul 13 18:15:19.625995 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.625927    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4867b47e-3a18-4704-9109-2636b6a2e139" containerName="main"
Jul 13 18:15:19.632035 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.631985    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.634669 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.634642    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-762866\"/\"default-dockercfg-vf48q\""
Jul 13 18:15:19.635460 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.635430    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-762866\"/\"openshift-service-ca.crt\""
Jul 13 18:15:19.635582 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.635476    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-762866\"/\"sub-test-model-762866-kserve-self-signed-certs\""
Jul 13 18:15:19.635707 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.635640    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-762866\"/\"kube-root-ca.crt\""
Jul 13 18:15:19.640439 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.640413    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"]
Jul 13 18:15:19.714880 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.714843    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-tmp-dir\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.714880 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.714887    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfwtq\" (UniqueName: \"kubernetes.io/projected/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-kube-api-access-nfwtq\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.715093 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.714916    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-home\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.715093 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.714977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-model-cache\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.715093 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.715022    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-tls-certs\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.715093 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.715061    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-dshm\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.815587 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.815553    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-tmp-dir\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.815587 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.815598    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfwtq\" (UniqueName: \"kubernetes.io/projected/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-kube-api-access-nfwtq\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.815827 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.815630    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-home\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.815827 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.815664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-model-cache\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.815827 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.815698    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-tls-certs\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.815983 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.815867    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-dshm\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.816037 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.816017    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-tmp-dir\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.816132 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.816092    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-home\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.816132 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.816109    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-model-cache\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.818047 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.818025    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-dshm\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.818182 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.818165    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-tls-certs\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.829002 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.828972    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfwtq\" (UniqueName: \"kubernetes.io/projected/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-kube-api-access-nfwtq\") pod \"sub-test-model-762866-kserve-78694b7d9-7scm9\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") " pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:19.943139 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:19.943059    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:20.088387 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:20.088349    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"]
Jul 13 18:15:20.091732 ip-10-0-137-223 kubenswrapper[2564]: W0713 18:15:20.091702    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaac66927_a7cc_4e7f_ad21_bd9495c4b20d.slice/crio-52aa2ba8175cd8f22826ffeebbaa4dc033965ea89b6d2e53acbde63c238ced61 WatchSource:0}: Error finding container 52aa2ba8175cd8f22826ffeebbaa4dc033965ea89b6d2e53acbde63c238ced61: Status 404 returned error can't find the container with id 52aa2ba8175cd8f22826ffeebbaa4dc033965ea89b6d2e53acbde63c238ced61
Jul 13 18:15:20.680588 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:20.680551    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9" event={"ID":"aac66927-a7cc-4e7f-ad21-bd9495c4b20d","Type":"ContainerStarted","Data":"11005a6bf15d7722eb3a307c47ac3b95aa9aef2b5792bb0a6439a82550fdbd23"}
Jul 13 18:15:20.680588 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:20.680593    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9" event={"ID":"aac66927-a7cc-4e7f-ad21-bd9495c4b20d","Type":"ContainerStarted","Data":"52aa2ba8175cd8f22826ffeebbaa4dc033965ea89b6d2e53acbde63c238ced61"}
Jul 13 18:15:20.698198 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:20.698134    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9" podStartSLOduration=1.698114377 podStartE2EDuration="1.698114377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:15:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:15:20.696402371 +0000 UTC m=+2616.209577659" watchObservedRunningTime="2026-07-13 18:15:20.698114377 +0000 UTC m=+2616.211289649"
Jul 13 18:15:25.083699 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:25.083661    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:15:29.943868 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:29.943814    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:29.943868 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:29.943877    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:29.956311 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:29.956257    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:30.739096 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:30.739063    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:15:52.501874 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:15:52.501832    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:16:06.592128 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:06.592081    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:16:14.067749 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:14.067709    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"]
Jul 13 18:16:14.913164 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:14.913129    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"]
Jul 13 18:16:21.082986 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:21.082947    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:16:24.528171 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.528140    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"]
Jul 13 18:16:24.531382 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.531363    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.533708 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.533686    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a74fcd\"/\"rate-test-model-a74fcd-kserve-self-signed-certs\""
Jul 13 18:16:24.540845 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.540822    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"]
Jul 13 18:16:24.677920 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.677884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-model-cache\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.678112 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.677931    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-tmp-dir\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.678112 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.677987    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d2cc350-dafa-4f4d-81c1-5acf06d49494-tls-certs\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.678112 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.678027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr9vb\" (UniqueName: \"kubernetes.io/projected/8d2cc350-dafa-4f4d-81c1-5acf06d49494-kube-api-access-pr9vb\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.678112 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.678060    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-dshm\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.678112 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.678080    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-home\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.778883 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.778785    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-model-cache\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.778883 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.778829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-tmp-dir\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.778883 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.778846    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d2cc350-dafa-4f4d-81c1-5acf06d49494-tls-certs\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.779164 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.778969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr9vb\" (UniqueName: \"kubernetes.io/projected/8d2cc350-dafa-4f4d-81c1-5acf06d49494-kube-api-access-pr9vb\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.779164 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.779021    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-dshm\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.779164 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.779044    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-home\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.779365 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.779217    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-tmp-dir\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.779478 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.779451    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-home\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.779604 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.779514    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-model-cache\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.781244 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.781221    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-dshm\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.781351 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.781336    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d2cc350-dafa-4f4d-81c1-5acf06d49494-tls-certs\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.787293 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.787247    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr9vb\" (UniqueName: \"kubernetes.io/projected/8d2cc350-dafa-4f4d-81c1-5acf06d49494-kube-api-access-pr9vb\") pod \"rate-test-model-a74fcd-kserve-d49486d6c-pq8br\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") " pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.841648 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.841608    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:24.978666 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:24.978644    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"]
Jul 13 18:16:24.980763 ip-10-0-137-223 kubenswrapper[2564]: W0713 18:16:24.980735    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d2cc350_dafa_4f4d_81c1_5acf06d49494.slice/crio-b2140f496e2a8b20d188f5bd2165f336bd57b1674435f73efd261ff5ef65b651 WatchSource:0}: Error finding container b2140f496e2a8b20d188f5bd2165f336bd57b1674435f73efd261ff5ef65b651: Status 404 returned error can't find the container with id b2140f496e2a8b20d188f5bd2165f336bd57b1674435f73efd261ff5ef65b651
Jul 13 18:16:25.977890 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:25.977851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br" event={"ID":"8d2cc350-dafa-4f4d-81c1-5acf06d49494","Type":"ContainerStarted","Data":"2ab9f33dcd441c4121283bc03a11e4957a6521c45146c92b6c69b0c778a7ffac"}
Jul 13 18:16:25.978289 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:25.977902    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br" event={"ID":"8d2cc350-dafa-4f4d-81c1-5acf06d49494","Type":"ContainerStarted","Data":"b2140f496e2a8b20d188f5bd2165f336bd57b1674435f73efd261ff5ef65b651"}
Jul 13 18:16:25.994346 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:25.994297    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br" podStartSLOduration=1.9942804189999999 podStartE2EDuration="1.994280419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:16:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:16:25.993041981 +0000 UTC m=+2681.506217250" watchObservedRunningTime="2026-07-13 18:16:25.994280419 +0000 UTC m=+2681.507455676"
Jul 13 18:16:29.087971 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.087920    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9" podUID="a2f0ec5b-e7dd-4436-820f-006393aea458" containerName="main" containerID="cri-o://90c871833f743c80b9da9e7fd2b20f941997f22492b5f43989edc0bbbaa6fd75" gracePeriod=45
Jul 13 18:16:29.346805 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.346746    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:16:29.420990 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.420955    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8r7r\" (UniqueName: \"kubernetes.io/projected/a2f0ec5b-e7dd-4436-820f-006393aea458-kube-api-access-s8r7r\") pod \"a2f0ec5b-e7dd-4436-820f-006393aea458\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") "
Jul 13 18:16:29.421170 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.421004    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-home\") pod \"a2f0ec5b-e7dd-4436-820f-006393aea458\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") "
Jul 13 18:16:29.421170 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.421052    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-dshm\") pod \"a2f0ec5b-e7dd-4436-820f-006393aea458\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") "
Jul 13 18:16:29.421170 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.421089    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-tmp-dir\") pod \"a2f0ec5b-e7dd-4436-820f-006393aea458\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") "
Jul 13 18:16:29.421170 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.421113    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2f0ec5b-e7dd-4436-820f-006393aea458-tls-certs\") pod \"a2f0ec5b-e7dd-4436-820f-006393aea458\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") "
Jul 13 18:16:29.421170 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.421158    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-model-cache\") pod \"a2f0ec5b-e7dd-4436-820f-006393aea458\" (UID: \"a2f0ec5b-e7dd-4436-820f-006393aea458\") "
Jul 13 18:16:29.421491 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.421384    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-home" (OuterVolumeSpecName: "home") pod "a2f0ec5b-e7dd-4436-820f-006393aea458" (UID: "a2f0ec5b-e7dd-4436-820f-006393aea458"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:16:29.421491 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.421427    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a2f0ec5b-e7dd-4436-820f-006393aea458" (UID: "a2f0ec5b-e7dd-4436-820f-006393aea458"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:16:29.421594 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.421549    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-home\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:16:29.421594 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.421567    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-tmp-dir\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:16:29.421594 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.421565    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-model-cache" (OuterVolumeSpecName: "model-cache") pod "a2f0ec5b-e7dd-4436-820f-006393aea458" (UID: "a2f0ec5b-e7dd-4436-820f-006393aea458"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:16:29.423197 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.423170    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-dshm" (OuterVolumeSpecName: "dshm") pod "a2f0ec5b-e7dd-4436-820f-006393aea458" (UID: "a2f0ec5b-e7dd-4436-820f-006393aea458"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:16:29.423693 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.423670    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2f0ec5b-e7dd-4436-820f-006393aea458-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a2f0ec5b-e7dd-4436-820f-006393aea458" (UID: "a2f0ec5b-e7dd-4436-820f-006393aea458"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:16:29.423779 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.423672    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2f0ec5b-e7dd-4436-820f-006393aea458-kube-api-access-s8r7r" (OuterVolumeSpecName: "kube-api-access-s8r7r") pod "a2f0ec5b-e7dd-4436-820f-006393aea458" (UID: "a2f0ec5b-e7dd-4436-820f-006393aea458"). InnerVolumeSpecName "kube-api-access-s8r7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:16:29.522343 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.522262    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-dshm\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:16:29.522343 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.522334    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2f0ec5b-e7dd-4436-820f-006393aea458-tls-certs\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:16:29.522343 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.522348    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2f0ec5b-e7dd-4436-820f-006393aea458-model-cache\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:16:29.522590 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.522358    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8r7r\" (UniqueName: \"kubernetes.io/projected/a2f0ec5b-e7dd-4436-820f-006393aea458-kube-api-access-s8r7r\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:16:29.933880 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.933839    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9" podUID="aac66927-a7cc-4e7f-ad21-bd9495c4b20d" containerName="main" containerID="cri-o://11005a6bf15d7722eb3a307c47ac3b95aa9aef2b5792bb0a6439a82550fdbd23" gracePeriod=45
Jul 13 18:16:29.998390 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.998352    2564 generic.go:356] "Generic (PLEG): container finished" podID="a2f0ec5b-e7dd-4436-820f-006393aea458" containerID="90c871833f743c80b9da9e7fd2b20f941997f22492b5f43989edc0bbbaa6fd75" exitCode=0
Jul 13 18:16:29.998557 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.998398    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"
Jul 13 18:16:29.998557 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.998399    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9" event={"ID":"a2f0ec5b-e7dd-4436-820f-006393aea458","Type":"ContainerDied","Data":"90c871833f743c80b9da9e7fd2b20f941997f22492b5f43989edc0bbbaa6fd75"}
Jul 13 18:16:29.998557 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.998522    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9" event={"ID":"a2f0ec5b-e7dd-4436-820f-006393aea458","Type":"ContainerDied","Data":"7d90d569909aed371043e87fa131a7c38a9fd3581e65262a4ae5f9b703b9e3f5"}
Jul 13 18:16:29.998757 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:29.998560    2564 scope.go:117] "RemoveContainer" containerID="90c871833f743c80b9da9e7fd2b20f941997f22492b5f43989edc0bbbaa6fd75"
Jul 13 18:16:30.020609 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.020575    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"]
Jul 13 18:16:30.027831 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.027806    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/sub-test-model-a74fcd-kserve-5d7b57d8b5-8dxm9"]
Jul 13 18:16:30.045315 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.045289    2564 scope.go:117] "RemoveContainer" containerID="90c871833f743c80b9da9e7fd2b20f941997f22492b5f43989edc0bbbaa6fd75"
Jul 13 18:16:30.045628 ip-10-0-137-223 kubenswrapper[2564]: E0713 18:16:30.045607    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90c871833f743c80b9da9e7fd2b20f941997f22492b5f43989edc0bbbaa6fd75\": container with ID starting with 90c871833f743c80b9da9e7fd2b20f941997f22492b5f43989edc0bbbaa6fd75 not found: ID does not exist" containerID="90c871833f743c80b9da9e7fd2b20f941997f22492b5f43989edc0bbbaa6fd75"
Jul 13 18:16:30.045713 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.045634    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c871833f743c80b9da9e7fd2b20f941997f22492b5f43989edc0bbbaa6fd75"} err="failed to get container status \"90c871833f743c80b9da9e7fd2b20f941997f22492b5f43989edc0bbbaa6fd75\": rpc error: code = NotFound desc = could not find container \"90c871833f743c80b9da9e7fd2b20f941997f22492b5f43989edc0bbbaa6fd75\": container with ID starting with 90c871833f743c80b9da9e7fd2b20f941997f22492b5f43989edc0bbbaa6fd75 not found: ID does not exist"
Jul 13 18:16:30.191503 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.191433    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:16:30.330806 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.330768    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-tmp-dir\") pod \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") "
Jul 13 18:16:30.330996 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.330816    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-home\") pod \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") "
Jul 13 18:16:30.330996 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.330855    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfwtq\" (UniqueName: \"kubernetes.io/projected/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-kube-api-access-nfwtq\") pod \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") "
Jul 13 18:16:30.330996 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.330901    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-model-cache\") pod \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") "
Jul 13 18:16:30.330996 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.330919    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-tls-certs\") pod \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") "
Jul 13 18:16:30.330996 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.330934    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-dshm\") pod \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\" (UID: \"aac66927-a7cc-4e7f-ad21-bd9495c4b20d\") "
Jul 13 18:16:30.331257 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.331057    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aac66927-a7cc-4e7f-ad21-bd9495c4b20d" (UID: "aac66927-a7cc-4e7f-ad21-bd9495c4b20d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:16:30.331257 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.331130    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-home" (OuterVolumeSpecName: "home") pod "aac66927-a7cc-4e7f-ad21-bd9495c4b20d" (UID: "aac66927-a7cc-4e7f-ad21-bd9495c4b20d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:16:30.331257 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.331154    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-model-cache" (OuterVolumeSpecName: "model-cache") pod "aac66927-a7cc-4e7f-ad21-bd9495c4b20d" (UID: "aac66927-a7cc-4e7f-ad21-bd9495c4b20d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:16:30.333183 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.333160    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-dshm" (OuterVolumeSpecName: "dshm") pod "aac66927-a7cc-4e7f-ad21-bd9495c4b20d" (UID: "aac66927-a7cc-4e7f-ad21-bd9495c4b20d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:16:30.333183 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.333166    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-kube-api-access-nfwtq" (OuterVolumeSpecName: "kube-api-access-nfwtq") pod "aac66927-a7cc-4e7f-ad21-bd9495c4b20d" (UID: "aac66927-a7cc-4e7f-ad21-bd9495c4b20d"). InnerVolumeSpecName "kube-api-access-nfwtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:16:30.333354 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.333173    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aac66927-a7cc-4e7f-ad21-bd9495c4b20d" (UID: "aac66927-a7cc-4e7f-ad21-bd9495c4b20d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:16:30.431605 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.431567    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-tmp-dir\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:16:30.431605 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.431601    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-home\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:16:30.431605 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.431610    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfwtq\" (UniqueName: \"kubernetes.io/projected/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-kube-api-access-nfwtq\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:16:30.431848 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.431618    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-model-cache\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:16:30.431848 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.431628    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-tls-certs\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:16:30.431848 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:30.431636    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aac66927-a7cc-4e7f-ad21-bd9495c4b20d-dshm\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:16:31.011005 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:31.010971    2564 generic.go:356] "Generic (PLEG): container finished" podID="aac66927-a7cc-4e7f-ad21-bd9495c4b20d" containerID="11005a6bf15d7722eb3a307c47ac3b95aa9aef2b5792bb0a6439a82550fdbd23" exitCode=0
Jul 13 18:16:31.011239 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:31.011101    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"
Jul 13 18:16:31.015081 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:31.015051    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2f0ec5b-e7dd-4436-820f-006393aea458" path="/var/lib/kubelet/pods/a2f0ec5b-e7dd-4436-820f-006393aea458/volumes"
Jul 13 18:16:31.015433 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:31.015415    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9" event={"ID":"aac66927-a7cc-4e7f-ad21-bd9495c4b20d","Type":"ContainerDied","Data":"11005a6bf15d7722eb3a307c47ac3b95aa9aef2b5792bb0a6439a82550fdbd23"}
Jul 13 18:16:31.015701 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:31.015445    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9" event={"ID":"aac66927-a7cc-4e7f-ad21-bd9495c4b20d","Type":"ContainerDied","Data":"52aa2ba8175cd8f22826ffeebbaa4dc033965ea89b6d2e53acbde63c238ced61"}
Jul 13 18:16:31.015701 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:31.015463    2564 scope.go:117] "RemoveContainer" containerID="11005a6bf15d7722eb3a307c47ac3b95aa9aef2b5792bb0a6439a82550fdbd23"
Jul 13 18:16:31.024402 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:31.024253    2564 scope.go:117] "RemoveContainer" containerID="11005a6bf15d7722eb3a307c47ac3b95aa9aef2b5792bb0a6439a82550fdbd23"
Jul 13 18:16:31.024574 ip-10-0-137-223 kubenswrapper[2564]: E0713 18:16:31.024556    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11005a6bf15d7722eb3a307c47ac3b95aa9aef2b5792bb0a6439a82550fdbd23\": container with ID starting with 11005a6bf15d7722eb3a307c47ac3b95aa9aef2b5792bb0a6439a82550fdbd23 not found: ID does not exist" containerID="11005a6bf15d7722eb3a307c47ac3b95aa9aef2b5792bb0a6439a82550fdbd23"
Jul 13 18:16:31.024628 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:31.024582    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11005a6bf15d7722eb3a307c47ac3b95aa9aef2b5792bb0a6439a82550fdbd23"} err="failed to get container status \"11005a6bf15d7722eb3a307c47ac3b95aa9aef2b5792bb0a6439a82550fdbd23\": rpc error: code = NotFound desc = could not find container \"11005a6bf15d7722eb3a307c47ac3b95aa9aef2b5792bb0a6439a82550fdbd23\": container with ID starting with 11005a6bf15d7722eb3a307c47ac3b95aa9aef2b5792bb0a6439a82550fdbd23 not found: ID does not exist"
Jul 13 18:16:31.038549 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:31.038520    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"]
Jul 13 18:16:31.044035 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:31.044005    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-762866/sub-test-model-762866-kserve-78694b7d9-7scm9"]
Jul 13 18:16:33.009844 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:33.009806    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aac66927-a7cc-4e7f-ad21-bd9495c4b20d" path="/var/lib/kubelet/pods/aac66927-a7cc-4e7f-ad21-bd9495c4b20d/volumes"
Jul 13 18:16:34.841822 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:34.841788    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:34.842353 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:34.841859    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:34.854311 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:34.854261    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:35.041349 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:35.041318    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:16:38.489757 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:38.489673    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:16:45.126743 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:45.126713    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 18:16:45.133231 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:16:45.133200    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 18:17:05.332014 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.331973    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"]
Jul 13 18:17:05.332644 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.332464    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2f0ec5b-e7dd-4436-820f-006393aea458" containerName="main"
Jul 13 18:17:05.332644 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.332483    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2f0ec5b-e7dd-4436-820f-006393aea458" containerName="main"
Jul 13 18:17:05.332644 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.332516    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aac66927-a7cc-4e7f-ad21-bd9495c4b20d" containerName="main"
Jul 13 18:17:05.332644 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.332524    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="aac66927-a7cc-4e7f-ad21-bd9495c4b20d" containerName="main"
Jul 13 18:17:05.332644 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.332610    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2f0ec5b-e7dd-4436-820f-006393aea458" containerName="main"
Jul 13 18:17:05.332644 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.332622    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="aac66927-a7cc-4e7f-ad21-bd9495c4b20d" containerName="main"
Jul 13 18:17:05.335831 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.335808    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.337917 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.337893    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-762866\"/\"openshift-service-ca.crt\""
Jul 13 18:17:05.338870 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.338854    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-762866\"/\"kube-root-ca.crt\""
Jul 13 18:17:05.339000 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.338961    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-762866\"/\"default-dockercfg-vf48q\""
Jul 13 18:17:05.339044 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.339014    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-762866\"/\"rate-test-model-762866-kserve-self-signed-certs\""
Jul 13 18:17:05.345712 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.345687    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"]
Jul 13 18:17:05.436707 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.436650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-tmp-dir\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.436707 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.436689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571325f3-249d-4e4a-a5d7-eede94cf57f6-tls-certs\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.436943 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.436807    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vbnn\" (UniqueName: \"kubernetes.io/projected/571325f3-249d-4e4a-a5d7-eede94cf57f6-kube-api-access-6vbnn\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.436943 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.436868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-model-cache\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.436943 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.436902    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-home\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.437052 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.436963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-dshm\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.537410 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.537361    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-dshm\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.537617 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.537425    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-tmp-dir\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.537617 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.537452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571325f3-249d-4e4a-a5d7-eede94cf57f6-tls-certs\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.537617 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.537502    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vbnn\" (UniqueName: \"kubernetes.io/projected/571325f3-249d-4e4a-a5d7-eede94cf57f6-kube-api-access-6vbnn\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.537617 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.537532    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-model-cache\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.537617 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.537560    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-home\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.537913 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.537891    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-tmp-dir\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.537979 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.537924    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-model-cache\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.537979 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.537961    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-home\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.539661 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.539635    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-dshm\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.539912 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.539895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571325f3-249d-4e4a-a5d7-eede94cf57f6-tls-certs\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.547335 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.547308    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vbnn\" (UniqueName: \"kubernetes.io/projected/571325f3-249d-4e4a-a5d7-eede94cf57f6-kube-api-access-6vbnn\") pod \"rate-test-model-762866-kserve-7869d8d7bc-b4rvl\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") " pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.645678 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.645580    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:05.790005 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:05.789965    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"]
Jul 13 18:17:05.794073 ip-10-0-137-223 kubenswrapper[2564]: W0713 18:17:05.794033    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod571325f3_249d_4e4a_a5d7_eede94cf57f6.slice/crio-81abef5c4ebe47ae018f6e3e49c025301d315faa8da1d149619db81ec42a16fd WatchSource:0}: Error finding container 81abef5c4ebe47ae018f6e3e49c025301d315faa8da1d149619db81ec42a16fd: Status 404 returned error can't find the container with id 81abef5c4ebe47ae018f6e3e49c025301d315faa8da1d149619db81ec42a16fd
Jul 13 18:17:06.165889 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:06.165852    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl" event={"ID":"571325f3-249d-4e4a-a5d7-eede94cf57f6","Type":"ContainerStarted","Data":"bdabc6df0a6df78da834002a11a553be9b979ab430242789e01e5cd34512223e"}
Jul 13 18:17:06.166043 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:06.165901    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl" event={"ID":"571325f3-249d-4e4a-a5d7-eede94cf57f6","Type":"ContainerStarted","Data":"81abef5c4ebe47ae018f6e3e49c025301d315faa8da1d149619db81ec42a16fd"}
Jul 13 18:17:06.189204 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:06.189153    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl" podStartSLOduration=1.189135677 podStartE2EDuration="1.189135677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:17:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:17:06.188337702 +0000 UTC m=+2721.701512990" watchObservedRunningTime="2026-07-13 18:17:06.189135677 +0000 UTC m=+2721.702310946"
Jul 13 18:17:10.091849 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:10.091814    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:17:15.646488 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:15.646443    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:15.646488 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:15.646500    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:15.659075 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:15.659043    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:16.229727 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:16.229699    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:17:28.679284 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:28.679234    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:17:49.194027 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:49.193980    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:17:53.783031 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:53.782986    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"]
Jul 13 18:17:54.704753 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:54.704720    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"]
Jul 13 18:17:58.758487 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:58.758445    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7496-140575034340272"]
Jul 13 18:17:58.761646 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:58.761629    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7496-140575034340272"
Jul 13 18:17:58.763928 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:58.763905    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-dl4kl\""
Jul 13 18:17:58.767661 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:58.767637    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7496-140575034340272"]
Jul 13 18:17:58.814904 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:58.814868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5sdp\" (UniqueName: \"kubernetes.io/projected/ab281159-86cb-47ee-b50c-955bad6c56d3-kube-api-access-c5sdp\") pod \"test-curl-7496-140575034340272\" (UID: \"ab281159-86cb-47ee-b50c-955bad6c56d3\") " pod="openshift-ingress/test-curl-7496-140575034340272"
Jul 13 18:17:58.916364 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:58.916326    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5sdp\" (UniqueName: \"kubernetes.io/projected/ab281159-86cb-47ee-b50c-955bad6c56d3-kube-api-access-c5sdp\") pod \"test-curl-7496-140575034340272\" (UID: \"ab281159-86cb-47ee-b50c-955bad6c56d3\") " pod="openshift-ingress/test-curl-7496-140575034340272"
Jul 13 18:17:58.924741 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:58.924707    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5sdp\" (UniqueName: \"kubernetes.io/projected/ab281159-86cb-47ee-b50c-955bad6c56d3-kube-api-access-c5sdp\") pod \"test-curl-7496-140575034340272\" (UID: \"ab281159-86cb-47ee-b50c-955bad6c56d3\") " pod="openshift-ingress/test-curl-7496-140575034340272"
Jul 13 18:17:59.071879 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:59.071790    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7496-140575034340272"
Jul 13 18:17:59.207875 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:59.207848    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7496-140575034340272"]
Jul 13 18:17:59.210179 ip-10-0-137-223 kubenswrapper[2564]: W0713 18:17:59.210136    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab281159_86cb_47ee_b50c_955bad6c56d3.slice/crio-602f80f3afae6e1aa75713f0efb60cd7458cfd34369e77ec63868b84cfd4b195 WatchSource:0}: Error finding container 602f80f3afae6e1aa75713f0efb60cd7458cfd34369e77ec63868b84cfd4b195: Status 404 returned error can't find the container with id 602f80f3afae6e1aa75713f0efb60cd7458cfd34369e77ec63868b84cfd4b195
Jul 13 18:17:59.211553 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:59.211537    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 18:17:59.408958 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:17:59.408922    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7496-140575034340272" event={"ID":"ab281159-86cb-47ee-b50c-955bad6c56d3","Type":"ContainerStarted","Data":"602f80f3afae6e1aa75713f0efb60cd7458cfd34369e77ec63868b84cfd4b195"}
Jul 13 18:18:00.415332 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:00.415298    2564 generic.go:356] "Generic (PLEG): container finished" podID="ab281159-86cb-47ee-b50c-955bad6c56d3" containerID="a6729d40ebee89cbeb8dd144ca459d74e8e19b76212d5435759963ef7ff683b2" exitCode=0
Jul 13 18:18:00.415735 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:00.415396    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7496-140575034340272" event={"ID":"ab281159-86cb-47ee-b50c-955bad6c56d3","Type":"ContainerDied","Data":"a6729d40ebee89cbeb8dd144ca459d74e8e19b76212d5435759963ef7ff683b2"}
Jul 13 18:18:01.556170 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:01.556138    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7496-140575034340272"
Jul 13 18:18:01.590952 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:01.590918    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7496-140575034340272_ab281159-86cb-47ee-b50c-955bad6c56d3/test-curl-7496-140575034340272/0.log"
Jul 13 18:18:01.614638 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:01.614601    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7496-140575034340272"]
Jul 13 18:18:01.618640 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:01.618610    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7496-140575034340272"]
Jul 13 18:18:01.638130 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:01.638095    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5sdp\" (UniqueName: \"kubernetes.io/projected/ab281159-86cb-47ee-b50c-955bad6c56d3-kube-api-access-c5sdp\") pod \"ab281159-86cb-47ee-b50c-955bad6c56d3\" (UID: \"ab281159-86cb-47ee-b50c-955bad6c56d3\") "
Jul 13 18:18:01.640202 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:01.640177    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab281159-86cb-47ee-b50c-955bad6c56d3-kube-api-access-c5sdp" (OuterVolumeSpecName: "kube-api-access-c5sdp") pod "ab281159-86cb-47ee-b50c-955bad6c56d3" (UID: "ab281159-86cb-47ee-b50c-955bad6c56d3"). InnerVolumeSpecName "kube-api-access-c5sdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:18:01.738975 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:01.738887    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5sdp\" (UniqueName: \"kubernetes.io/projected/ab281159-86cb-47ee-b50c-955bad6c56d3-kube-api-access-c5sdp\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:18:02.425586 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:02.425554    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7496-140575034340272"
Jul 13 18:18:02.425770 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:02.425597    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="602f80f3afae6e1aa75713f0efb60cd7458cfd34369e77ec63868b84cfd4b195"
Jul 13 18:18:02.435447 ip-10-0-137-223 kubenswrapper[2564]: E0713 18:18:02.435412    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7496-140575034340272\" is forbidden: User \"system:node:ip-10-0-137-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-223.ec2.internal' and this object" podUID="ab281159-86cb-47ee-b50c-955bad6c56d3" pod="openshift-ingress/test-curl-7496-140575034340272"
Jul 13 18:18:03.010082 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:03.010045    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab281159-86cb-47ee-b50c-955bad6c56d3" path="/var/lib/kubelet/pods/ab281159-86cb-47ee-b50c-955bad6c56d3/volumes"
Jul 13 18:18:04.794625 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:04.794585    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7496-140575035473968"]
Jul 13 18:18:04.795001 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:04.794925    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab281159-86cb-47ee-b50c-955bad6c56d3" containerName="test-curl-7496-140575034340272"
Jul 13 18:18:04.795001 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:04.794937    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab281159-86cb-47ee-b50c-955bad6c56d3" containerName="test-curl-7496-140575034340272"
Jul 13 18:18:04.795001 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:04.794993    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab281159-86cb-47ee-b50c-955bad6c56d3" containerName="test-curl-7496-140575034340272"
Jul 13 18:18:04.797935 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:04.797916    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7496-140575035473968"
Jul 13 18:18:04.800071 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:04.800052    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-dl4kl\""
Jul 13 18:18:04.805117 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:04.805069    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7496-140575035473968"]
Jul 13 18:18:04.866239 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:04.866204    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-875jp\" (UniqueName: \"kubernetes.io/projected/89d0437a-58d1-4f65-ba73-46fc6267b1c3-kube-api-access-875jp\") pod \"test-curl-7496-140575035473968\" (UID: \"89d0437a-58d1-4f65-ba73-46fc6267b1c3\") " pod="openshift-ingress/test-curl-7496-140575035473968"
Jul 13 18:18:04.967391 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:04.967354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-875jp\" (UniqueName: \"kubernetes.io/projected/89d0437a-58d1-4f65-ba73-46fc6267b1c3-kube-api-access-875jp\") pod \"test-curl-7496-140575035473968\" (UID: \"89d0437a-58d1-4f65-ba73-46fc6267b1c3\") " pod="openshift-ingress/test-curl-7496-140575035473968"
Jul 13 18:18:04.979386 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:04.979361    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-875jp\" (UniqueName: \"kubernetes.io/projected/89d0437a-58d1-4f65-ba73-46fc6267b1c3-kube-api-access-875jp\") pod \"test-curl-7496-140575035473968\" (UID: \"89d0437a-58d1-4f65-ba73-46fc6267b1c3\") " pod="openshift-ingress/test-curl-7496-140575035473968"
Jul 13 18:18:05.107764 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:05.107713    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7496-140575035473968"
Jul 13 18:18:05.241966 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:05.241936    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7496-140575035473968"]
Jul 13 18:18:05.244679 ip-10-0-137-223 kubenswrapper[2564]: W0713 18:18:05.244649    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89d0437a_58d1_4f65_ba73_46fc6267b1c3.slice/crio-1d2dcfbac2fde29ccf1f02bde5b7516cbd352cda08e4aeb2ccf315fc03944ae8 WatchSource:0}: Error finding container 1d2dcfbac2fde29ccf1f02bde5b7516cbd352cda08e4aeb2ccf315fc03944ae8: Status 404 returned error can't find the container with id 1d2dcfbac2fde29ccf1f02bde5b7516cbd352cda08e4aeb2ccf315fc03944ae8
Jul 13 18:18:05.382300 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:05.382249    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:18:05.440191 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:05.440155    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7496-140575035473968" event={"ID":"89d0437a-58d1-4f65-ba73-46fc6267b1c3","Type":"ContainerStarted","Data":"1d2dcfbac2fde29ccf1f02bde5b7516cbd352cda08e4aeb2ccf315fc03944ae8"}
Jul 13 18:18:06.452305 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:06.452244    2564 generic.go:356] "Generic (PLEG): container finished" podID="89d0437a-58d1-4f65-ba73-46fc6267b1c3" containerID="878c989bfd5e6a85cc9334a97ecdb92b58c33c1f666e6d285ec97564a91b81bd" exitCode=0
Jul 13 18:18:06.452707 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:06.452319    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7496-140575035473968" event={"ID":"89d0437a-58d1-4f65-ba73-46fc6267b1c3","Type":"ContainerDied","Data":"878c989bfd5e6a85cc9334a97ecdb92b58c33c1f666e6d285ec97564a91b81bd"}
Jul 13 18:18:07.592773 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:07.592742    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7496-140575035473968"
Jul 13 18:18:07.613342 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:07.613307    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7496-140575035473968_89d0437a-58d1-4f65-ba73-46fc6267b1c3/test-curl-7496-140575035473968/0.log"
Jul 13 18:18:07.637403 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:07.637371    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7496-140575035473968"]
Jul 13 18:18:07.642097 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:07.642065    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7496-140575035473968"]
Jul 13 18:18:07.692727 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:07.692689    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-875jp\" (UniqueName: \"kubernetes.io/projected/89d0437a-58d1-4f65-ba73-46fc6267b1c3-kube-api-access-875jp\") pod \"89d0437a-58d1-4f65-ba73-46fc6267b1c3\" (UID: \"89d0437a-58d1-4f65-ba73-46fc6267b1c3\") "
Jul 13 18:18:07.694817 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:07.694782    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89d0437a-58d1-4f65-ba73-46fc6267b1c3-kube-api-access-875jp" (OuterVolumeSpecName: "kube-api-access-875jp") pod "89d0437a-58d1-4f65-ba73-46fc6267b1c3" (UID: "89d0437a-58d1-4f65-ba73-46fc6267b1c3"). InnerVolumeSpecName "kube-api-access-875jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:18:07.793636 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:07.793556    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-875jp\" (UniqueName: \"kubernetes.io/projected/89d0437a-58d1-4f65-ba73-46fc6267b1c3-kube-api-access-875jp\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:18:08.462652 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:08.462626    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d2dcfbac2fde29ccf1f02bde5b7516cbd352cda08e4aeb2ccf315fc03944ae8"
Jul 13 18:18:08.462652 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:08.462635    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7496-140575035473968"
Jul 13 18:18:08.472245 ip-10-0-137-223 kubenswrapper[2564]: E0713 18:18:08.472214    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7496-140575035473968\" is forbidden: User \"system:node:ip-10-0-137-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-223.ec2.internal' and this object" podUID="89d0437a-58d1-4f65-ba73-46fc6267b1c3" pod="openshift-ingress/test-curl-7496-140575035473968"
Jul 13 18:18:08.802988 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:08.802888    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br" podUID="8d2cc350-dafa-4f4d-81c1-5acf06d49494" containerName="main" containerID="cri-o://2ab9f33dcd441c4121283bc03a11e4957a6521c45146c92b6c69b0c778a7ffac" gracePeriod=45
Jul 13 18:18:09.011777 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.011735    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89d0437a-58d1-4f65-ba73-46fc6267b1c3" path="/var/lib/kubelet/pods/89d0437a-58d1-4f65-ba73-46fc6267b1c3/volumes"
Jul 13 18:18:09.066251 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.066177    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:18:09.209197 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.209152    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-model-cache\") pod \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") "
Jul 13 18:18:09.209197 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.209216    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-dshm\") pod \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") "
Jul 13 18:18:09.209488 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.209239    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr9vb\" (UniqueName: \"kubernetes.io/projected/8d2cc350-dafa-4f4d-81c1-5acf06d49494-kube-api-access-pr9vb\") pod \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") "
Jul 13 18:18:09.209488 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.209287    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-tmp-dir\") pod \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") "
Jul 13 18:18:09.209488 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.209310    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-home\") pod \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") "
Jul 13 18:18:09.209488 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.209329    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d2cc350-dafa-4f4d-81c1-5acf06d49494-tls-certs\") pod \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\" (UID: \"8d2cc350-dafa-4f4d-81c1-5acf06d49494\") "
Jul 13 18:18:09.209686 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.209553    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-model-cache" (OuterVolumeSpecName: "model-cache") pod "8d2cc350-dafa-4f4d-81c1-5acf06d49494" (UID: "8d2cc350-dafa-4f4d-81c1-5acf06d49494"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:18:09.209686 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.209570    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8d2cc350-dafa-4f4d-81c1-5acf06d49494" (UID: "8d2cc350-dafa-4f4d-81c1-5acf06d49494"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:18:09.209686 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.209581    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-home" (OuterVolumeSpecName: "home") pod "8d2cc350-dafa-4f4d-81c1-5acf06d49494" (UID: "8d2cc350-dafa-4f4d-81c1-5acf06d49494"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:18:09.211538 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.211511    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-dshm" (OuterVolumeSpecName: "dshm") pod "8d2cc350-dafa-4f4d-81c1-5acf06d49494" (UID: "8d2cc350-dafa-4f4d-81c1-5acf06d49494"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:18:09.211659 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.211542    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d2cc350-dafa-4f4d-81c1-5acf06d49494-kube-api-access-pr9vb" (OuterVolumeSpecName: "kube-api-access-pr9vb") pod "8d2cc350-dafa-4f4d-81c1-5acf06d49494" (UID: "8d2cc350-dafa-4f4d-81c1-5acf06d49494"). InnerVolumeSpecName "kube-api-access-pr9vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:18:09.211659 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.211575    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d2cc350-dafa-4f4d-81c1-5acf06d49494-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8d2cc350-dafa-4f4d-81c1-5acf06d49494" (UID: "8d2cc350-dafa-4f4d-81c1-5acf06d49494"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:18:09.310871 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.310827    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-model-cache\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:18:09.310871 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.310861    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-dshm\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:18:09.310871 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.310871    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr9vb\" (UniqueName: \"kubernetes.io/projected/8d2cc350-dafa-4f4d-81c1-5acf06d49494-kube-api-access-pr9vb\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:18:09.310871 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.310880    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-tmp-dir\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:18:09.311146 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.310891    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d2cc350-dafa-4f4d-81c1-5acf06d49494-home\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:18:09.311146 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.310899    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d2cc350-dafa-4f4d-81c1-5acf06d49494-tls-certs\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:18:09.468425 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.468386    2564 generic.go:356] "Generic (PLEG): container finished" podID="8d2cc350-dafa-4f4d-81c1-5acf06d49494" containerID="2ab9f33dcd441c4121283bc03a11e4957a6521c45146c92b6c69b0c778a7ffac" exitCode=0
Jul 13 18:18:09.468425 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.468427    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"
Jul 13 18:18:09.468622 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.468467    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br" event={"ID":"8d2cc350-dafa-4f4d-81c1-5acf06d49494","Type":"ContainerDied","Data":"2ab9f33dcd441c4121283bc03a11e4957a6521c45146c92b6c69b0c778a7ffac"}
Jul 13 18:18:09.468622 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.468512    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br" event={"ID":"8d2cc350-dafa-4f4d-81c1-5acf06d49494","Type":"ContainerDied","Data":"b2140f496e2a8b20d188f5bd2165f336bd57b1674435f73efd261ff5ef65b651"}
Jul 13 18:18:09.468622 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.468531    2564 scope.go:117] "RemoveContainer" containerID="2ab9f33dcd441c4121283bc03a11e4957a6521c45146c92b6c69b0c778a7ffac"
Jul 13 18:18:09.477488 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.477467    2564 scope.go:117] "RemoveContainer" containerID="2ab9f33dcd441c4121283bc03a11e4957a6521c45146c92b6c69b0c778a7ffac"
Jul 13 18:18:09.477787 ip-10-0-137-223 kubenswrapper[2564]: E0713 18:18:09.477768    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ab9f33dcd441c4121283bc03a11e4957a6521c45146c92b6c69b0c778a7ffac\": container with ID starting with 2ab9f33dcd441c4121283bc03a11e4957a6521c45146c92b6c69b0c778a7ffac not found: ID does not exist" containerID="2ab9f33dcd441c4121283bc03a11e4957a6521c45146c92b6c69b0c778a7ffac"
Jul 13 18:18:09.477835 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.477795    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ab9f33dcd441c4121283bc03a11e4957a6521c45146c92b6c69b0c778a7ffac"} err="failed to get container status \"2ab9f33dcd441c4121283bc03a11e4957a6521c45146c92b6c69b0c778a7ffac\": rpc error: code = NotFound desc = could not find container \"2ab9f33dcd441c4121283bc03a11e4957a6521c45146c92b6c69b0c778a7ffac\": container with ID starting with 2ab9f33dcd441c4121283bc03a11e4957a6521c45146c92b6c69b0c778a7ffac not found: ID does not exist"
Jul 13 18:18:09.488887 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.488853    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"]
Jul 13 18:18:09.491082 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.491058    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a74fcd/rate-test-model-a74fcd-kserve-d49486d6c-pq8br"]
Jul 13 18:18:09.724906 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.724808    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl" podUID="571325f3-249d-4e4a-a5d7-eede94cf57f6" containerName="main" containerID="cri-o://bdabc6df0a6df78da834002a11a553be9b979ab430242789e01e5cd34512223e" gracePeriod=45
Jul 13 18:18:09.984178 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:09.984114    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:18:10.118453 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.118408    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vbnn\" (UniqueName: \"kubernetes.io/projected/571325f3-249d-4e4a-a5d7-eede94cf57f6-kube-api-access-6vbnn\") pod \"571325f3-249d-4e4a-a5d7-eede94cf57f6\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") "
Jul 13 18:18:10.118665 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.118489    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-dshm\") pod \"571325f3-249d-4e4a-a5d7-eede94cf57f6\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") "
Jul 13 18:18:10.118665 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.118543    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-tmp-dir\") pod \"571325f3-249d-4e4a-a5d7-eede94cf57f6\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") "
Jul 13 18:18:10.118665 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.118568    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571325f3-249d-4e4a-a5d7-eede94cf57f6-tls-certs\") pod \"571325f3-249d-4e4a-a5d7-eede94cf57f6\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") "
Jul 13 18:18:10.118665 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.118595    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-home\") pod \"571325f3-249d-4e4a-a5d7-eede94cf57f6\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") "
Jul 13 18:18:10.118665 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.118635    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-model-cache\") pod \"571325f3-249d-4e4a-a5d7-eede94cf57f6\" (UID: \"571325f3-249d-4e4a-a5d7-eede94cf57f6\") "
Jul 13 18:18:10.118909 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.118816    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "571325f3-249d-4e4a-a5d7-eede94cf57f6" (UID: "571325f3-249d-4e4a-a5d7-eede94cf57f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:18:10.118959 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.118909    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-home" (OuterVolumeSpecName: "home") pod "571325f3-249d-4e4a-a5d7-eede94cf57f6" (UID: "571325f3-249d-4e4a-a5d7-eede94cf57f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:18:10.118959 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.118927    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "571325f3-249d-4e4a-a5d7-eede94cf57f6" (UID: "571325f3-249d-4e4a-a5d7-eede94cf57f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:18:10.120670 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.120636    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-dshm" (OuterVolumeSpecName: "dshm") pod "571325f3-249d-4e4a-a5d7-eede94cf57f6" (UID: "571325f3-249d-4e4a-a5d7-eede94cf57f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 18:18:10.120670 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.120640    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/571325f3-249d-4e4a-a5d7-eede94cf57f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "571325f3-249d-4e4a-a5d7-eede94cf57f6" (UID: "571325f3-249d-4e4a-a5d7-eede94cf57f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 18:18:10.120814 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.120674    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/571325f3-249d-4e4a-a5d7-eede94cf57f6-kube-api-access-6vbnn" (OuterVolumeSpecName: "kube-api-access-6vbnn") pod "571325f3-249d-4e4a-a5d7-eede94cf57f6" (UID: "571325f3-249d-4e4a-a5d7-eede94cf57f6"). InnerVolumeSpecName "kube-api-access-6vbnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:18:10.219668 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.219628    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-model-cache\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:18:10.219668 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.219661    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vbnn\" (UniqueName: \"kubernetes.io/projected/571325f3-249d-4e4a-a5d7-eede94cf57f6-kube-api-access-6vbnn\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:18:10.219668 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.219670    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-dshm\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:18:10.219906 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.219681    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-tmp-dir\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:18:10.219906 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.219690    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/571325f3-249d-4e4a-a5d7-eede94cf57f6-tls-certs\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:18:10.219906 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.219697    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/571325f3-249d-4e4a-a5d7-eede94cf57f6-home\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:18:10.475395 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.475362    2564 generic.go:356] "Generic (PLEG): container finished" podID="571325f3-249d-4e4a-a5d7-eede94cf57f6" containerID="bdabc6df0a6df78da834002a11a553be9b979ab430242789e01e5cd34512223e" exitCode=0
Jul 13 18:18:10.475588 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.475405    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"
Jul 13 18:18:10.475588 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.475420    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl" event={"ID":"571325f3-249d-4e4a-a5d7-eede94cf57f6","Type":"ContainerDied","Data":"bdabc6df0a6df78da834002a11a553be9b979ab430242789e01e5cd34512223e"}
Jul 13 18:18:10.475588 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.475455    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl" event={"ID":"571325f3-249d-4e4a-a5d7-eede94cf57f6","Type":"ContainerDied","Data":"81abef5c4ebe47ae018f6e3e49c025301d315faa8da1d149619db81ec42a16fd"}
Jul 13 18:18:10.475588 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.475471    2564 scope.go:117] "RemoveContainer" containerID="bdabc6df0a6df78da834002a11a553be9b979ab430242789e01e5cd34512223e"
Jul 13 18:18:10.484349 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.484329    2564 scope.go:117] "RemoveContainer" containerID="bdabc6df0a6df78da834002a11a553be9b979ab430242789e01e5cd34512223e"
Jul 13 18:18:10.484632 ip-10-0-137-223 kubenswrapper[2564]: E0713 18:18:10.484613    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdabc6df0a6df78da834002a11a553be9b979ab430242789e01e5cd34512223e\": container with ID starting with bdabc6df0a6df78da834002a11a553be9b979ab430242789e01e5cd34512223e not found: ID does not exist" containerID="bdabc6df0a6df78da834002a11a553be9b979ab430242789e01e5cd34512223e"
Jul 13 18:18:10.484738 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.484642    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdabc6df0a6df78da834002a11a553be9b979ab430242789e01e5cd34512223e"} err="failed to get container status \"bdabc6df0a6df78da834002a11a553be9b979ab430242789e01e5cd34512223e\": rpc error: code = NotFound desc = could not find container \"bdabc6df0a6df78da834002a11a553be9b979ab430242789e01e5cd34512223e\": container with ID starting with bdabc6df0a6df78da834002a11a553be9b979ab430242789e01e5cd34512223e not found: ID does not exist"
Jul 13 18:18:10.495883 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.495855    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"]
Jul 13 18:18:10.498107 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.498085    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-762866/rate-test-model-762866-kserve-7869d8d7bc-b4rvl"]
Jul 13 18:18:10.817319 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.817213    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7496-140575035474976"]
Jul 13 18:18:10.817582 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.817568    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89d0437a-58d1-4f65-ba73-46fc6267b1c3" containerName="test-curl-7496-140575035473968"
Jul 13 18:18:10.817627 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.817583    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="89d0437a-58d1-4f65-ba73-46fc6267b1c3" containerName="test-curl-7496-140575035473968"
Jul 13 18:18:10.817627 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.817595    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="571325f3-249d-4e4a-a5d7-eede94cf57f6" containerName="main"
Jul 13 18:18:10.817627 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.817600    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="571325f3-249d-4e4a-a5d7-eede94cf57f6" containerName="main"
Jul 13 18:18:10.817627 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.817618    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d2cc350-dafa-4f4d-81c1-5acf06d49494" containerName="main"
Jul 13 18:18:10.817627 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.817624    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d2cc350-dafa-4f4d-81c1-5acf06d49494" containerName="main"
Jul 13 18:18:10.817796 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.817688    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d2cc350-dafa-4f4d-81c1-5acf06d49494" containerName="main"
Jul 13 18:18:10.817796 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.817696    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="571325f3-249d-4e4a-a5d7-eede94cf57f6" containerName="main"
Jul 13 18:18:10.817796 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.817701    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="89d0437a-58d1-4f65-ba73-46fc6267b1c3" containerName="test-curl-7496-140575035473968"
Jul 13 18:18:10.821936 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.821915    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7496-140575035474976"
Jul 13 18:18:10.824227 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.824198    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-dl4kl\""
Jul 13 18:18:10.831246 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.827349    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7496-140575035474976"]
Jul 13 18:18:10.925465 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:10.925425    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvx4p\" (UniqueName: \"kubernetes.io/projected/f272ca99-3af4-4c51-9d38-31db8b389542-kube-api-access-rvx4p\") pod \"test-curl-7496-140575035474976\" (UID: \"f272ca99-3af4-4c51-9d38-31db8b389542\") " pod="openshift-ingress/test-curl-7496-140575035474976"
Jul 13 18:18:11.010406 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:11.010372    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="571325f3-249d-4e4a-a5d7-eede94cf57f6" path="/var/lib/kubelet/pods/571325f3-249d-4e4a-a5d7-eede94cf57f6/volumes"
Jul 13 18:18:11.010801 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:11.010783    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d2cc350-dafa-4f4d-81c1-5acf06d49494" path="/var/lib/kubelet/pods/8d2cc350-dafa-4f4d-81c1-5acf06d49494/volumes"
Jul 13 18:18:11.026208 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:11.026164    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvx4p\" (UniqueName: \"kubernetes.io/projected/f272ca99-3af4-4c51-9d38-31db8b389542-kube-api-access-rvx4p\") pod \"test-curl-7496-140575035474976\" (UID: \"f272ca99-3af4-4c51-9d38-31db8b389542\") " pod="openshift-ingress/test-curl-7496-140575035474976"
Jul 13 18:18:11.036944 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:11.034366    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvx4p\" (UniqueName: \"kubernetes.io/projected/f272ca99-3af4-4c51-9d38-31db8b389542-kube-api-access-rvx4p\") pod \"test-curl-7496-140575035474976\" (UID: \"f272ca99-3af4-4c51-9d38-31db8b389542\") " pod="openshift-ingress/test-curl-7496-140575035474976"
Jul 13 18:18:11.136145 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:11.136113    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7496-140575035474976"
Jul 13 18:18:11.270608 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:11.270581    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7496-140575035474976"]
Jul 13 18:18:11.272420 ip-10-0-137-223 kubenswrapper[2564]: W0713 18:18:11.272390    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf272ca99_3af4_4c51_9d38_31db8b389542.slice/crio-7254200202e2a6a29d20219da44450fa0a177a8bebe3e73f0975e93ffe9ae73a WatchSource:0}: Error finding container 7254200202e2a6a29d20219da44450fa0a177a8bebe3e73f0975e93ffe9ae73a: Status 404 returned error can't find the container with id 7254200202e2a6a29d20219da44450fa0a177a8bebe3e73f0975e93ffe9ae73a
Jul 13 18:18:11.481233 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:11.481140    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7496-140575035474976" event={"ID":"f272ca99-3af4-4c51-9d38-31db8b389542","Type":"ContainerStarted","Data":"7254200202e2a6a29d20219da44450fa0a177a8bebe3e73f0975e93ffe9ae73a"}
Jul 13 18:18:12.489005 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:12.488968    2564 generic.go:356] "Generic (PLEG): container finished" podID="f272ca99-3af4-4c51-9d38-31db8b389542" containerID="9ef7f6e6008fc55395ee4d9a2bdf39bb8ef2de8df1ad3869f4686542f44ffba5" exitCode=0
Jul 13 18:18:12.489445 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:12.489030    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7496-140575035474976" event={"ID":"f272ca99-3af4-4c51-9d38-31db8b389542","Type":"ContainerDied","Data":"9ef7f6e6008fc55395ee4d9a2bdf39bb8ef2de8df1ad3869f4686542f44ffba5"}
Jul 13 18:18:13.633582 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:13.633558    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7496-140575035474976"
Jul 13 18:18:13.652765 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:13.652736    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7496-140575035474976_f272ca99-3af4-4c51-9d38-31db8b389542/test-curl-7496-140575035474976/0.log"
Jul 13 18:18:13.676197 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:13.676162    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7496-140575035474976"]
Jul 13 18:18:13.678540 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:13.678505    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7496-140575035474976"]
Jul 13 18:18:13.746251 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:13.746159    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvx4p\" (UniqueName: \"kubernetes.io/projected/f272ca99-3af4-4c51-9d38-31db8b389542-kube-api-access-rvx4p\") pod \"f272ca99-3af4-4c51-9d38-31db8b389542\" (UID: \"f272ca99-3af4-4c51-9d38-31db8b389542\") "
Jul 13 18:18:13.748247 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:13.748221    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f272ca99-3af4-4c51-9d38-31db8b389542-kube-api-access-rvx4p" (OuterVolumeSpecName: "kube-api-access-rvx4p") pod "f272ca99-3af4-4c51-9d38-31db8b389542" (UID: "f272ca99-3af4-4c51-9d38-31db8b389542"). InnerVolumeSpecName "kube-api-access-rvx4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 18:18:13.847016 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:13.846979    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvx4p\" (UniqueName: \"kubernetes.io/projected/f272ca99-3af4-4c51-9d38-31db8b389542-kube-api-access-rvx4p\") on node \"ip-10-0-137-223.ec2.internal\" DevicePath \"\""
Jul 13 18:18:14.499018 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:14.498984    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7496-140575035474976"
Jul 13 18:18:14.499196 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:14.499025    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7254200202e2a6a29d20219da44450fa0a177a8bebe3e73f0975e93ffe9ae73a"
Jul 13 18:18:14.508684 ip-10-0-137-223 kubenswrapper[2564]: E0713 18:18:14.508647    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7496-140575035474976\" is forbidden: User \"system:node:ip-10-0-137-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-223.ec2.internal' and this object" podUID="f272ca99-3af4-4c51-9d38-31db8b389542" pod="openshift-ingress/test-curl-7496-140575035474976"
Jul 13 18:18:15.007171 ip-10-0-137-223 kubenswrapper[2564]: E0713 18:18:15.007135    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7496-140575035474976\" is forbidden: User \"system:node:ip-10-0-137-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-223.ec2.internal' and this object" podUID="f272ca99-3af4-4c51-9d38-31db8b389542" pod="openshift-ingress/test-curl-7496-140575035474976"
Jul 13 18:18:15.009342 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:15.009318    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f272ca99-3af4-4c51-9d38-31db8b389542" path="/var/lib/kubelet/pods/f272ca99-3af4-4c51-9d38-31db8b389542/volumes"
Jul 13 18:18:27.688982 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:27.688945    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:18:53.375703 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:18:53.375667    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dh877"]
Jul 13 18:19:06.595078 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:06.595038    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d6d5984d7-wq9tc_cc36b880-6953-4055-a7cf-da8d67c2f105/authorino/0.log"
Jul 13 18:19:12.206995 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:12.206958    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qtcg6_7df6d337-3a48-47a9-ac5c-337b0c82214f/server/0.log"
Jul 13 18:19:12.342611 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:12.342551    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vtfm4_36c737ac-b0b4-4777-aad6-e252dc3536e0/manager/0.log"
Jul 13 18:19:12.466863 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:12.466788    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59fbf78564-2jfdl_7d7fac46-626a-4eb5-b367-5fb54189570c/copy-manifests/0.log"
Jul 13 18:19:12.486746 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:12.486716    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59fbf78564-2jfdl_7d7fac46-626a-4eb5-b367-5fb54189570c/manager/0.log"
Jul 13 18:19:16.574883 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:16.574853    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d6d5984d7-wq9tc_cc36b880-6953-4055-a7cf-da8d67c2f105/authorino/0.log"
Jul 13 18:19:17.391920 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:17.391892    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dh877_5d373563-4025-44d8-8f50-f5a3f0e9b4f1/limitador/0.log"
Jul 13 18:19:18.271665 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:18.271635    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dc9d9cd-ppxzd_e78b1508-5797-43e1-889f-27fc54efcd2d/kube-auth-proxy/0.log"
Jul 13 18:19:18.764023 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:18.763984    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75c8cd656-p548p_4c7a9e1c-535f-4468-a0cb-68454f647ea3/router/0.log"
Jul 13 18:19:19.485030 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:19.484990    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbm8tcd_2dc9e7d2-83ba-4d48-ba46-665525e14430/main/0.log"
Jul 13 18:19:19.736156 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:19.736062    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-bkmrs_7eeb9acc-eec1-46b1-a23b-5dfe2c21fe74/main/0.log"
Jul 13 18:19:27.334311 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:27.334255    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s4xjg_25cdc609-cac2-4bf2-9410-a4f48e6f5094/global-pull-secret-syncer/0.log"
Jul 13 18:19:27.460821 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:27.460782    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qrvn2_f05dbea2-6cf8-47e0-861c-8045ec151d3c/konnectivity-agent/0.log"
Jul 13 18:19:27.483456 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:27.483417    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-223.ec2.internal_2c4c00b6996d408e41b531f802af9845/haproxy/0.log"
Jul 13 18:19:32.598577 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:32.598535    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d6d5984d7-wq9tc_cc36b880-6953-4055-a7cf-da8d67c2f105/authorino/0.log"
Jul 13 18:19:32.973868 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:32.973788    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dh877_5d373563-4025-44d8-8f50-f5a3f0e9b4f1/limitador/0.log"
Jul 13 18:19:34.927188 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:34.927154    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-fgtjc_195b11af-642d-4fef-87c1-dfc75d1cf13a/cluster-monitoring-operator/0.log"
Jul 13 18:19:35.192594 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:35.192510    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t846p_e2c6377b-2866-4d0e-aebc-4eb7d6d47828/node-exporter/0.log"
Jul 13 18:19:35.231324 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:35.231294    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t846p_e2c6377b-2866-4d0e-aebc-4eb7d6d47828/kube-rbac-proxy/0.log"
Jul 13 18:19:35.270316 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:35.270281    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t846p_e2c6377b-2866-4d0e-aebc-4eb7d6d47828/init-textfile/0.log"
Jul 13 18:19:37.055144 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.055053    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-847pm_d386326b-6631-4ece-9a9e-dff8ace68f97/networking-console-plugin/0.log"
Jul 13 18:19:37.431930 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.431896    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"]
Jul 13 18:19:37.432327 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.432307    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f272ca99-3af4-4c51-9d38-31db8b389542" containerName="test-curl-7496-140575035474976"
Jul 13 18:19:37.432327 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.432327    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f272ca99-3af4-4c51-9d38-31db8b389542" containerName="test-curl-7496-140575035474976"
Jul 13 18:19:37.432457 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.432406    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f272ca99-3af4-4c51-9d38-31db8b389542" containerName="test-curl-7496-140575035474976"
Jul 13 18:19:37.435486 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.435464    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.437598 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.437577    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nbr9z\"/\"kube-root-ca.crt\""
Jul 13 18:19:37.438387 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.438368    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nbr9z\"/\"openshift-service-ca.crt\""
Jul 13 18:19:37.438475 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.438368    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nbr9z\"/\"default-dockercfg-svj4k\""
Jul 13 18:19:37.445565 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.445540    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"]
Jul 13 18:19:37.535187 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.535146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjcfj\" (UniqueName: \"kubernetes.io/projected/0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2-kube-api-access-qjcfj\") pod \"perf-node-gather-daemonset-6mfnc\" (UID: \"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.535428 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.535203    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2-sys\") pod \"perf-node-gather-daemonset-6mfnc\" (UID: \"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.535428 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.535343    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2-proc\") pod \"perf-node-gather-daemonset-6mfnc\" (UID: \"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.535428 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.535381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2-podres\") pod \"perf-node-gather-daemonset-6mfnc\" (UID: \"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.535428 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.535416    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2-lib-modules\") pod \"perf-node-gather-daemonset-6mfnc\" (UID: \"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.635933 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.635891    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2-sys\") pod \"perf-node-gather-daemonset-6mfnc\" (UID: \"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.636136 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.635949    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2-proc\") pod \"perf-node-gather-daemonset-6mfnc\" (UID: \"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.636136 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.636016    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2-proc\") pod \"perf-node-gather-daemonset-6mfnc\" (UID: \"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.636136 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.636029    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2-sys\") pod \"perf-node-gather-daemonset-6mfnc\" (UID: \"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.636136 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.636059    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2-podres\") pod \"perf-node-gather-daemonset-6mfnc\" (UID: \"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.636136 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.636104    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2-lib-modules\") pod \"perf-node-gather-daemonset-6mfnc\" (UID: \"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.636465 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.636162    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2-podres\") pod \"perf-node-gather-daemonset-6mfnc\" (UID: \"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.636465 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.636209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjcfj\" (UniqueName: \"kubernetes.io/projected/0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2-kube-api-access-qjcfj\") pod \"perf-node-gather-daemonset-6mfnc\" (UID: \"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.636465 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.636295    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2-lib-modules\") pod \"perf-node-gather-daemonset-6mfnc\" (UID: \"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.643930 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.643898    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjcfj\" (UniqueName: \"kubernetes.io/projected/0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2-kube-api-access-qjcfj\") pod \"perf-node-gather-daemonset-6mfnc\" (UID: \"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2\") " pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.722146 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.722061    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/1.log"
Jul 13 18:19:37.731079 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.731047    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-8878b_111b636e-36d8-4c99-ac23-631505961170/console-operator/2.log"
Jul 13 18:19:37.746100 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.746066    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:37.880861 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:37.880833    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"]
Jul 13 18:19:37.882817 ip-10-0-137-223 kubenswrapper[2564]: W0713 18:19:37.882788    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0b41fe0a_7ea1_413a_abb9_3f961b1ce2f2.slice/crio-4aea036316b297fb54717e491cad85409b30393f1a7cd5523a5963cc897caa1a WatchSource:0}: Error finding container 4aea036316b297fb54717e491cad85409b30393f1a7cd5523a5963cc897caa1a: Status 404 returned error can't find the container with id 4aea036316b297fb54717e491cad85409b30393f1a7cd5523a5963cc897caa1a
Jul 13 18:19:38.873348 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:38.873315    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc" event={"ID":"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2","Type":"ContainerStarted","Data":"cd51aeaf251ed9aa579964579c9ea023a99058e02c9617b1471014f3f8b77cc8"}
Jul 13 18:19:38.873740 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:38.873370    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc" event={"ID":"0b41fe0a-7ea1-413a-abb9-3f961b1ce2f2","Type":"ContainerStarted","Data":"4aea036316b297fb54717e491cad85409b30393f1a7cd5523a5963cc897caa1a"}
Jul 13 18:19:38.873740 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:38.873401    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:38.889674 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:38.889620    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc" podStartSLOduration=1.889602751 podStartE2EDuration="1.889602751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:19:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:19:38.888479352 +0000 UTC m=+2874.401654622" watchObservedRunningTime="2026-07-13 18:19:38.889602751 +0000 UTC m=+2874.402778015"
Jul 13 18:19:38.961564 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:38.961537    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-fm4k8_bd6391f8-ce94-4677-92d6-047514b9479f/volume-data-source-validator/0.log"
Jul 13 18:19:40.042193 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:40.042161    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vr8x9_a6d21c8d-0abf-4429-ac79-efa11aa43aec/dns/0.log"
Jul 13 18:19:40.064252 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:40.064224    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vr8x9_a6d21c8d-0abf-4429-ac79-efa11aa43aec/kube-rbac-proxy/0.log"
Jul 13 18:19:40.139081 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:40.139052    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7gznh_26261b52-74ca-405a-98cc-4cd807ec42f4/dns-node-resolver/0.log"
Jul 13 18:19:40.806924 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:40.806892    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nx5qk_e0b0c1eb-d696-4180-bfd9-f7d1d32dec80/node-ca/0.log"
Jul 13 18:19:42.001852 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:42.001807    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dc9d9cd-ppxzd_e78b1508-5797-43e1-889f-27fc54efcd2d/kube-auth-proxy/0.log"
Jul 13 18:19:42.172381 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:42.172355    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75c8cd656-p548p_4c7a9e1c-535f-4468-a0cb-68454f647ea3/router/0.log"
Jul 13 18:19:42.943604 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:42.943577    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wnx5t_c66a8af0-b527-42ae-b24e-fb6f1b1885ea/serve-healthcheck-canary/0.log"
Jul 13 18:19:43.425917 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:43.425847    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-s57lt_1d2776c4-1aa1-4631-840a-8dbf875b62a8/insights-operator/0.log"
Jul 13 18:19:43.427029 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:43.427008    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-s57lt_1d2776c4-1aa1-4631-840a-8dbf875b62a8/insights-operator/1.log"
Jul 13 18:19:43.448811 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:43.448782    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4lfw8_ccd9d90d-a5ea-4a96-8573-5fad19a087b2/kube-rbac-proxy/0.log"
Jul 13 18:19:43.471831 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:43.471802    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4lfw8_ccd9d90d-a5ea-4a96-8573-5fad19a087b2/exporter/0.log"
Jul 13 18:19:43.493738 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:43.493709    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4lfw8_ccd9d90d-a5ea-4a96-8573-5fad19a087b2/extractor/0.log"
Jul 13 18:19:44.888495 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:44.888469    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nbr9z/perf-node-gather-daemonset-6mfnc"
Jul 13 18:19:46.077982 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:46.077948    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qtcg6_7df6d337-3a48-47a9-ac5c-337b0c82214f/server/0.log"
Jul 13 18:19:46.188616 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:46.188590    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vtfm4_36c737ac-b0b4-4777-aad6-e252dc3536e0/manager/0.log"
Jul 13 18:19:46.309883 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:46.309778    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59fbf78564-2jfdl_7d7fac46-626a-4eb5-b367-5fb54189570c/manager/0.log"
Jul 13 18:19:46.330939 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:46.330912    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-59fbf78564-2jfdl_7d7fac46-626a-4eb5-b367-5fb54189570c/copy-manifests/0.log"
Jul 13 18:19:47.528012 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:47.527924    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dc9d9cd-ppxzd_e78b1508-5797-43e1-889f-27fc54efcd2d/kube-auth-proxy/0.log"
Jul 13 18:19:47.650439 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:47.650402    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75c8cd656-p548p_4c7a9e1c-535f-4468-a0cb-68454f647ea3/router/0.log"
Jul 13 18:19:47.870959 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:47.870928    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-84567cbc5f-m4959_9aca23fd-aaad-4a23-b0c2-fdbff378efc1/manager/0.log"
Jul 13 18:19:49.092031 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:49.091994    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-545dc9d9cd-ppxzd_e78b1508-5797-43e1-889f-27fc54efcd2d/kube-auth-proxy/0.log"
Jul 13 18:19:49.222400 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:49.222367    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75c8cd656-p548p_4c7a9e1c-535f-4468-a0cb-68454f647ea3/router/0.log"
Jul 13 18:19:53.213321 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:53.213232    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-brczj_62d8c92a-b95e-4cb5-ba78-83f4e808eb65/kube-storage-version-migrator-operator/1.log"
Jul 13 18:19:53.214928 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:53.214895    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-brczj_62d8c92a-b95e-4cb5-ba78-83f4e808eb65/kube-storage-version-migrator-operator/0.log"
Jul 13 18:19:54.536335 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:54.536302    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p58fk_b8d7f308-9d05-4571-9072-9dadbdf3ccb4/kube-multus-additional-cni-plugins/0.log"
Jul 13 18:19:54.560006 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:54.559978    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p58fk_b8d7f308-9d05-4571-9072-9dadbdf3ccb4/egress-router-binary-copy/0.log"
Jul 13 18:19:54.583960 ip-10-0-137-223 kubenswrapper[2564]: I0713 18:19:54.583925    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p58fk_b8d7f308-9d05-4571-9072-9dadbdf3ccb4/cni-plugins/0.log"