Jul 29 17:52:50.417866 ip-10-0-138-0 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 17:52:50.802133 ip-10-0-138-0 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 17:52:50.802133 ip-10-0-138-0 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 17:52:50.802133 ip-10-0-138-0 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 17:52:50.802133 ip-10-0-138-0 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 17:52:50.802133 ip-10-0-138-0 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 17:52:50.803125 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.803041    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 17:52:50.809711 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809687    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 17:52:50.809711 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809707    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 17:52:50.809711 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809713    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 17:52:50.809711 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809718    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809722    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809726    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809730    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809734    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809738    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809741    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809745    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809749    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809752    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809756    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809762    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809768    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809772    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809775    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809779    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809783    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809788    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809791    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 17:52:50.809952 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809795    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809799    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809803    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809807    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809811    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809815    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809819    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809823    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809827    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809832    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809836    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809840    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809845    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809850    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809854    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809860    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809864    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809868    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809873    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809877    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809881    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 17:52:50.810755 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809885    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809890    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809894    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809898    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809902    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809906    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809911    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809916    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809920    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809927    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809933    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809939    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809945    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809951    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809956    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809960    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809965    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809979    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809984    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 17:52:50.811702 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809989    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809994    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.809998    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810002    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810007    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810011    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810015    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810021    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810025    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810030    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810034    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810039    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810043    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810047    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810051    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810055    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810060    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810064    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810068    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810073    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 17:52:50.812495 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810079    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810084    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810089    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810093    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810097    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810101    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810106    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810110    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810114    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810119    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810123    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810127    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810131    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810136    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810140    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810144    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.810148    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811332    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811343    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811350    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 17:52:50.813361 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811355    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811362    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811367    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811375    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811380    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811385    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811389    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811394    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811398    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811402    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811407    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811411    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811415    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811420    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811425    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811429    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811434    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811438    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811443    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 17:52:50.814235 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811447    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811451    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811456    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811460    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811464    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811468    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811472    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811476    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811480    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811485    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811489    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811493    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811499    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811503    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811508    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811512    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811516    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811522    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811526    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 17:52:50.814879 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811531    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811553    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811558    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811562    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811567    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811571    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811576    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811580    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811584    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811589    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811594    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811598    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811602    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811607    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811611    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811615    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811619    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811623    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811627    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811632    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 17:52:50.815448 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811636    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811640    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811644    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811649    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811653    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811661    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811667    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811673    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811678    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811684    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811688    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811693    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811697    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811701    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811705    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811709    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811713    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811717    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811721    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 17:52:50.816091 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811725    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811729    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811734    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811740    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811745    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811749    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811754    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811758    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811762    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811766    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811771    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811775    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811779    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811783    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811788    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811792    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811796    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811800    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.811805    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812437    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812445    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 17:52:50.816703 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812449    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812454    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812457    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812463    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812467    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812472    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812477    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812481    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812485    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812489    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812494    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812498    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812502    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812506    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812510    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812515    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812519    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812523    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812530    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 17:52:50.817239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812557    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812563    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812568    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812572    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812577    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812581    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812585    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812589    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812593    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812596    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812601    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812606    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812612    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812617    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812622    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812627    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812631    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812634    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812638    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 17:52:50.817890 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812643    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812647    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812654    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812660    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812664    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812669    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812673    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812678    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812682    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812687    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812692    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812696    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812700    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812708    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812712    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812716    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812720    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812725    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812730    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 17:52:50.818354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812734    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812738    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812742    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812746    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812751    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812755    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812759    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812763    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812768    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812772    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812776    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812780    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812784    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812788    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812793    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812797    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812801    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812805    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812809    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812813    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 17:52:50.818893 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812817    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812821    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812826    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812830    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812835    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812839    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812847    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812851    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812855    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812859    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812863    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812867    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812871    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812875    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812880    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812884    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812889    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812893    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812898    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.812902    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 17:52:50.819377 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813005    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813022    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813031    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813038    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813045    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813050    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813060    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813067    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813072    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813077    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813083    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813088    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813094    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813098    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813103    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813108    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813113    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813118    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813127    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813132    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813137    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813142    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813147    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813153    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 17:52:50.819905 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813158    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813163    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813169    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813174    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813180    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813185    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813190    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813195    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813202    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813206    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813211    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813216    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813221    2567 flags.go:64] FLAG: --enable-server="true"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813226    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813232    2567 flags.go:64] FLAG: --event-burst="100"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813237    2567 flags.go:64] FLAG: --event-qps="50"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813242    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813247    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813252    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813258    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813263    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813268    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813273    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813277    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813282    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 17:52:50.820501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813288    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813296    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813300    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813305    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813310    2567 flags.go:64] FLAG: --feature-gates=""
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813316    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813321    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813325    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813331    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813336    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813341    2567 flags.go:64] FLAG: --help="false"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813348    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-138-0.ec2.internal"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813353    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813358    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813362    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813367    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813372    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813377    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813381    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813386    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813391    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813395    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813400    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813405    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 29 17:52:50.821170 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813410    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813415    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813420    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813425    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813430    2567 flags.go:64] FLAG: --lock-file=""
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813434    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813439    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813449    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813458    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813465    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813471    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813475    2567 flags.go:64] FLAG: --logging-format="text"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813480    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813485    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813490    2567 flags.go:64] FLAG: --manifest-url=""
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813495    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813502    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813507    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813513    2567 flags.go:64] FLAG: --max-pods="110"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813519    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813524    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813529    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813554    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813561    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813565    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 17:52:50.821839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813570    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813582    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813586    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813591    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813596    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813601    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813609    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813614    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813619    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813623    2567 flags.go:64] FLAG: --port="10250"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813628    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813633    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07e989657afeeb409"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813638    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813643    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813648    2567 flags.go:64] FLAG: --register-node="true"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813653    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813661    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813667    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813672    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813677    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813683    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813688    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813693    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813697    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813702    2567 flags.go:64] FLAG: --runonce="false"
Jul 29 17:52:50.822448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813706    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813711    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813719    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813724    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813729    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813734    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813739    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813744    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813748    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813752    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813757    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813762    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813767    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813772    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813776    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813786    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813790    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813795    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813802    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813807    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813812    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813816    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813821    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813827    2567 flags.go:64] FLAG: --v="2"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813834    2567 flags.go:64] FLAG: --version="false"
Jul 29 17:52:50.823102 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813842    2567 flags.go:64] FLAG: --vmodule=""
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813848    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.813854    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814039    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814045    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814049    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814053    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814059    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814063    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814069    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814074    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814079    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814083    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814089    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814093    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814097    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814101    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814108    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814114    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814119    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 17:52:50.823728 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814123    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814127    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814132    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814136    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814141    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814145    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814149    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814153    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814158    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814162    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814169    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814173    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814177    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814182    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814187    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814191    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814196    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814200    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814204    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814209    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 17:52:50.824239 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814213    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814219    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814223    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814227    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814231    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814236    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814239    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814243    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814247    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814251    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814258    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814263    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814268    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814273    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814278    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814283    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814287    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814291    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 17:52:50.824758 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814298    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814303    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814308    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814313    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814321    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814325    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814330    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814335    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814340    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814345    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814350    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814354    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814359    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814364    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814368    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814374    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814379    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814383    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814387    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814391    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 17:52:50.825246 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814395    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814400    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814404    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814409    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814413    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814417    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814422    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814426    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814430    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814434    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814439    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814443    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814447    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814452    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814456    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814460    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814466    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814471    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814475    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814479    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 17:52:50.825751 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814483    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 17:52:50.826249 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814489    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 17:52:50.826249 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814493    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 17:52:50.826249 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.814498    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 17:52:50.826249 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.815283    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 17:52:50.826249 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.823090    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 17:52:50.826249 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.823107    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 17:52:50.826249 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.823813    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 17:52:50.826249 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.823821    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 17:52:50.826249 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823877    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 17:52:50.826249 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823882    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 17:52:50.826249 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823886    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 17:52:50.826249 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823890    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 17:52:50.826249 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823892    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 17:52:50.826249 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823895    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 17:52:50.826249 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823898    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823901    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823903    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823907    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823910    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823913    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823915    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823918    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823921    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823924    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823927    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823930    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823932    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823935    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823937    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823940    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823942    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823945    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823948    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 17:52:50.826656 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823951    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823954    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823959    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823962    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823966    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823970    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823974    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823977    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823980    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823984    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823987    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823990    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823993    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823996    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.823998    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824001    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824003    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824006    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824009    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 17:52:50.827131 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824011    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824014    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824024    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824028    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824030    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824033    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824036    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824039    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824041    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824044    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824046    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824049    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824052    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824054    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824057    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824059    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824062    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824065    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824069    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824072    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 17:52:50.827600 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824075    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824078    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824080    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824083    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824085    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824088    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824091    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824093    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824096    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824098    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824101    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824104    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824106    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824110    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824113    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824117    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824120    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824122    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824125    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 17:52:50.828107 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824128    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 17:52:50.828608 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824131    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 17:52:50.828608 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824133    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 17:52:50.828608 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824136    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 17:52:50.828608 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824138    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 17:52:50.828608 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824141    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 17:52:50.828608 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824144    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 17:52:50.828608 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824147    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 17:52:50.828608 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824149    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 17:52:50.828608 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824152    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 17:52:50.828608 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824154    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 17:52:50.828608 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824157    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 17:52:50.828608 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824160    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 17:52:50.828608 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824163    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 17:52:50.828608 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824166    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 17:52:50.828608 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824169    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 17:52:50.829005 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.824174    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 17:52:50.829005 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824287    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 17:52:50.829005 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824291    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 17:52:50.829005 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824294    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 17:52:50.829005 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824297    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 17:52:50.829005 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824300    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 17:52:50.829005 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824303    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 17:52:50.829005 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824306    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 17:52:50.829005 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824309    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 17:52:50.829005 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824312    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 17:52:50.829005 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824315    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 17:52:50.829005 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824318    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 17:52:50.829005 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824321    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 17:52:50.829005 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824324    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 17:52:50.829005 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824326    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824329    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824332    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824335    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824338    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824340    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824343    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824346    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824349    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824351    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824354    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824356    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824359    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824362    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824364    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824367    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824370    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824373    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824376    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824378    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 17:52:50.829379 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824381    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824384    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824386    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824389    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824391    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824394    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824397    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824399    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824402    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824404    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824407    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824409    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824412    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824415    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824417    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824420    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824422    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824425    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824428    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824430    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 17:52:50.829877 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824433    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824435    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824438    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824440    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824443    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824446    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824449    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824451    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824454    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824457    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824460    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824463    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824465    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824468    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824470    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824473    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824475    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824478    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824481    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 17:52:50.830360 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824483    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824486    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824488    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824491    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824494    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824496    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824499    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824501    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824504    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824507    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824510    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824513    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824516    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824518    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824521    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824523    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824526    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824529    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824532    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 17:52:50.830898 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824549    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 17:52:50.831354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824552    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 17:52:50.831354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824556    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 17:52:50.831354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824561    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 17:52:50.831354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824565    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 17:52:50.831354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824568    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 17:52:50.831354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824571    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 17:52:50.831354 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:50.824574    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 17:52:50.831354 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.824580    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 17:52:50.831354 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.825290    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 17:52:50.831354 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.827154    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 17:52:50.831354 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.828354    2567 server.go:1019] "Starting client certificate rotation"
Jul 29 17:52:50.831354 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.828468    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 17:52:50.831354 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.828506    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 17:52:50.831695 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.831099    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 17:52:50.836748 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.836727    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 17:52:50.850435 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.850414    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 29 17:52:50.852607 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.852590    2567 log.go:25] "Validated CRI v1 image API"
Jul 29 17:52:50.853412 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.853395    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 17:52:50.857804 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.857783    2567 fs.go:135] Filesystem UUIDs: map[000337c2-69e5-4263-919a-298aafcb1edc:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 de4fee4e-32bd-42d4-8fab-ed06debda200:/dev/nvme0n1p3]
Jul 29 17:52:50.857878 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.857803    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 17:52:50.862956 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.862840    2567 manager.go:216] Machine: {Timestamp:2026-07-29 17:52:50.861473615 +0000 UTC m=+0.319155527 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099670 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2df06b9a1d7e71d441a8b832ecb558 SystemUUID:ec2df06b-9a1d-7e71-d441-a8b832ecb558 BootID:15ed9285-84c3-4c8c-9f70-0e4c3ceeb1a0 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:04:ab:c0:c0:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:04:ab:c0:c0:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:6b:60:b1:dc:ec Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 17:52:50.862956 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.862948    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 17:52:50.863089 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.863066    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 17:52:50.863818 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.863803    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 17:52:50.866136 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.866109    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 17:52:50.866313 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.866154    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-0.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 17:52:50.867011 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.867001    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 17:52:50.867047 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.867014    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 17:52:50.867047 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.867022    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 17:52:50.867626 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.867616    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 17:52:50.868804 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.868794    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 17:52:50.870616 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.870605    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 17:52:50.870742 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.870732    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 17:52:50.870796 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.870789    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 17:52:50.870826 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.870804    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 17:52:50.870858 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.870824    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 17:52:50.870858 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.870838    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 29 17:52:50.870858 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.870848    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 17:52:50.871531 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.871507    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 17:52:50.871659 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.871554    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 17:52:50.873927 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.873912    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 17:52:50.875759 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.875747    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 17:52:50.875803 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.875777    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 17:52:50.877112 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.877102    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 17:52:50.877153 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.877118    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 17:52:50.877153 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.877124    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 17:52:50.877153 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.877130    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 17:52:50.877153 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.877139    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 17:52:50.877153 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.877144    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 17:52:50.877153 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.877153    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 17:52:50.877314 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.877159    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 17:52:50.877314 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.877166    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 17:52:50.877314 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.877172    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 17:52:50.877314 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.877189    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 17:52:50.877314 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.877195    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 17:52:50.877855 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.877845    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 17:52:50.877888 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.877856    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 17:52:50.881376 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.881361    2567 server.go:1268] "Started kubelet"
Jul 29 17:52:50.881481 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.881447    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 17:52:50.882500 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.881484    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 17:52:50.882595 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.882546    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 17:52:50.883595 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.883570    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-0.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 17:52:50.883847 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:50.883823    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 17:52:50.883847 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:50.883802    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 17:52:50.884122 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.884103    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 17:52:50.885162 ip-10-0-138-0 systemd[1]: Started Kubernetes Kubelet.
Jul 29 17:52:50.886471 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.886456    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 17:52:50.889126 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:50.889103    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 17:52:50.891622 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:50.890612    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-0.ec2.internal.18c6d42812fc9c89  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-0.ec2.internal,UID:ip-10-0-138-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-0.ec2.internal,},FirstTimestamp:2026-07-29 17:52:50.881305737 +0000 UTC m=+0.338987648,LastTimestamp:2026-07-29 17:52:50.881305737 +0000 UTC m=+0.338987648,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-0.ec2.internal,}"
Jul 29 17:52:50.893575 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.893316    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 17:52:50.893575 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.893331    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 17:52:50.893575 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:50.893438    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:50.894710 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.894690    2567 factory.go:55] Registering systemd factory
Jul 29 17:52:50.894710 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.894705    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 17:52:50.894843 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.894714    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 29 17:52:50.894843 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.894707    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 17:52:50.894843 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.894730    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 17:52:50.894951 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.894865    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 17:52:50.894951 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.894874    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 17:52:50.895045 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.895025    2567 factory.go:153] Registering CRI-O factory
Jul 29 17:52:50.895045 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.895042    2567 factory.go:223] Registration of the crio container factory successfully
Jul 29 17:52:50.895177 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.895093    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 17:52:50.895177 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.895117    2567 factory.go:103] Registering Raw factory
Jul 29 17:52:50.895177 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.895132    2567 manager.go:1196] Started watching for new ooms in manager
Jul 29 17:52:50.895573 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.895553    2567 manager.go:349] Starting recovery of all containers
Jul 29 17:52:50.901212 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:50.901183    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 17:52:50.901335 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:50.901274    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 17:52:50.905731 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.905715    2567 manager.go:354] Recovery completed
Jul 29 17:52:50.910608 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.910591    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 17:52:50.912407 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.912378    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 17:52:50.912471 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.912424    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 17:52:50.912471 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.912440    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID"
Jul 29 17:52:50.913004 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.912985    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 17:52:50.913004 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.913003    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 17:52:50.913129 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.913019    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 17:52:50.913129 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.913021    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 17:52:50.913666 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.913649    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hq8sz"
Jul 29 17:52:50.913872 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.913852    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 17:52:50.913961 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.913887    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 17:52:50.913961 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.913904    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID"
Jul 29 17:52:50.914949 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.914934    2567 policy_none.go:49] "None policy: Start"
Jul 29 17:52:50.915032 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.914953    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 17:52:50.915032 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.914967    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 17:52:50.916167 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:50.915697    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-0.ec2.internal.18c6d42814d72b7b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-0.ec2.internal,UID:ip-10-0-138-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-0.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-0.ec2.internal,},FirstTimestamp:2026-07-29 17:52:50.912406395 +0000 UTC m=+0.370088307,LastTimestamp:2026-07-29 17:52:50.912406395 +0000 UTC m=+0.370088307,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-0.ec2.internal,}"
Jul 29 17:52:50.917650 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.917622    2567 policy_none.go:47] "Start"
Jul 29 17:52:50.923164 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.923148    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hq8sz"
Jul 29 17:52:50.924426 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:50.924354    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-0.ec2.internal.18c6d42814d78855  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-0.ec2.internal,UID:ip-10-0-138-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-0.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-0.ec2.internal,},FirstTimestamp:2026-07-29 17:52:50.912430165 +0000 UTC m=+0.370112078,LastTimestamp:2026-07-29 17:52:50.912430165 +0000 UTC m=+0.370112078,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-0.ec2.internal,}"
Jul 29 17:52:50.926851 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:50.926768    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-0.ec2.internal.18c6d42814d7c4cf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-0.ec2.internal,UID:ip-10-0-138-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-0.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-0.ec2.internal,},FirstTimestamp:2026-07-29 17:52:50.912445647 +0000 UTC m=+0.370127563,LastTimestamp:2026-07-29 17:52:50.912445647 +0000 UTC m=+0.370127563,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-0.ec2.internal,}"
Jul 29 17:52:50.943192 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.943177    2567 manager.go:337] "Starting Device Plugin manager"
Jul 29 17:52:50.943288 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:50.943214    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 17:52:50.943288 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.943225    2567 server.go:87] "Starting device plugin registration server"
Jul 29 17:52:50.943486 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.943470    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 17:52:50.943724 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.943497    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 17:52:50.943724 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.943597    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 17:52:50.943724 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.943698    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 17:52:50.943724 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.943705    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 17:52:50.944380 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:50.944361    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 17:52:50.944522 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:50.944505    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:50.956440 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.956405    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 17:52:50.957567 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.957530    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 17:52:50.957670 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.957585    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 17:52:50.957670 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.957611    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 17:52:50.957670 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:50.957646    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 17:52:50.959907 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:50.959889    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 17:52:51.044266 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.044235    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 17:52:51.045312 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.045293    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 17:52:51.045385 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.045327    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 17:52:51.045385 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.045337    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID"
Jul 29 17:52:51.045385 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.045361    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.055832 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.055714    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.055832 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:51.055747    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-0.ec2.internal\": node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:51.057878 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.057859    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal"]
Jul 29 17:52:51.057938 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.057927    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 17:52:51.059379 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.059359    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 17:52:51.059489 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.059393    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 17:52:51.059489 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.059407    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID"
Jul 29 17:52:51.060862 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.060845    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 17:52:51.060959 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.060941    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.061009 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.060979    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 17:52:51.061662 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.061645    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 17:52:51.061754 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.061679    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 17:52:51.061754 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.061693    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID"
Jul 29 17:52:51.061754 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.061698    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 17:52:51.061754 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.061731    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 17:52:51.061754 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.061745    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID"
Jul 29 17:52:51.063430 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.063415    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.063505 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.063447    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 17:52:51.064218 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.064203    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 17:52:51.064273 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.064239    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 17:52:51.064273 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.064254    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID"
Jul 29 17:52:51.082108 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:51.082086    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:51.095408 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:51.095384    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-0.ec2.internal\" not found" node="ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.099926 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:51.099908    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-0.ec2.internal\" not found" node="ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.183161 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:51.183131    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:51.195483 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.195464    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9761bdc563be04bad0254b4a24289200-config\") pod \"kube-apiserver-proxy-ip-10-0-138-0.ec2.internal\" (UID: \"9761bdc563be04bad0254b4a24289200\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.195591 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.195490    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f37f8e60f1d0647f24a342c586f7a75-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"4f37f8e60f1d0647f24a342c586f7a75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.195591 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.195508    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f37f8e60f1d0647f24a342c586f7a75-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"4f37f8e60f1d0647f24a342c586f7a75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.283907 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:51.283865    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:51.296272 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.296240    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9761bdc563be04bad0254b4a24289200-config\") pod \"kube-apiserver-proxy-ip-10-0-138-0.ec2.internal\" (UID: \"9761bdc563be04bad0254b4a24289200\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.296318 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.296274    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f37f8e60f1d0647f24a342c586f7a75-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"4f37f8e60f1d0647f24a342c586f7a75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.296318 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.296291    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f37f8e60f1d0647f24a342c586f7a75-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"4f37f8e60f1d0647f24a342c586f7a75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.296396 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.296336    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4f37f8e60f1d0647f24a342c586f7a75-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"4f37f8e60f1d0647f24a342c586f7a75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.296396 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.296341    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9761bdc563be04bad0254b4a24289200-config\") pod \"kube-apiserver-proxy-ip-10-0-138-0.ec2.internal\" (UID: \"9761bdc563be04bad0254b4a24289200\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.296465 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.296412    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f37f8e60f1d0647f24a342c586f7a75-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal\" (UID: \"4f37f8e60f1d0647f24a342c586f7a75\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.384794 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:51.384699    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:51.399280 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.399256    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.403679 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.403282    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal"
Jul 29 17:52:51.485696 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:51.485487    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:51.586113 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:51.586073    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:51.686711 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:51.686646    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:51.787263 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:51.787231    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:51.827809 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.827787    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 17:52:51.828219 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:51.827937    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 17:52:51.888037 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:51.888002    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:53.037212 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.037181    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 17:47:52 +0000 UTC" deadline="2028-04-21 23:44:04.52787679 +0000 UTC"
Jul 29 17:52:53.037269 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.037212    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15173h51m11.490667837s"
Jul 29 17:52:53.098629 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:53.098542    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:53.147046 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.147007    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 17:52:53.199578 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:53.199539    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:53.209065 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.209040    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 17:52:53.210417 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.210394    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 17:52:53.210518 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.210435    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 17:52:53.210518 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.210449    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeHasSufficientPID"
Jul 29 17:52:53.227004 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:53.226948    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9761bdc563be04bad0254b4a24289200.slice/crio-ea7b0de0efda349f3c4d01185646490ba35eed0050df029b192723ada10eb010 WatchSource:0}: Error finding container ea7b0de0efda349f3c4d01185646490ba35eed0050df029b192723ada10eb010: Status 404 returned error can't find the container with id ea7b0de0efda349f3c4d01185646490ba35eed0050df029b192723ada10eb010
Jul 29 17:52:53.227390 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:53.227369    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f37f8e60f1d0647f24a342c586f7a75.slice/crio-a4bbe3bb2fa1388d5afaa3162bc4ca905e6c99f959786b988db78a51e2db6288 WatchSource:0}: Error finding container a4bbe3bb2fa1388d5afaa3162bc4ca905e6c99f959786b988db78a51e2db6288: Status 404 returned error can't find the container with id a4bbe3bb2fa1388d5afaa3162bc4ca905e6c99f959786b988db78a51e2db6288
Jul 29 17:52:53.232973 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.232955    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 17:52:53.299943 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:53.299902    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:53.400608 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:53.400530    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-0.ec2.internal\" not found"
Jul 29 17:52:53.404377 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.404349    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 17:52:53.503540 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.503518    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal"
Jul 29 17:52:53.515643 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.515621    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 17:52:53.516582 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.516568    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal"
Jul 29 17:52:53.535528 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.535508    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 17:52:53.540185 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.540163    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 17:52:53.981646 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.981326    2567 apiserver.go:52] "Watching apiserver"
Jul 29 17:52:53.990235 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.990198    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 17:52:53.991688 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.991657    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-d8t56","kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal","openshift-image-registry/node-ca-vq6jk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal","openshift-multus/multus-additional-cni-plugins-6cnvn","openshift-multus/multus-sdq9g","openshift-multus/network-metrics-daemon-pb4m5","openshift-network-diagnostics/network-check-target-bdzwx","kube-system/konnectivity-agent-t5k5f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh","openshift-cluster-node-tuning-operator/tuned-mptzm","openshift-dns/node-resolver-89dgp","openshift-network-operator/iptables-alerter-86qst","openshift-ovn-kubernetes/ovnkube-node-64wqm"]
Jul 29 17:52:53.993728 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.993701    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:53.996019 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.995318    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-86qst"
Jul 29 17:52:53.996524 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.996503    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z5hkw\""
Jul 29 17:52:53.996895 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.996875    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 17:52:53.997314 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.997019    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vq6jk"
Jul 29 17:52:53.998178 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.998161    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:53.999183 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.998871    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 17:52:53.999183 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.998975    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 17:52:53.999183 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.999082    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f9pwc\""
Jul 29 17:52:53.999376 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.999272    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 17:52:53.999873 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.999451    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 17:52:53.999873 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.999638    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 17:52:53.999873 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.999659    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 17:52:53.999873 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:53.999660    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 17:52:54.000130 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.000073    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.000844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.000324    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 17:52:54.001519 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.001410    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.003234 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.002923    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 17:52:54.003342 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.003324    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t5k5f"
Jul 29 17:52:54.003633 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.003611    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 17:52:54.004121 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.004097    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:52:54.004210 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.004173    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:52:54.007291 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.007271    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:52:54.007400 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.007368    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:52:54.008553 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.008531    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 17:52:54.008753 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.008728    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9z6nk\""
Jul 29 17:52:54.009022 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.009005    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xd9ws\""
Jul 29 17:52:54.009088 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.009067    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 17:52:54.009360 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.009340    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 17:52:54.009698 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.009680    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 17:52:54.009782 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.009753    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 17:52:54.009907 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.009892    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 17:52:54.010021 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.010005    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zqpnk\""
Jul 29 17:52:54.010133 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.010115    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 17:52:54.011591 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.010213    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 17:52:54.011591 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.010311    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 17:52:54.011591 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.010549    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nlzcj\""
Jul 29 17:52:54.011591 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.010696    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 17:52:54.011591 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.010755    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 17:52:54.011591 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.010959    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 17:52:54.011591 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.011109    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 17:52:54.012655 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.012347    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cfgjb\""
Jul 29 17:52:54.013643 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.013526    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:52:54.013643 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.013616    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:52:54.014261 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.014202    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a2902694-36ec-4862-b312-619dc1ca027e-konnectivity-ca\") pod \"konnectivity-agent-t5k5f\" (UID: \"a2902694-36ec-4862-b312-619dc1ca027e\") " pod="kube-system/konnectivity-agent-t5k5f"
Jul 29 17:52:54.014395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.014245    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-cni-binary-copy\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.014512 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.014464    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs\") pod \"network-metrics-daemon-pb4m5\" (UID: \"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e\") " pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:52:54.014512 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.014503    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-run-netns\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.014626 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.014535    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/811db32f-58b9-4a71-81ef-0c27b57adde4-env-overrides\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.014680 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.014625    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/811db32f-58b9-4a71-81ef-0c27b57adde4-ovnkube-script-lib\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.014680 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.014657    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6941e167-23bc-45b8-bf79-2c038f30311e-serviceca\") pod \"node-ca-vq6jk\" (UID: \"6941e167-23bc-45b8-bf79-2c038f30311e\") " pod="openshift-image-registry/node-ca-vq6jk"
Jul 29 17:52:54.014798 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.014689    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.014798 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.014725    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz7tq\" (UniqueName: \"kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq\") pod \"network-check-target-bdzwx\" (UID: \"d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab\") " pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:52:54.014900 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.014814    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-systemd-units\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.014900 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.014846    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-cni-netd\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.014900 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.014874    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-cnibin\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.015063 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.014957    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-os-release\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.015063 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.015002    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-run-multus-certs\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.015063 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.015041    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-run-k8s-cni-cncf-io\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.015243 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.015122    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-run-netns\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.015243 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.015161    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-cnibin\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.015243 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.015191    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.015457 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.015220    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-cni-bin\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.015457 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.015315    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-var-lib-kubelet\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.015457 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.015340    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-etc-kubernetes\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.015457 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.015370    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.015457 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.015436    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-kubelet\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.015742 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.015467    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-etc-openvswitch\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.015742 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.015500    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/811db32f-58b9-4a71-81ef-0c27b57adde4-ovn-node-metrics-cert\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.015742 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.015532    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-multus-cni-dir\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.016865    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc505c99-3575-4017-ab6f-a1fa0b0b5fe4-host-slash\") pod \"iptables-alerter-86qst\" (UID: \"bc505c99-3575-4017-ab6f-a1fa0b0b5fe4\") " pod="openshift-network-operator/iptables-alerter-86qst"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.016916    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-run-ovn-kubernetes\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.016944    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-var-lib-cni-bin\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.016967    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a2902694-36ec-4862-b312-619dc1ca027e-agent-certs\") pod \"konnectivity-agent-t5k5f\" (UID: \"a2902694-36ec-4862-b312-619dc1ca027e\") " pod="kube-system/konnectivity-agent-t5k5f"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017008    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s877c\" (UniqueName: \"kubernetes.io/projected/bc505c99-3575-4017-ab6f-a1fa0b0b5fe4-kube-api-access-s877c\") pod \"iptables-alerter-86qst\" (UID: \"bc505c99-3575-4017-ab6f-a1fa0b0b5fe4\") " pod="openshift-network-operator/iptables-alerter-86qst"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017033    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-socket-dir\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017067    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-device-dir\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017090    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-node-log\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017114    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxjrk\" (UniqueName: \"kubernetes.io/projected/811db32f-58b9-4a71-81ef-0c27b57adde4-kube-api-access-bxjrk\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017137    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-multus-daemon-config\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017161    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-os-release\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017184    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017213    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-registration-dir\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017237    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-sys-fs\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017261    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zscdf\" (UniqueName: \"kubernetes.io/projected/6941e167-23bc-45b8-bf79-2c038f30311e-kube-api-access-zscdf\") pod \"node-ca-vq6jk\" (UID: \"6941e167-23bc-45b8-bf79-2c038f30311e\") " pod="openshift-image-registry/node-ca-vq6jk"
Jul 29 17:52:54.017596 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017282    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-hostroot\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017304    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-run-ovn\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017325    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bc505c99-3575-4017-ab6f-a1fa0b0b5fe4-iptables-alerter-script\") pod \"iptables-alerter-86qst\" (UID: \"bc505c99-3575-4017-ab6f-a1fa0b0b5fe4\") " pod="openshift-network-operator/iptables-alerter-86qst"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017347    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-slash\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017369    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-run-systemd\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017400    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-multus-socket-dir-parent\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017593    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qqfv\" (UniqueName: \"kubernetes.io/projected/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-kube-api-access-9qqfv\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017630    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-log-socket\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017657    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/811db32f-58b9-4a71-81ef-0c27b57adde4-ovnkube-config\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017691    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-multus-conf-dir\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017723    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017749    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-run-openvswitch\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017795    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgpbv\" (UniqueName: \"kubernetes.io/projected/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-kube-api-access-kgpbv\") pod \"network-metrics-daemon-pb4m5\" (UID: \"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e\") " pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017821    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d669h\" (UniqueName: \"kubernetes.io/projected/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-kube-api-access-d669h\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017846    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017871    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlhbt\" (UniqueName: \"kubernetes.io/projected/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-kube-api-access-mlhbt\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.018395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017898    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-system-cni-dir\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.019163 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017932    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6941e167-23bc-45b8-bf79-2c038f30311e-host\") pod \"node-ca-vq6jk\" (UID: \"6941e167-23bc-45b8-bf79-2c038f30311e\") " pod="openshift-image-registry/node-ca-vq6jk"
Jul 29 17:52:54.019163 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017957    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-var-lib-openvswitch\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.019163 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.017982    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-system-cni-dir\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.019163 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.018024    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-cni-binary-copy\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.019163 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.018045    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-var-lib-cni-multus\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.019455 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.019435    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.020574 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.020550    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-89dgp"
Jul 29 17:52:54.022396 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.022134    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 17:52:54.022396 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.022203    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 17:52:54.022550 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.022418    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-424rr\""
Jul 29 17:52:54.023254 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.023211    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 17:52:54.023546 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.023379    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gl8f5\""
Jul 29 17:52:54.023546 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.023443    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 17:52:54.023897 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.023734    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 17:52:54.053012 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.052976    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mr78z"
Jul 29 17:52:54.063002 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.062971    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mr78z"
Jul 29 17:52:54.072842 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.072727    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" event={"ID":"9761bdc563be04bad0254b4a24289200","Type":"ContainerStarted","Data":"ea7b0de0efda349f3c4d01185646490ba35eed0050df029b192723ada10eb010"}
Jul 29 17:52:54.074462 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.074431    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" event={"ID":"4f37f8e60f1d0647f24a342c586f7a75","Type":"ContainerStarted","Data":"a4bbe3bb2fa1388d5afaa3162bc4ca905e6c99f959786b988db78a51e2db6288"}
Jul 29 17:52:54.099969 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.099942    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 17:52:54.105874 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.105848    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 17:52:54.118587 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118538    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs\") pod \"network-metrics-daemon-pb4m5\" (UID: \"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e\") " pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:52:54.118587 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118576    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-run-netns\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.118810 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118602    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/811db32f-58b9-4a71-81ef-0c27b57adde4-env-overrides\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.118810 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118626    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/811db32f-58b9-4a71-81ef-0c27b57adde4-ovnkube-script-lib\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.118810 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118647    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6941e167-23bc-45b8-bf79-2c038f30311e-serviceca\") pod \"node-ca-vq6jk\" (UID: \"6941e167-23bc-45b8-bf79-2c038f30311e\") " pod="openshift-image-registry/node-ca-vq6jk"
Jul 29 17:52:54.118810 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.118810 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118704    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz7tq\" (UniqueName: \"kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq\") pod \"network-check-target-bdzwx\" (UID: \"d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab\") " pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:52:54.118810 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118728    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-systemd-units\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.118810 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118749    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-cni-netd\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.118810 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118772    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-cnibin\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.118810 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118794    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-os-release\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118818    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-run-multus-certs\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118856    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71dd6af3-71f3-4859-af35-a7174b3b3fea-dbus\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118886    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-run-k8s-cni-cncf-io\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118910    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-run-netns\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118938    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-cnibin\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.118974    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119028    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-cni-bin\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119055    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-var-lib-kubelet\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119072    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-systemd-units\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119078    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-etc-kubernetes\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119128    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-etc-kubernetes\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119136    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-modprobe-d\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119177    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-cni-netd\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119172    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119216    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-kubelet\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119236    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-cnibin\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.119295 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119272    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-run-netns\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119297    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-os-release\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119326    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-kubelet\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119351    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-run-multus-certs\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119402    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-run-k8s-cni-cncf-io\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119446    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-run-netns\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119486    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-cnibin\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119532    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119572    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-cni-bin\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119635    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-var-lib-kubelet\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119786    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.119820    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119875    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-etc-openvswitch\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119842    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-etc-openvswitch\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.119951    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs podName:40ccf825-6a2b-4d4d-82b8-a8edb3f2168e nodeName:}" failed. No retries permitted until 2026-07-29 17:52:54.619905698 +0000 UTC m=+2.968133792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs") pod "network-metrics-daemon-pb4m5" (UID: "40ccf825-6a2b-4d4d-82b8-a8edb3f2168e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.119977    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/811db32f-58b9-4a71-81ef-0c27b57adde4-ovn-node-metrics-cert\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120028    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-multus-cni-dir\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.120094 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120058    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-run\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120086    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-lib-modules\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120116    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-tuned\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120146    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc505c99-3575-4017-ab6f-a1fa0b0b5fe4-host-slash\") pod \"iptables-alerter-86qst\" (UID: \"bc505c99-3575-4017-ab6f-a1fa0b0b5fe4\") " pod="openshift-network-operator/iptables-alerter-86qst"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120170    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-run-ovn-kubernetes\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120220    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-var-lib-cni-bin\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120241    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc505c99-3575-4017-ab6f-a1fa0b0b5fe4-host-slash\") pod \"iptables-alerter-86qst\" (UID: \"bc505c99-3575-4017-ab6f-a1fa0b0b5fe4\") " pod="openshift-network-operator/iptables-alerter-86qst"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120254    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a2902694-36ec-4862-b312-619dc1ca027e-agent-certs\") pod \"konnectivity-agent-t5k5f\" (UID: \"a2902694-36ec-4862-b312-619dc1ca027e\") " pod="kube-system/konnectivity-agent-t5k5f"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120282    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71dd6af3-71f3-4859-af35-a7174b3b3fea-kubelet-config\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120305    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-sysctl-conf\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120309    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120325    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-systemd\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120349    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-tmp\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120375    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s877c\" (UniqueName: \"kubernetes.io/projected/bc505c99-3575-4017-ab6f-a1fa0b0b5fe4-kube-api-access-s877c\") pod \"iptables-alerter-86qst\" (UID: \"bc505c99-3575-4017-ab6f-a1fa0b0b5fe4\") " pod="openshift-network-operator/iptables-alerter-86qst"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120362    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120401    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-socket-dir\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120405    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-run-ovn-kubernetes\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.120844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120425    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-device-dir\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120448    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-node-log\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxjrk\" (UniqueName: \"kubernetes.io/projected/811db32f-58b9-4a71-81ef-0c27b57adde4-kube-api-access-bxjrk\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120497    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-multus-daemon-config\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120522    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-os-release\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120545    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120549    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/811db32f-58b9-4a71-81ef-0c27b57adde4-env-overrides\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120568    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-registration-dir\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120582    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-multus-cni-dir\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120589    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-sys-fs\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120611    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zscdf\" (UniqueName: \"kubernetes.io/projected/6941e167-23bc-45b8-bf79-2c038f30311e-kube-api-access-zscdf\") pod \"node-ca-vq6jk\" (UID: \"6941e167-23bc-45b8-bf79-2c038f30311e\") " pod="openshift-image-registry/node-ca-vq6jk"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120636    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-var-lib-cni-bin\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120635    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-hostroot\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120696    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-hostroot\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120832    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-socket-dir\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120890    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-sys\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120922    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-run-ovn\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.121539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120948    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bc505c99-3575-4017-ab6f-a1fa0b0b5fe4-iptables-alerter-script\") pod \"iptables-alerter-86qst\" (UID: \"bc505c99-3575-4017-ab6f-a1fa0b0b5fe4\") " pod="openshift-network-operator/iptables-alerter-86qst"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.120974    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-slash\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121018    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-run-systemd\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121042    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-multus-socket-dir-parent\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121066    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qqfv\" (UniqueName: \"kubernetes.io/projected/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-kube-api-access-9qqfv\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121089    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-log-socket\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121107    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-device-dir\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121113    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/811db32f-58b9-4a71-81ef-0c27b57adde4-ovnkube-config\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121137    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-multus-conf-dir\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121158    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-host-slash\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121205    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-multus-daemon-config\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121211    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-run-ovn\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121216    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-multus-socket-dir-parent\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121161    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-host\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121275    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-os-release\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121384    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-node-log\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121399    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88lxz\" (UniqueName: \"kubernetes.io/projected/252bf4d1-9eab-471e-bb97-cdf6a537d8c6-kube-api-access-88lxz\") pod \"node-resolver-89dgp\" (UID: \"252bf4d1-9eab-471e-bb97-cdf6a537d8c6\") " pod="openshift-dns/node-resolver-89dgp"
Jul 29 17:52:54.122277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121435    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-registration-dir\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121439    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-log-socket\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121439    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121478    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-run-openvswitch\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121506    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-sysconfig\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121531    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb2k7\" (UniqueName: \"kubernetes.io/projected/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-kube-api-access-rb2k7\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121479    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-run-systemd\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121479    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-multus-conf-dir\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121582    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/252bf4d1-9eab-471e-bb97-cdf6a537d8c6-tmp-dir\") pod \"node-resolver-89dgp\" (UID: \"252bf4d1-9eab-471e-bb97-cdf6a537d8c6\") " pod="openshift-dns/node-resolver-89dgp"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121611    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgpbv\" (UniqueName: \"kubernetes.io/projected/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-kube-api-access-kgpbv\") pod \"network-metrics-daemon-pb4m5\" (UID: \"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e\") " pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121638    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d669h\" (UniqueName: \"kubernetes.io/projected/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-kube-api-access-d669h\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121653    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-sys-fs\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121664    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121612    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121726    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlhbt\" (UniqueName: \"kubernetes.io/projected/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-kube-api-access-mlhbt\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121756    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-system-cni-dir\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121780    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6941e167-23bc-45b8-bf79-2c038f30311e-host\") pod \"node-ca-vq6jk\" (UID: \"6941e167-23bc-45b8-bf79-2c038f30311e\") " pod="openshift-image-registry/node-ca-vq6jk"
Jul 29 17:52:54.123082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121805    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-var-lib-openvswitch\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121830    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-system-cni-dir\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121853    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-cni-binary-copy\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121806    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bc505c99-3575-4017-ab6f-a1fa0b0b5fe4-iptables-alerter-script\") pod \"iptables-alerter-86qst\" (UID: \"bc505c99-3575-4017-ab6f-a1fa0b0b5fe4\") " pod="openshift-network-operator/iptables-alerter-86qst"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121880    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121918    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6941e167-23bc-45b8-bf79-2c038f30311e-host\") pod \"node-ca-vq6jk\" (UID: \"6941e167-23bc-45b8-bf79-2c038f30311e\") " pod="openshift-image-registry/node-ca-vq6jk"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121941    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.121952    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-var-lib-openvswitch\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122010    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-var-lib-cni-multus\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122040    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a2902694-36ec-4862-b312-619dc1ca027e-konnectivity-ca\") pod \"konnectivity-agent-t5k5f\" (UID: \"a2902694-36ec-4862-b312-619dc1ca027e\") " pod="kube-system/konnectivity-agent-t5k5f"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122069    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122091    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/811db32f-58b9-4a71-81ef-0c27b57adde4-run-openvswitch\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122098    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-cni-binary-copy\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122191    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-system-cni-dir\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122226    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-system-cni-dir\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-kubernetes\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122298    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-sysctl-d\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.123825 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122321    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-var-lib-kubelet\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.124627 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122324    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/811db32f-58b9-4a71-81ef-0c27b57adde4-ovnkube-config\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.124627 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122356    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/252bf4d1-9eab-471e-bb97-cdf6a537d8c6-hosts-file\") pod \"node-resolver-89dgp\" (UID: \"252bf4d1-9eab-471e-bb97-cdf6a537d8c6\") " pod="openshift-dns/node-resolver-89dgp"
Jul 29 17:52:54.124627 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122533    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-host-var-lib-cni-multus\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.124627 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122571    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-cni-binary-copy\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.124627 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122595    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a2902694-36ec-4862-b312-619dc1ca027e-konnectivity-ca\") pod \"konnectivity-agent-t5k5f\" (UID: \"a2902694-36ec-4862-b312-619dc1ca027e\") " pod="kube-system/konnectivity-agent-t5k5f"
Jul 29 17:52:54.124627 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.122944    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6941e167-23bc-45b8-bf79-2c038f30311e-serviceca\") pod \"node-ca-vq6jk\" (UID: \"6941e167-23bc-45b8-bf79-2c038f30311e\") " pod="openshift-image-registry/node-ca-vq6jk"
Jul 29 17:52:54.124627 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.123181    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/811db32f-58b9-4a71-81ef-0c27b57adde4-ovnkube-script-lib\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.124627 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.123610    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-cni-binary-copy\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.125422 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.125398    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a2902694-36ec-4862-b312-619dc1ca027e-agent-certs\") pod \"konnectivity-agent-t5k5f\" (UID: \"a2902694-36ec-4862-b312-619dc1ca027e\") " pod="kube-system/konnectivity-agent-t5k5f"
Jul 29 17:52:54.126874 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.126852    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/811db32f-58b9-4a71-81ef-0c27b57adde4-ovn-node-metrics-cert\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.138635 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.138584    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 17:52:54.138635 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.138615    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 17:52:54.138635 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.138628    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sz7tq for pod openshift-network-diagnostics/network-check-target-bdzwx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:52:54.138890 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.138695    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq podName:d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab nodeName:}" failed. No retries permitted until 2026-07-29 17:52:54.638676424 +0000 UTC m=+2.986904515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sz7tq" (UniqueName: "kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq") pod "network-check-target-bdzwx" (UID: "d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:52:54.141032 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.140967    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qqfv\" (UniqueName: \"kubernetes.io/projected/40d0d6f9-b2a3-4663-bdba-cf83fac067f5-kube-api-access-9qqfv\") pod \"aws-ebs-csi-driver-node-gw8jh\" (UID: \"40d0d6f9-b2a3-4663-bdba-cf83fac067f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.141032 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.140985    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlhbt\" (UniqueName: \"kubernetes.io/projected/9d1ee8d0-4514-416b-9074-9a60fc53eb4c-kube-api-access-mlhbt\") pod \"multus-sdq9g\" (UID: \"9d1ee8d0-4514-416b-9074-9a60fc53eb4c\") " pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.143542 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.143493    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgpbv\" (UniqueName: \"kubernetes.io/projected/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-kube-api-access-kgpbv\") pod \"network-metrics-daemon-pb4m5\" (UID: \"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e\") " pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:52:54.143655 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.143583    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zscdf\" (UniqueName: \"kubernetes.io/projected/6941e167-23bc-45b8-bf79-2c038f30311e-kube-api-access-zscdf\") pod \"node-ca-vq6jk\" (UID: \"6941e167-23bc-45b8-bf79-2c038f30311e\") " pod="openshift-image-registry/node-ca-vq6jk"
Jul 29 17:52:54.146181 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.146136    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxjrk\" (UniqueName: \"kubernetes.io/projected/811db32f-58b9-4a71-81ef-0c27b57adde4-kube-api-access-bxjrk\") pod \"ovnkube-node-64wqm\" (UID: \"811db32f-58b9-4a71-81ef-0c27b57adde4\") " pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.146605 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.146407    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d669h\" (UniqueName: \"kubernetes.io/projected/31a0018a-f046-4b33-a0e9-ae9cd4a7cec5-kube-api-access-d669h\") pod \"multus-additional-cni-plugins-6cnvn\" (UID: \"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5\") " pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.147289 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.147241    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s877c\" (UniqueName: \"kubernetes.io/projected/bc505c99-3575-4017-ab6f-a1fa0b0b5fe4-kube-api-access-s877c\") pod \"iptables-alerter-86qst\" (UID: \"bc505c99-3575-4017-ab6f-a1fa0b0b5fe4\") " pod="openshift-network-operator/iptables-alerter-86qst"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223363    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-sys\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-host\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223424    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88lxz\" (UniqueName: \"kubernetes.io/projected/252bf4d1-9eab-471e-bb97-cdf6a537d8c6-kube-api-access-88lxz\") pod \"node-resolver-89dgp\" (UID: \"252bf4d1-9eab-471e-bb97-cdf6a537d8c6\") " pod="openshift-dns/node-resolver-89dgp"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223451    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-sysconfig\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223475    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb2k7\" (UniqueName: \"kubernetes.io/projected/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-kube-api-access-rb2k7\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223500    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/252bf4d1-9eab-471e-bb97-cdf6a537d8c6-tmp-dir\") pod \"node-resolver-89dgp\" (UID: \"252bf4d1-9eab-471e-bb97-cdf6a537d8c6\") " pod="openshift-dns/node-resolver-89dgp"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223531    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223554    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-kubernetes\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223576    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-sysctl-d\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223598    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-var-lib-kubelet\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223620    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/252bf4d1-9eab-471e-bb97-cdf6a537d8c6-hosts-file\") pod \"node-resolver-89dgp\" (UID: \"252bf4d1-9eab-471e-bb97-cdf6a537d8c6\") " pod="openshift-dns/node-resolver-89dgp"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223658    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-sysconfig\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71dd6af3-71f3-4859-af35-a7174b3b3fea-dbus\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223697    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-modprobe-d\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223719    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-run\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223726    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-sys\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223768    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-lib-modules\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.224307 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223809    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-tuned\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.223828    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223842    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71dd6af3-71f3-4859-af35-a7174b3b3fea-kubelet-config\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223867    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-sysctl-conf\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.223885    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret podName:71dd6af3-71f3-4859-af35-a7174b3b3fea nodeName:}" failed. No retries permitted until 2026-07-29 17:52:54.72386521 +0000 UTC m=+3.072093283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret") pod "global-pull-secret-syncer-d8t56" (UID: "71dd6af3-71f3-4859-af35-a7174b3b3fea") : object "kube-system"/"original-pull-secret" not registered
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223915    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-systemd\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223939    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-tmp\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223947    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/252bf4d1-9eab-471e-bb97-cdf6a537d8c6-tmp-dir\") pod \"node-resolver-89dgp\" (UID: \"252bf4d1-9eab-471e-bb97-cdf6a537d8c6\") " pod="openshift-dns/node-resolver-89dgp"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.223983    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-sysctl-conf\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.224041    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-run\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.224101    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-lib-modules\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.224148    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-modprobe-d\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.224155    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71dd6af3-71f3-4859-af35-a7174b3b3fea-kubelet-config\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.224197    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-var-lib-kubelet\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.224239    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-host\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.224245    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-sysctl-d\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.224293    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-kubernetes\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.224463    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71dd6af3-71f3-4859-af35-a7174b3b3fea-dbus\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:52:54.225395 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.224050    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/252bf4d1-9eab-471e-bb97-cdf6a537d8c6-hosts-file\") pod \"node-resolver-89dgp\" (UID: \"252bf4d1-9eab-471e-bb97-cdf6a537d8c6\") " pod="openshift-dns/node-resolver-89dgp"
Jul 29 17:52:54.226254 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.224512    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-systemd\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.227549 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.227527    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-etc-tuned\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.227640 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.227568    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-tmp\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.235703 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.235648    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88lxz\" (UniqueName: \"kubernetes.io/projected/252bf4d1-9eab-471e-bb97-cdf6a537d8c6-kube-api-access-88lxz\") pod \"node-resolver-89dgp\" (UID: \"252bf4d1-9eab-471e-bb97-cdf6a537d8c6\") " pod="openshift-dns/node-resolver-89dgp"
Jul 29 17:52:54.237973 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.237949    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb2k7\" (UniqueName: \"kubernetes.io/projected/51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc-kube-api-access-rb2k7\") pod \"tuned-mptzm\" (UID: \"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc\") " pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.308330 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.308297    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh"
Jul 29 17:52:54.322096 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.322070    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-86qst"
Jul 29 17:52:54.339047 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.339016    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vq6jk"
Jul 29 17:52:54.340164 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.340139    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:52:54.349004 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.348966    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6cnvn"
Jul 29 17:52:54.355447 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.355416    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sdq9g"
Jul 29 17:52:54.363264 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.363129    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t5k5f"
Jul 29 17:52:54.371806 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.371787    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mptzm"
Jul 29 17:52:54.378077 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.378049    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-89dgp"
Jul 29 17:52:54.626663 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.626586    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs\") pod \"network-metrics-daemon-pb4m5\" (UID: \"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e\") " pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:52:54.626823 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.626728    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:52:54.626823 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.626793    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs podName:40ccf825-6a2b-4d4d-82b8-a8edb3f2168e nodeName:}" failed. No retries permitted until 2026-07-29 17:52:55.626775208 +0000 UTC m=+3.975003293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs") pod "network-metrics-daemon-pb4m5" (UID: "40ccf825-6a2b-4d4d-82b8-a8edb3f2168e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:52:54.727097 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.727059    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:52:54.727278 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:54.727112    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz7tq\" (UniqueName: \"kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq\") pod \"network-check-target-bdzwx\" (UID: \"d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab\") " pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:52:54.727278 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.727219    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 17:52:54.727278 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.727249    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 17:52:54.727278 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.727267    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 17:52:54.727278 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.727279    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sz7tq for pod openshift-network-diagnostics/network-check-target-bdzwx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:52:54.727510 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.727289    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret podName:71dd6af3-71f3-4859-af35-a7174b3b3fea nodeName:}" failed. No retries permitted until 2026-07-29 17:52:55.727270218 +0000 UTC m=+4.075498312 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret") pod "global-pull-secret-syncer-d8t56" (UID: "71dd6af3-71f3-4859-af35-a7174b3b3fea") : object "kube-system"/"original-pull-secret" not registered
Jul 29 17:52:54.727510 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:54.727317    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq podName:d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab nodeName:}" failed. No retries permitted until 2026-07-29 17:52:55.727305456 +0000 UTC m=+4.075533540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sz7tq" (UniqueName: "kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq") pod "network-check-target-bdzwx" (UID: "d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:52:55.065769 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:55.065681    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 17:47:54 +0000 UTC" deadline="2028-05-08 13:02:47.048736808 +0000 UTC"
Jul 29 17:52:55.065769 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:55.065717    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15571h9m51.983023937s"
Jul 29 17:52:55.219398 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:55.219371    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d0d6f9_b2a3_4663_bdba_cf83fac067f5.slice/crio-13bef10c06c7241036cce7074009a3e881ee70b0bcfa394cf14c44bbe6bb7c73 WatchSource:0}: Error finding container 13bef10c06c7241036cce7074009a3e881ee70b0bcfa394cf14c44bbe6bb7c73: Status 404 returned error can't find the container with id 13bef10c06c7241036cce7074009a3e881ee70b0bcfa394cf14c44bbe6bb7c73
Jul 29 17:52:55.220902 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:55.220780    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252bf4d1_9eab_471e_bb97_cdf6a537d8c6.slice/crio-607c2f2186ba02a4c5467aaff9560e6f26640d5836699354d39f18c6f092135b WatchSource:0}: Error finding container 607c2f2186ba02a4c5467aaff9560e6f26640d5836699354d39f18c6f092135b: Status 404 returned error can't find the container with id 607c2f2186ba02a4c5467aaff9560e6f26640d5836699354d39f18c6f092135b
Jul 29 17:52:55.222216 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:55.221853    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d1ee8d0_4514_416b_9074_9a60fc53eb4c.slice/crio-0bf4cc4887998937c0f301dab84b49d38a0e3f5e5470d3c882213b3191b804e9 WatchSource:0}: Error finding container 0bf4cc4887998937c0f301dab84b49d38a0e3f5e5470d3c882213b3191b804e9: Status 404 returned error can't find the container with id 0bf4cc4887998937c0f301dab84b49d38a0e3f5e5470d3c882213b3191b804e9
Jul 29 17:52:55.227247 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:55.227222    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51eb3da2_20ac_46b2_b6e1_2e45e0ee08cc.slice/crio-eae5dd2203fd82f9c880385ef4f9f1780a6dc2a376164371a2638029e757d04a WatchSource:0}: Error finding container eae5dd2203fd82f9c880385ef4f9f1780a6dc2a376164371a2638029e757d04a: Status 404 returned error can't find the container with id eae5dd2203fd82f9c880385ef4f9f1780a6dc2a376164371a2638029e757d04a
Jul 29 17:52:55.228586 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:55.228486    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a0018a_f046_4b33_a0e9_ae9cd4a7cec5.slice/crio-9283654e351df7b832f7564dfc74a6873322cb708b07c09b9301cd151f0bfe4d WatchSource:0}: Error finding container 9283654e351df7b832f7564dfc74a6873322cb708b07c09b9301cd151f0bfe4d: Status 404 returned error can't find the container with id 9283654e351df7b832f7564dfc74a6873322cb708b07c09b9301cd151f0bfe4d
Jul 29 17:52:55.229364 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:52:55.229345    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2902694_36ec_4862_b312_619dc1ca027e.slice/crio-4e6a0d4b42660f7e67e5c27afc99cde053e49832c95a10947f70070b2a684656 WatchSource:0}: Error finding container 4e6a0d4b42660f7e67e5c27afc99cde053e49832c95a10947f70070b2a684656: Status 404 returned error can't find the container with id 4e6a0d4b42660f7e67e5c27afc99cde053e49832c95a10947f70070b2a684656
Jul 29 17:52:55.634041 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:55.633692    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs\") pod \"network-metrics-daemon-pb4m5\" (UID: \"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e\") " pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:52:55.634041 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:55.633951    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:52:55.634262 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:55.634062    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs podName:40ccf825-6a2b-4d4d-82b8-a8edb3f2168e nodeName:}" failed. No retries permitted until 2026-07-29 17:52:57.634011028 +0000 UTC m=+5.982239118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs") pod "network-metrics-daemon-pb4m5" (UID: "40ccf825-6a2b-4d4d-82b8-a8edb3f2168e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:52:55.734791 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:55.734750    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz7tq\" (UniqueName: \"kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq\") pod \"network-check-target-bdzwx\" (UID: \"d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab\") " pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:52:55.734957 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:55.734838    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:52:55.735031 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:55.734975    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 17:52:55.735099 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:55.735056    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret podName:71dd6af3-71f3-4859-af35-a7174b3b3fea nodeName:}" failed. No retries permitted until 2026-07-29 17:52:57.735035865 +0000 UTC m=+6.083263944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret") pod "global-pull-secret-syncer-d8t56" (UID: "71dd6af3-71f3-4859-af35-a7174b3b3fea") : object "kube-system"/"original-pull-secret" not registered
Jul 29 17:52:55.735490 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:55.735471    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 17:52:55.735569 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:55.735498    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 17:52:55.735569 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:55.735511    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sz7tq for pod openshift-network-diagnostics/network-check-target-bdzwx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:52:55.735569 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:55.735554    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq podName:d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab nodeName:}" failed. No retries permitted until 2026-07-29 17:52:57.735540183 +0000 UTC m=+6.083768256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sz7tq" (UniqueName: "kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq") pod "network-check-target-bdzwx" (UID: "d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:52:56.066291 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.066139    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 17:47:54 +0000 UTC" deadline="2028-02-06 20:41:31.717100367 +0000 UTC"
Jul 29 17:52:56.066291 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.066204    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13370h48m35.650900623s"
Jul 29 17:52:56.070379 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.070351    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:52:56.070539 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:56.070502    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:52:56.070956 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.070937    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:52:56.071075 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:56.071053    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:52:56.071148 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.071133    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:52:56.071247 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:56.071227    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:52:56.093240 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.093129    2567 generic.go:356] "Generic (PLEG): container finished" podID="4f37f8e60f1d0647f24a342c586f7a75" containerID="bb02a02b38b5f1dad95801f401ae24b1cf5d5110e4d44d2ed7f93a0867f9e61c" exitCode=0
Jul 29 17:52:56.093413 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.093284    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" event={"ID":"4f37f8e60f1d0647f24a342c586f7a75","Type":"ContainerDied","Data":"bb02a02b38b5f1dad95801f401ae24b1cf5d5110e4d44d2ed7f93a0867f9e61c"}
Jul 29 17:52:56.103309 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.102880    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-86qst" event={"ID":"bc505c99-3575-4017-ab6f-a1fa0b0b5fe4","Type":"ContainerStarted","Data":"551c93b9a283f2efe024fbe31edab481d403b1047d80c863da0e99ac138255a8"}
Jul 29 17:52:56.106702 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.106671    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t5k5f" event={"ID":"a2902694-36ec-4862-b312-619dc1ca027e","Type":"ContainerStarted","Data":"4e6a0d4b42660f7e67e5c27afc99cde053e49832c95a10947f70070b2a684656"}
Jul 29 17:52:56.114361 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.114331    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mptzm" event={"ID":"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc","Type":"ContainerStarted","Data":"eae5dd2203fd82f9c880385ef4f9f1780a6dc2a376164371a2638029e757d04a"}
Jul 29 17:52:56.117925 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.116584    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-89dgp" event={"ID":"252bf4d1-9eab-471e-bb97-cdf6a537d8c6","Type":"ContainerStarted","Data":"607c2f2186ba02a4c5467aaff9560e6f26640d5836699354d39f18c6f092135b"}
Jul 29 17:52:56.125063 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.124957    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh" event={"ID":"40d0d6f9-b2a3-4663-bdba-cf83fac067f5","Type":"ContainerStarted","Data":"13bef10c06c7241036cce7074009a3e881ee70b0bcfa394cf14c44bbe6bb7c73"}
Jul 29 17:52:56.145383 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.145343    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" event={"ID":"9761bdc563be04bad0254b4a24289200","Type":"ContainerStarted","Data":"9353e46bc0bb724ae28843dc13fece192b27f9b0ccb32631c541db53fb8f7ac4"}
Jul 29 17:52:56.155656 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.155538    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm" event={"ID":"811db32f-58b9-4a71-81ef-0c27b57adde4","Type":"ContainerStarted","Data":"27c3d7439653a70f0ff5446e9b08978ed793a6987eec40c84da914625e587b40"}
Jul 29 17:52:56.159377 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.159311    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6cnvn" event={"ID":"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5","Type":"ContainerStarted","Data":"9283654e351df7b832f7564dfc74a6873322cb708b07c09b9301cd151f0bfe4d"}
Jul 29 17:52:56.164387 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.164348    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vq6jk" event={"ID":"6941e167-23bc-45b8-bf79-2c038f30311e","Type":"ContainerStarted","Data":"f8d60cb76500c9fbfbcf1cdd3914caa4cbf80ec01f5979922e5c07bdc59d55ef"}
Jul 29 17:52:56.189507 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:56.189461    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sdq9g" event={"ID":"9d1ee8d0-4514-416b-9074-9a60fc53eb4c","Type":"ContainerStarted","Data":"0bf4cc4887998937c0f301dab84b49d38a0e3f5e5470d3c882213b3191b804e9"}
Jul 29 17:52:57.209818 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:57.209779    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" event={"ID":"4f37f8e60f1d0647f24a342c586f7a75","Type":"ContainerStarted","Data":"157bd2613be615efac835a286c9c4603e8297afee3068a0b63f9f16ecea3ce78"}
Jul 29 17:52:57.237047 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:57.236972    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-0.ec2.internal" podStartSLOduration=4.236953055 podStartE2EDuration="4.236953055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:52:56.163217727 +0000 UTC m=+4.511445825" watchObservedRunningTime="2026-07-29 17:52:57.236953055 +0000 UTC m=+5.585181150"
Jul 29 17:52:57.651514 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:57.651470    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs\") pod \"network-metrics-daemon-pb4m5\" (UID: \"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e\") " pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:52:57.651701 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:57.651652    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:52:57.651763 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:57.651720    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs podName:40ccf825-6a2b-4d4d-82b8-a8edb3f2168e nodeName:}" failed. No retries permitted until 2026-07-29 17:53:01.651700571 +0000 UTC m=+9.999928693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs") pod "network-metrics-daemon-pb4m5" (UID: "40ccf825-6a2b-4d4d-82b8-a8edb3f2168e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:52:57.752867 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:57.752828    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz7tq\" (UniqueName: \"kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq\") pod \"network-check-target-bdzwx\" (UID: \"d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab\") " pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:52:57.753067 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:57.752910    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:52:57.753067 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:57.753045    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 17:52:57.753193 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:57.753108    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret podName:71dd6af3-71f3-4859-af35-a7174b3b3fea nodeName:}" failed. No retries permitted until 2026-07-29 17:53:01.753090089 +0000 UTC m=+10.101318179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret") pod "global-pull-secret-syncer-d8t56" (UID: "71dd6af3-71f3-4859-af35-a7174b3b3fea") : object "kube-system"/"original-pull-secret" not registered
Jul 29 17:52:57.753566 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:57.753534    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 17:52:57.753566 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:57.753559    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 17:52:57.753566 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:57.753572    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sz7tq for pod openshift-network-diagnostics/network-check-target-bdzwx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:52:57.753818 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:57.753620    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq podName:d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab nodeName:}" failed. No retries permitted until 2026-07-29 17:53:01.753604663 +0000 UTC m=+10.101832750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sz7tq" (UniqueName: "kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq") pod "network-check-target-bdzwx" (UID: "d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:52:58.068082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:58.067567    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:52:58.068082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:58.067587    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:52:58.068082 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:58.067709    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:52:58.068082 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:58.067786    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:52:58.068082 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:52:58.067862    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:52:58.068082 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:52:58.067944    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:00.067982 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:00.067948    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:00.068458 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:00.068098    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:53:00.068527 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:00.068503    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:00.068630 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:00.068606    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:00.068782 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:00.068750    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:00.068900 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:00.068878    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:53:01.685359 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:01.685275    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs\") pod \"network-metrics-daemon-pb4m5\" (UID: \"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e\") " pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:01.685842 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:01.685475    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:01.685842 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:01.685552    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs podName:40ccf825-6a2b-4d4d-82b8-a8edb3f2168e nodeName:}" failed. No retries permitted until 2026-07-29 17:53:09.685530415 +0000 UTC m=+18.033758494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs") pod "network-metrics-daemon-pb4m5" (UID: "40ccf825-6a2b-4d4d-82b8-a8edb3f2168e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:01.786531 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:01.786495    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz7tq\" (UniqueName: \"kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq\") pod \"network-check-target-bdzwx\" (UID: \"d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab\") " pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:01.786695 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:01.786576    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:01.786695 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:01.786687    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:01.786816 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:01.786747    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret podName:71dd6af3-71f3-4859-af35-a7174b3b3fea nodeName:}" failed. No retries permitted until 2026-07-29 17:53:09.786728719 +0000 UTC m=+18.134956795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret") pod "global-pull-secret-syncer-d8t56" (UID: "71dd6af3-71f3-4859-af35-a7174b3b3fea") : object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:01.787227 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:01.787080    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 17:53:01.787227 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:01.787109    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 17:53:01.787227 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:01.787121    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sz7tq for pod openshift-network-diagnostics/network-check-target-bdzwx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:01.787227 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:01.787169    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq podName:d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab nodeName:}" failed. No retries permitted until 2026-07-29 17:53:09.787153669 +0000 UTC m=+18.135381757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sz7tq" (UniqueName: "kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq") pod "network-check-target-bdzwx" (UID: "d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:02.069471 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:02.069385    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:02.069623 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:02.069595    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:02.070083 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:02.070063    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:02.070218 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:02.070200    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:53:02.070574 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:02.070355    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:02.070574 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:02.070473    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:53:04.067558 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:04.067468    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:04.067558 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:04.067515    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:04.068137 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:04.067476    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:04.068137 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:04.067605    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:53:04.068137 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:04.067718    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:53:04.068137 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:04.067795    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:06.073707 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:06.073644    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:06.074160 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:06.073756    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:06.074160 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:06.073763    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:53:06.074160 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:06.073789    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:06.074160 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:06.073888    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:06.074160 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:06.073964    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:53:08.070392 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:08.070361    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:08.070903 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:08.070361    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:08.070903 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:08.070494    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:53:08.070903 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:08.070371    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:08.070903 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:08.070552    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:08.070903 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:08.070631    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:53:09.746815 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:09.746774    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs\") pod \"network-metrics-daemon-pb4m5\" (UID: \"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e\") " pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:09.747370 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:09.746945    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:09.747370 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:09.747034    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs podName:40ccf825-6a2b-4d4d-82b8-a8edb3f2168e nodeName:}" failed. No retries permitted until 2026-07-29 17:53:25.747012172 +0000 UTC m=+34.095240274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs") pod "network-metrics-daemon-pb4m5" (UID: "40ccf825-6a2b-4d4d-82b8-a8edb3f2168e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:09.847259 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:09.847210    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:09.847476 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:09.847288    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz7tq\" (UniqueName: \"kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq\") pod \"network-check-target-bdzwx\" (UID: \"d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab\") " pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:09.847476 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:09.847434    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 17:53:09.847476 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:09.847449    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 17:53:09.847476 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:09.847459    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sz7tq for pod openshift-network-diagnostics/network-check-target-bdzwx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:09.847629 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:09.847478    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:09.847629 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:09.847512    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq podName:d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab nodeName:}" failed. No retries permitted until 2026-07-29 17:53:25.847498065 +0000 UTC m=+34.195726156 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sz7tq" (UniqueName: "kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq") pod "network-check-target-bdzwx" (UID: "d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:09.847629 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:09.847544    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret podName:71dd6af3-71f3-4859-af35-a7174b3b3fea nodeName:}" failed. No retries permitted until 2026-07-29 17:53:25.847530617 +0000 UTC m=+34.195758687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret") pod "global-pull-secret-syncer-d8t56" (UID: "71dd6af3-71f3-4859-af35-a7174b3b3fea") : object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:10.068061 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:10.067964    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:10.068233 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:10.067964    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:10.068233 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:10.068116    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:10.068233 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:10.067964    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:10.068233 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:10.068174    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:53:10.068429 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:10.068287    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:53:12.068982 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:12.068939    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:12.069456 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:12.069075    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:12.069456 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:12.069070    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:12.069456 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:12.069187    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:53:12.069456 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:12.069202    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:12.069456 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:12.069330    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:53:14.068218 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.067909    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:14.068521 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:14.068213    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:14.068521 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.068292    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:14.068521 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:14.068375    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:53:14.068521 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.068437    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:14.068521 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:14.068510    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:53:14.247479 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.247302    2567 generic.go:356] "Generic (PLEG): container finished" podID="31a0018a-f046-4b33-a0e9-ae9cd4a7cec5" containerID="8989411dbe6cf0e3aa78c05f273df47ccacca62d98d932cc407589a2e43f99e9" exitCode=0
Jul 29 17:53:14.247664 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.247385    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6cnvn" event={"ID":"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5","Type":"ContainerDied","Data":"8989411dbe6cf0e3aa78c05f273df47ccacca62d98d932cc407589a2e43f99e9"}
Jul 29 17:53:14.249213 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.249187    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vq6jk" event={"ID":"6941e167-23bc-45b8-bf79-2c038f30311e","Type":"ContainerStarted","Data":"3017ccd5fef0116fa96979bd1de3b4e4c5419f0a82cd6ad184fb760fbc01a1d9"}
Jul 29 17:53:14.250702 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.250676    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sdq9g" event={"ID":"9d1ee8d0-4514-416b-9074-9a60fc53eb4c","Type":"ContainerStarted","Data":"dae65f395dfa3e612e7fe757d1428766d5896235bd37ed548144d5ce40b269a6"}
Jul 29 17:53:14.252089 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.252067    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t5k5f" event={"ID":"a2902694-36ec-4862-b312-619dc1ca027e","Type":"ContainerStarted","Data":"6f72ca8e37dd8cffaa452fc4c9d4923c665b634ce926ce45ef6e644df65d7297"}
Jul 29 17:53:14.253783 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.253723    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mptzm" event={"ID":"51eb3da2-20ac-46b2-b6e1-2e45e0ee08cc","Type":"ContainerStarted","Data":"298841126e4fa18f56a1a903047a207e041de9978537d8741deab386d0a57b91"}
Jul 29 17:53:14.255260 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.255238    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-89dgp" event={"ID":"252bf4d1-9eab-471e-bb97-cdf6a537d8c6","Type":"ContainerStarted","Data":"ce710467f2c88bad075edf3601e99f9cc88ef167fe0e114152ec16973262c43e"}
Jul 29 17:53:14.260754 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.260725    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh" event={"ID":"40d0d6f9-b2a3-4663-bdba-cf83fac067f5","Type":"ContainerStarted","Data":"5d6d0e856a5b653e346904fb36cc42e51c37e79da5cd11a9af5941be123bd61b"}
Jul 29 17:53:14.262602 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.262581    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm" event={"ID":"811db32f-58b9-4a71-81ef-0c27b57adde4","Type":"ContainerStarted","Data":"f4f35254c5d29d343ccb61dfe6719e1b5fce9388411283b550c001201a7ecb99"}
Jul 29 17:53:14.262678 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.262645    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm" event={"ID":"811db32f-58b9-4a71-81ef-0c27b57adde4","Type":"ContainerStarted","Data":"9208d068eff652b8fb07c998aa8016a12b1fa56308d6559328fb4941cc2155c5"}
Jul 29 17:53:14.269631 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.269591    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-0.ec2.internal" podStartSLOduration=21.269578196 podStartE2EDuration="21.269578196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:52:57.23829199 +0000 UTC m=+5.586520085" watchObservedRunningTime="2026-07-29 17:53:14.269578196 +0000 UTC m=+22.617806289"
Jul 29 17:53:14.283862 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.283805    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-89dgp" podStartSLOduration=3.600171933 podStartE2EDuration="22.283783631s" totalImagesPullingTime="18.683611698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:14.282803038 +0000 UTC m=+22.631031132" watchObservedRunningTime="2026-07-29 17:53:14.283783631 +0000 UTC m=+22.632011726"
Jul 29 17:53:14.297508 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.297465    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vq6jk" podStartSLOduration=3.618316187 podStartE2EDuration="22.297441832s" totalImagesPullingTime="18.679125645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:14.297257492 +0000 UTC m=+22.645485587" watchObservedRunningTime="2026-07-29 17:53:14.297441832 +0000 UTC m=+22.645669922"
Jul 29 17:53:14.327694 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.327619    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sdq9g" podStartSLOduration=3.566132849 podStartE2EDuration="22.327603384s" totalImagesPullingTime="18.761470535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:14.327573486 +0000 UTC m=+22.675801579" watchObservedRunningTime="2026-07-29 17:53:14.327603384 +0000 UTC m=+22.675831473"
Jul 29 17:53:14.327854 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.327835    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t5k5f" podStartSLOduration=11.777903278 podStartE2EDuration="22.327827421s" totalImagesPullingTime="10.549924143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:14.310960312 +0000 UTC m=+22.659188405" watchObservedRunningTime="2026-07-29 17:53:14.327827421 +0000 UTC m=+22.676055514"
Jul 29 17:53:14.345267 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:14.345228    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mptzm" podStartSLOduration=3.664088282 podStartE2EDuration="22.345211609s" totalImagesPullingTime="18.681123327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:14.344788866 +0000 UTC m=+22.693016971" watchObservedRunningTime="2026-07-29 17:53:14.345211609 +0000 UTC m=+22.693439701"
Jul 29 17:53:15.268063 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:15.268027    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm" event={"ID":"811db32f-58b9-4a71-81ef-0c27b57adde4","Type":"ContainerStarted","Data":"edec485ed8b0548a35275e2e3a91ae81de1d01d4fa5a6acf89954bed842ef3da"}
Jul 29 17:53:15.268857 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:15.268121    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm" event={"ID":"811db32f-58b9-4a71-81ef-0c27b57adde4","Type":"ContainerStarted","Data":"3761125a6d197cef9ce6125c54ca96032fcee99a4b10162f4081ecd1d802ffde"}
Jul 29 17:53:15.268857 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:15.268169    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm" event={"ID":"811db32f-58b9-4a71-81ef-0c27b57adde4","Type":"ContainerStarted","Data":"3b3b0893ac5b1631e5c968c46c5b8856d86311bd2e8d2acf3dd134e86f92eb12"}
Jul 29 17:53:15.268857 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:15.268225    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm" event={"ID":"811db32f-58b9-4a71-81ef-0c27b57adde4","Type":"ContainerStarted","Data":"94bf06e60d626d1e56a3d918a9778856b364d24484c76c34cd979b560f268448"}
Jul 29 17:53:15.269695 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:15.269648    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-86qst" event={"ID":"bc505c99-3575-4017-ab6f-a1fa0b0b5fe4","Type":"ContainerStarted","Data":"e7b71d6a520bc85fa86b9877c46d35a6289ec0d7bc2b8338712af56d45551d75"}
Jul 29 17:53:15.301473 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:15.301399    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-86qst" podStartSLOduration=4.629824945 podStartE2EDuration="23.301377146s" totalImagesPullingTime="18.671552201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:15.299233356 +0000 UTC m=+23.647461451" watchObservedRunningTime="2026-07-29 17:53:15.301377146 +0000 UTC m=+23.649605240"
Jul 29 17:53:15.413285 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:15.413257    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 17:53:16.063790 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:16.063686    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T17:53:15.413278612Z","UUID":"f3eef571-4f06-4b6a-b22e-ed4d3dfdf2c8","Handler":null,"Name":"","Endpoint":""}
Jul 29 17:53:16.065298 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:16.065277    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 17:53:16.065412 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:16.065320    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 17:53:16.067469 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:16.067450    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:16.067469 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:16.067461    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:16.067661 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:16.067555    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:53:16.067702 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:16.067677    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:53:16.067758 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:16.067745    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:16.067840 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:16.067820    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:16.274391 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:16.274350    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh" event={"ID":"40d0d6f9-b2a3-4663-bdba-cf83fac067f5","Type":"ContainerStarted","Data":"069581b8babb366b24bbe2133b781316a40574a05cba58e63a1c4692271adc7c"}
Jul 29 17:53:17.278802 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:17.278767    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh" event={"ID":"40d0d6f9-b2a3-4663-bdba-cf83fac067f5","Type":"ContainerStarted","Data":"a615d51d875781c127032f719564f7b569fd692ad1a297ff03daa712122cc69d"}
Jul 29 17:53:17.282494 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:17.282456    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm" event={"ID":"811db32f-58b9-4a71-81ef-0c27b57adde4","Type":"ContainerStarted","Data":"a5c601d262b6bd54c43f54ee6cdaeecb83a3f52452b9d8f8cd690bd905450a77"}
Jul 29 17:53:17.297047 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:17.296976    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gw8jh" podStartSLOduration=4.460620343 podStartE2EDuration="25.296957959s" totalImagesPullingTime="20.836337616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:17.296541773 +0000 UTC m=+25.644769867" watchObservedRunningTime="2026-07-29 17:53:17.296957959 +0000 UTC m=+25.645186053"
Jul 29 17:53:18.067774 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:18.067737    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:18.067774 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:18.067756    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:18.068040 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:18.067867    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:53:18.068040 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:18.067938    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:53:18.068040 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:18.067967    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:18.068206 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:18.068081    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:18.342880 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:18.342541    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t5k5f"
Jul 29 17:53:18.343323 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:18.343298    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t5k5f"
Jul 29 17:53:19.290678 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:19.290581    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm" event={"ID":"811db32f-58b9-4a71-81ef-0c27b57adde4","Type":"ContainerStarted","Data":"c9968ce93ffcf106512425f704a0be6bb2c43135d5ffb160c4a3ac6eb317e0f3"}
Jul 29 17:53:19.290844 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:19.290819    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:53:19.290909 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:19.290895    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:53:19.290958 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:19.290943    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:53:19.292967 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:19.292939    2567 generic.go:356] "Generic (PLEG): container finished" podID="31a0018a-f046-4b33-a0e9-ae9cd4a7cec5" containerID="162f1f74b4c95827e28b1c736b2146a6ea1701f2039b019a6fb1f20d34b04a95" exitCode=0
Jul 29 17:53:19.293101 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:19.293035    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6cnvn" event={"ID":"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5","Type":"ContainerDied","Data":"162f1f74b4c95827e28b1c736b2146a6ea1701f2039b019a6fb1f20d34b04a95"}
Jul 29 17:53:19.293205 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:19.293190    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t5k5f"
Jul 29 17:53:19.293966 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:19.293817    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t5k5f"
Jul 29 17:53:19.306124 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:19.306103    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:53:19.306320 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:19.306304    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:53:19.327600 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:19.327556    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm" podStartSLOduration=8.571798283 podStartE2EDuration="27.327541471s" totalImagesPullingTime="18.755743188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:19.326872561 +0000 UTC m=+27.675100654" watchObservedRunningTime="2026-07-29 17:53:19.327541471 +0000 UTC m=+27.675769558"
Jul 29 17:53:20.070741 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:20.070714    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:20.071378 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:20.070840    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:20.071378 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:20.070843    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:20.071378 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:20.070876    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:20.071378 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:20.070974    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:53:20.071378 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:20.071097    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:53:21.098924 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:21.098681    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d8t56"]
Jul 29 17:53:21.099350 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:21.098957    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:21.099350 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:21.099099    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:21.101704 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:21.101678    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bdzwx"]
Jul 29 17:53:21.101839 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:21.101774    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:21.101895 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:21.101872    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:53:21.102450 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:21.102417    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pb4m5"]
Jul 29 17:53:21.102564 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:21.102506    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:21.102627 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:21.102593    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:53:21.299054 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:21.299016    2567 generic.go:356] "Generic (PLEG): container finished" podID="31a0018a-f046-4b33-a0e9-ae9cd4a7cec5" containerID="baa0580e1c0fc7e6942d996aaacfafe2b449178be26a833f335d4c5193d527cb" exitCode=0
Jul 29 17:53:21.299218 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:21.299099    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6cnvn" event={"ID":"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5","Type":"ContainerDied","Data":"baa0580e1c0fc7e6942d996aaacfafe2b449178be26a833f335d4c5193d527cb"}
Jul 29 17:53:23.067884 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:23.067850    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:23.068272 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:23.067891    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:23.068272 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:23.067891    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:23.068272 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:23.067956    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:23.068272 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:23.068068    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:53:23.068272 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:23.068142    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:53:23.308951 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:23.308921    2567 generic.go:356] "Generic (PLEG): container finished" podID="31a0018a-f046-4b33-a0e9-ae9cd4a7cec5" containerID="913ca107ebf480164716327edc494c6c9b92da7b7993bafe104494ea2eb22fc0" exitCode=0
Jul 29 17:53:23.309140 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:23.308972    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6cnvn" event={"ID":"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5","Type":"ContainerDied","Data":"913ca107ebf480164716327edc494c6c9b92da7b7993bafe104494ea2eb22fc0"}
Jul 29 17:53:25.067659 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:25.067621    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:25.068112 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:25.067672    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:25.068112 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:25.067728    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:25.068112 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:25.067746    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:25.068112 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:25.067847    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:53:25.068112 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:25.067957    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:53:25.766981 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:25.766900    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs\") pod \"network-metrics-daemon-pb4m5\" (UID: \"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e\") " pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:25.767159 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:25.767114    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:25.767224 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:25.767194    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs podName:40ccf825-6a2b-4d4d-82b8-a8edb3f2168e nodeName:}" failed. No retries permitted until 2026-07-29 17:53:57.767171912 +0000 UTC m=+66.115400001 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs") pod "network-metrics-daemon-pb4m5" (UID: "40ccf825-6a2b-4d4d-82b8-a8edb3f2168e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:25.867898 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:25.867840    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:25.867898 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:25.867898    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz7tq\" (UniqueName: \"kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq\") pod \"network-check-target-bdzwx\" (UID: \"d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab\") " pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:25.868156 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:25.868065    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:25.868156 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:25.868141    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret podName:71dd6af3-71f3-4859-af35-a7174b3b3fea nodeName:}" failed. No retries permitted until 2026-07-29 17:53:57.868121755 +0000 UTC m=+66.216349842 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret") pod "global-pull-secret-syncer-d8t56" (UID: "71dd6af3-71f3-4859-af35-a7174b3b3fea") : object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:25.868156 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:25.868070    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 17:53:25.868318 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:25.868173    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 17:53:25.868318 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:25.868184    2567 projected.go:196] Error preparing data for projected volume kube-api-access-sz7tq for pod openshift-network-diagnostics/network-check-target-bdzwx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:25.868318 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:25.868225    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq podName:d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab nodeName:}" failed. No retries permitted until 2026-07-29 17:53:57.868213881 +0000 UTC m=+66.216441952 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sz7tq" (UniqueName: "kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq") pod "network-check-target-bdzwx" (UID: "d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:27.068001 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.067781    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:27.068500 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.067783    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:27.068500 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.067844    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:27.068500 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:27.068135    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pb4m5" podUID="40ccf825-6a2b-4d4d-82b8-a8edb3f2168e"
Jul 29 17:53:27.068500 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:27.068242    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8t56" podUID="71dd6af3-71f3-4859-af35-a7174b3b3fea"
Jul 29 17:53:27.068500 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:27.068338    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdzwx" podUID="d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab"
Jul 29 17:53:27.510245 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.510223    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-0.ec2.internal" event="NodeReady"
Jul 29 17:53:27.510403 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.510391    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 17:53:27.553942 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.553910    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8498fb9bb4-rv2h9"]
Jul 29 17:53:27.555662 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.555641    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.559716 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.559694    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 17:53:27.559906 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.559887    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v4qcg\""
Jul 29 17:53:27.560231 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.560215    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 17:53:27.560442 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.560429    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 17:53:27.566225 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.566207    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 17:53:27.582759 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.582728    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8498fb9bb4-rv2h9"]
Jul 29 17:53:27.583282 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.583261    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-txj5d"]
Jul 29 17:53:27.585056 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.585036    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-txj5d"
Jul 29 17:53:27.587490 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.587469    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7pxgj"]
Jul 29 17:53:27.587663 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.587642    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 17:53:27.590706 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.588430    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 17:53:27.590706 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.588513    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 17:53:27.590706 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.589573    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mh5gc\""
Jul 29 17:53:27.591744 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.591727    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:27.594648 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.594627    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 17:53:27.594648 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.594639    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 17:53:27.594788 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.594651    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pzsbz\""
Jul 29 17:53:27.599620 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.599601    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-txj5d"]
Jul 29 17:53:27.611377 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.611319    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7pxgj"]
Jul 29 17:53:27.680811 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.680779    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1a02b69b-6318-4b41-a28d-1e942cd7e56b-installation-pull-secrets\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.680984 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.680832    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-certificates\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.680984 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.680878    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1a02b69b-6318-4b41-a28d-1e942cd7e56b-image-registry-private-configuration\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.680984 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.680906    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ebdbddd1-189b-45d4-83e8-86c08bd86158-config-volume\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:27.680984 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.680945    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-bound-sa-token\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.680984 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.680976    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebdbddd1-189b-45d4-83e8-86c08bd86158-tmp-dir\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:27.681186 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.681016    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npw8p\" (UniqueName: \"kubernetes.io/projected/ebdbddd1-189b-45d4-83e8-86c08bd86158-kube-api-access-npw8p\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:27.681186 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.681055    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1a02b69b-6318-4b41-a28d-1e942cd7e56b-ca-trust-extracted\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.681186 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.681081    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a02b69b-6318-4b41-a28d-1e942cd7e56b-trusted-ca\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.681186 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.681105    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5qgj\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-kube-api-access-v5qgj\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.681186 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.681124    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n5s2\" (UniqueName: \"kubernetes.io/projected/900f8d29-a89b-43bc-937b-d47b4a13fd3e-kube-api-access-7n5s2\") pod \"ingress-canary-txj5d\" (UID: \"900f8d29-a89b-43bc-937b-d47b4a13fd3e\") " pod="openshift-ingress-canary/ingress-canary-txj5d"
Jul 29 17:53:27.681186 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.681146    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.681186 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.681159    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:27.681394 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.681194    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/900f8d29-a89b-43bc-937b-d47b4a13fd3e-cert\") pod \"ingress-canary-txj5d\" (UID: \"900f8d29-a89b-43bc-937b-d47b4a13fd3e\") " pod="openshift-ingress-canary/ingress-canary-txj5d"
Jul 29 17:53:27.782112 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782052    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1a02b69b-6318-4b41-a28d-1e942cd7e56b-image-registry-private-configuration\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.782112 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782110    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ebdbddd1-189b-45d4-83e8-86c08bd86158-config-volume\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:27.782325 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782224    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-bound-sa-token\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.782325 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782262    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebdbddd1-189b-45d4-83e8-86c08bd86158-tmp-dir\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:27.782325 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782286    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npw8p\" (UniqueName: \"kubernetes.io/projected/ebdbddd1-189b-45d4-83e8-86c08bd86158-kube-api-access-npw8p\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:27.782454 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782411    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1a02b69b-6318-4b41-a28d-1e942cd7e56b-ca-trust-extracted\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.782454 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782447    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a02b69b-6318-4b41-a28d-1e942cd7e56b-trusted-ca\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.782558 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782474    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5qgj\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-kube-api-access-v5qgj\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.782558 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782491    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n5s2\" (UniqueName: \"kubernetes.io/projected/900f8d29-a89b-43bc-937b-d47b4a13fd3e-kube-api-access-7n5s2\") pod \"ingress-canary-txj5d\" (UID: \"900f8d29-a89b-43bc-937b-d47b4a13fd3e\") " pod="openshift-ingress-canary/ingress-canary-txj5d"
Jul 29 17:53:27.782558 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782518    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.782558 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782541    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:27.782747 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782575    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/900f8d29-a89b-43bc-937b-d47b4a13fd3e-cert\") pod \"ingress-canary-txj5d\" (UID: \"900f8d29-a89b-43bc-937b-d47b4a13fd3e\") " pod="openshift-ingress-canary/ingress-canary-txj5d"
Jul 29 17:53:27.782747 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782627    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebdbddd1-189b-45d4-83e8-86c08bd86158-tmp-dir\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:27.782747 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782639    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1a02b69b-6318-4b41-a28d-1e942cd7e56b-installation-pull-secrets\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.782747 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782729    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-certificates\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.782943 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782821    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ebdbddd1-189b-45d4-83e8-86c08bd86158-config-volume\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:27.782943 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.782822    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1a02b69b-6318-4b41-a28d-1e942cd7e56b-ca-trust-extracted\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.782943 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:27.782881    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 17:53:27.782943 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:27.782897    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8498fb9bb4-rv2h9: secret "image-registry-tls" not found
Jul 29 17:53:27.782943 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:27.782903    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 17:53:27.783205 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:27.782979    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls podName:ebdbddd1-189b-45d4-83e8-86c08bd86158 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:28.282956404 +0000 UTC m=+36.631184514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls") pod "dns-default-7pxgj" (UID: "ebdbddd1-189b-45d4-83e8-86c08bd86158") : secret "dns-default-metrics-tls" not found
Jul 29 17:53:27.783205 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:27.783042    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls podName:1a02b69b-6318-4b41-a28d-1e942cd7e56b nodeName:}" failed. No retries permitted until 2026-07-29 17:53:28.283020044 +0000 UTC m=+36.631248118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls") pod "image-registry-8498fb9bb4-rv2h9" (UID: "1a02b69b-6318-4b41-a28d-1e942cd7e56b") : secret "image-registry-tls" not found
Jul 29 17:53:27.783313 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.783292    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-certificates\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.783536 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.783512    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a02b69b-6318-4b41-a28d-1e942cd7e56b-trusted-ca\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.786647 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.786620    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/900f8d29-a89b-43bc-937b-d47b4a13fd3e-cert\") pod \"ingress-canary-txj5d\" (UID: \"900f8d29-a89b-43bc-937b-d47b4a13fd3e\") " pod="openshift-ingress-canary/ingress-canary-txj5d"
Jul 29 17:53:27.786647 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.786640    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1a02b69b-6318-4b41-a28d-1e942cd7e56b-image-registry-private-configuration\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.786787 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.786628    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1a02b69b-6318-4b41-a28d-1e942cd7e56b-installation-pull-secrets\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.790975 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.790950    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npw8p\" (UniqueName: \"kubernetes.io/projected/ebdbddd1-189b-45d4-83e8-86c08bd86158-kube-api-access-npw8p\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:27.792183 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.792160    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-bound-sa-token\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.792341 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.792323    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n5s2\" (UniqueName: \"kubernetes.io/projected/900f8d29-a89b-43bc-937b-d47b4a13fd3e-kube-api-access-7n5s2\") pod \"ingress-canary-txj5d\" (UID: \"900f8d29-a89b-43bc-937b-d47b4a13fd3e\") " pod="openshift-ingress-canary/ingress-canary-txj5d"
Jul 29 17:53:27.792446 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.792429    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5qgj\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-kube-api-access-v5qgj\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:27.897736 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:27.897646    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-txj5d"
Jul 29 17:53:28.026032 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:28.025979    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-txj5d"]
Jul 29 17:53:28.029793 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:53:28.029767    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod900f8d29_a89b_43bc_937b_d47b4a13fd3e.slice/crio-220162642cd278dde67ae7e0fcb6dbafe2ff477babb2c81b4b2c1c2e3a923908 WatchSource:0}: Error finding container 220162642cd278dde67ae7e0fcb6dbafe2ff477babb2c81b4b2c1c2e3a923908: Status 404 returned error can't find the container with id 220162642cd278dde67ae7e0fcb6dbafe2ff477babb2c81b4b2c1c2e3a923908
Jul 29 17:53:28.287398 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:28.287307    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:28.287398 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:28.287343    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:28.288109 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:28.287445    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 17:53:28.288109 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:28.287454    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 17:53:28.288109 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:28.287474    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8498fb9bb4-rv2h9: secret "image-registry-tls" not found
Jul 29 17:53:28.288109 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:28.287507    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls podName:ebdbddd1-189b-45d4-83e8-86c08bd86158 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:29.287491983 +0000 UTC m=+37.635720059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls") pod "dns-default-7pxgj" (UID: "ebdbddd1-189b-45d4-83e8-86c08bd86158") : secret "dns-default-metrics-tls" not found
Jul 29 17:53:28.288109 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:28.287522    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls podName:1a02b69b-6318-4b41-a28d-1e942cd7e56b nodeName:}" failed. No retries permitted until 2026-07-29 17:53:29.287516649 +0000 UTC m=+37.635744720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls") pod "image-registry-8498fb9bb4-rv2h9" (UID: "1a02b69b-6318-4b41-a28d-1e942cd7e56b") : secret "image-registry-tls" not found
Jul 29 17:53:28.324269 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:28.324239    2567 generic.go:356] "Generic (PLEG): container finished" podID="31a0018a-f046-4b33-a0e9-ae9cd4a7cec5" containerID="af95fc3d572001bcf7981510a11542c7f77e57c7f270df676ad3f7032f112e18" exitCode=0
Jul 29 17:53:28.324440 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:28.324297    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6cnvn" event={"ID":"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5","Type":"ContainerDied","Data":"af95fc3d572001bcf7981510a11542c7f77e57c7f270df676ad3f7032f112e18"}
Jul 29 17:53:28.325425 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:28.325405    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-txj5d" event={"ID":"900f8d29-a89b-43bc-937b-d47b4a13fd3e","Type":"ContainerStarted","Data":"220162642cd278dde67ae7e0fcb6dbafe2ff477babb2c81b4b2c1c2e3a923908"}
Jul 29 17:53:29.067418 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:29.067386    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:29.067620 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:29.067516    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:29.067620 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:29.067572    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:29.070713 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:29.070687    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 17:53:29.070857 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:29.070687    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 17:53:29.071832 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:29.071806    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 17:53:29.071832 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:29.071826    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fmgk6\""
Jul 29 17:53:29.072009 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:29.071811    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 17:53:29.072009 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:29.071861    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kkd97\""
Jul 29 17:53:29.306288 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:29.306252    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:29.306759 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:29.306304    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:29.306759 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:29.306399    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 17:53:29.306759 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:29.306417    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8498fb9bb4-rv2h9: secret "image-registry-tls" not found
Jul 29 17:53:29.306759 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:29.306465    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls podName:1a02b69b-6318-4b41-a28d-1e942cd7e56b nodeName:}" failed. No retries permitted until 2026-07-29 17:53:31.306451109 +0000 UTC m=+39.654679199 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls") pod "image-registry-8498fb9bb4-rv2h9" (UID: "1a02b69b-6318-4b41-a28d-1e942cd7e56b") : secret "image-registry-tls" not found
Jul 29 17:53:29.306759 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:29.306478    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 17:53:29.306759 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:29.306528    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls podName:ebdbddd1-189b-45d4-83e8-86c08bd86158 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:31.306513029 +0000 UTC m=+39.654741122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls") pod "dns-default-7pxgj" (UID: "ebdbddd1-189b-45d4-83e8-86c08bd86158") : secret "dns-default-metrics-tls" not found
Jul 29 17:53:29.332069 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:29.331969    2567 generic.go:356] "Generic (PLEG): container finished" podID="31a0018a-f046-4b33-a0e9-ae9cd4a7cec5" containerID="141ece4045a80916d7821d33216e6a4bce81289b2b3fa31d0bc3754bbed931ba" exitCode=0
Jul 29 17:53:29.332069 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:29.332047    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6cnvn" event={"ID":"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5","Type":"ContainerDied","Data":"141ece4045a80916d7821d33216e6a4bce81289b2b3fa31d0bc3754bbed931ba"}
Jul 29 17:53:30.337776 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:30.337745    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6cnvn" event={"ID":"31a0018a-f046-4b33-a0e9-ae9cd4a7cec5","Type":"ContainerStarted","Data":"be654dda75b69b305f69f9f28a3efa6147892e5c6c84a77e42962b0c71240076"}
Jul 29 17:53:30.367255 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:30.367213    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6cnvn" podStartSLOduration=8.630178854 podStartE2EDuration="38.36719289s" totalImagesPullingTime="29.737014036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:30.365865701 +0000 UTC m=+38.714093794" watchObservedRunningTime="2026-07-29 17:53:30.36719289 +0000 UTC m=+38.715420984"
Jul 29 17:53:31.321086 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:31.320882    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:31.321255 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:31.321093    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:31.321255 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:31.321063    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 17:53:31.321255 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:31.321163    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8498fb9bb4-rv2h9: secret "image-registry-tls" not found
Jul 29 17:53:31.321255 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:31.321181    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 17:53:31.321255 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:31.321218    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls podName:1a02b69b-6318-4b41-a28d-1e942cd7e56b nodeName:}" failed. No retries permitted until 2026-07-29 17:53:35.321203149 +0000 UTC m=+43.669431220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls") pod "image-registry-8498fb9bb4-rv2h9" (UID: "1a02b69b-6318-4b41-a28d-1e942cd7e56b") : secret "image-registry-tls" not found
Jul 29 17:53:31.321255 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:31.321234    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls podName:ebdbddd1-189b-45d4-83e8-86c08bd86158 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:35.321226197 +0000 UTC m=+43.669454268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls") pod "dns-default-7pxgj" (UID: "ebdbddd1-189b-45d4-83e8-86c08bd86158") : secret "dns-default-metrics-tls" not found
Jul 29 17:53:31.341641 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:31.341612    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-txj5d" event={"ID":"900f8d29-a89b-43bc-937b-d47b4a13fd3e","Type":"ContainerStarted","Data":"ff4af93753445b5dc1d0a120169f0d6054375eab04322af0797d4f3036f02789"}
Jul 29 17:53:31.358780 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:31.358732    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-txj5d" podStartSLOduration=2.050715311 podStartE2EDuration="4.358716388s" totalImagesPullingTime="2.308001077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:31.357899906 +0000 UTC m=+39.706127999" watchObservedRunningTime="2026-07-29 17:53:31.358716388 +0000 UTC m=+39.706944481"
Jul 29 17:53:35.350208 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:35.350175    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:35.350208 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:35.350208    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:35.350647 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:35.350328    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 17:53:35.350647 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:35.350348    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8498fb9bb4-rv2h9: secret "image-registry-tls" not found
Jul 29 17:53:35.350647 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:35.350393    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls podName:1a02b69b-6318-4b41-a28d-1e942cd7e56b nodeName:}" failed. No retries permitted until 2026-07-29 17:53:43.350379917 +0000 UTC m=+51.698607988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls") pod "image-registry-8498fb9bb4-rv2h9" (UID: "1a02b69b-6318-4b41-a28d-1e942cd7e56b") : secret "image-registry-tls" not found
Jul 29 17:53:35.350647 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:35.350332    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 17:53:35.350647 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:35.350454    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls podName:ebdbddd1-189b-45d4-83e8-86c08bd86158 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:43.350443497 +0000 UTC m=+51.698671568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls") pod "dns-default-7pxgj" (UID: "ebdbddd1-189b-45d4-83e8-86c08bd86158") : secret "dns-default-metrics-tls" not found
Jul 29 17:53:43.410271 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:43.410229    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:43.410271 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:43.410271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:43.410829 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:43.410370    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 17:53:43.410829 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:43.410395    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 17:53:43.410829 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:43.410418    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8498fb9bb4-rv2h9: secret "image-registry-tls" not found
Jul 29 17:53:43.410829 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:43.410431    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls podName:ebdbddd1-189b-45d4-83e8-86c08bd86158 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:59.410417793 +0000 UTC m=+67.758645864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls") pod "dns-default-7pxgj" (UID: "ebdbddd1-189b-45d4-83e8-86c08bd86158") : secret "dns-default-metrics-tls" not found
Jul 29 17:53:43.410829 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:43.410477    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls podName:1a02b69b-6318-4b41-a28d-1e942cd7e56b nodeName:}" failed. No retries permitted until 2026-07-29 17:53:59.410458381 +0000 UTC m=+67.758686453 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls") pod "image-registry-8498fb9bb4-rv2h9" (UID: "1a02b69b-6318-4b41-a28d-1e942cd7e56b") : secret "image-registry-tls" not found
Jul 29 17:53:50.407304 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.407270    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm"]
Jul 29 17:53:50.409159 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.409144    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm"
Jul 29 17:53:50.412599 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.412575    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"]
Jul 29 17:53:50.413913 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.413894    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 29 17:53:50.414041 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.413932    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 29 17:53:50.414673 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.414654    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"
Jul 29 17:53:50.414761 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.414740    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 29 17:53:50.415286 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.415265    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nwkdm\""
Jul 29 17:53:50.415391 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.415309    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 29 17:53:50.418186 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.418171    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 29 17:53:50.418433 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.418418    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 29 17:53:50.418484 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.418448    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 29 17:53:50.419167 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.419154    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jsd8c\""
Jul 29 17:53:50.425715 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.425694    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm"]
Jul 29 17:53:50.430483 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.430463    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"]
Jul 29 17:53:50.460476 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.460445    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6587876a-1047-45f4-bc60-d7b9efa4ff29-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm\" (UID: \"6587876a-1047-45f4-bc60-d7b9efa4ff29\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm"
Jul 29 17:53:50.460634 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.460507    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnfn6\" (UniqueName: \"kubernetes.io/projected/e947e93d-98b4-4b2f-9626-e4ded066e91d-kube-api-access-jnfn6\") pod \"cluster-samples-operator-6748489656-2g95t\" (UID: \"e947e93d-98b4-4b2f-9626-e4ded066e91d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"
Jul 29 17:53:50.460634 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.460533    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6587876a-1047-45f4-bc60-d7b9efa4ff29-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm\" (UID: \"6587876a-1047-45f4-bc60-d7b9efa4ff29\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm"
Jul 29 17:53:50.460634 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.460569    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2g95t\" (UID: \"e947e93d-98b4-4b2f-9626-e4ded066e91d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"
Jul 29 17:53:50.460634 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.460593    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkd57\" (UniqueName: \"kubernetes.io/projected/6587876a-1047-45f4-bc60-d7b9efa4ff29-kube-api-access-vkd57\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm\" (UID: \"6587876a-1047-45f4-bc60-d7b9efa4ff29\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm"
Jul 29 17:53:50.543048 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.543011    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-546cd49bb7-sv6m9"]
Jul 29 17:53:50.545172 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.545154    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx"]
Jul 29 17:53:50.545300 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.545283    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:50.546986 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.546969    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx"
Jul 29 17:53:50.549845 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.549816    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hgsgv\""
Jul 29 17:53:50.550118 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.550094    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 29 17:53:50.550220 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.550102    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 29 17:53:50.550220 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.550150    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nvxt4\""
Jul 29 17:53:50.550220 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.550175    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 29 17:53:50.550220 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.550122    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 29 17:53:50.550698 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.550456    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 17:53:50.550698 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.550485    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 29 17:53:50.550698 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.550548    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 29 17:53:50.550884 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.550726    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 17:53:50.550983 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.550969    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 29 17:53:50.551073 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.550985    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 29 17:53:50.561758 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.561732    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2g95t\" (UID: \"e947e93d-98b4-4b2f-9626-e4ded066e91d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"
Jul 29 17:53:50.561855 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.561767    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkd57\" (UniqueName: \"kubernetes.io/projected/6587876a-1047-45f4-bc60-d7b9efa4ff29-kube-api-access-vkd57\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm\" (UID: \"6587876a-1047-45f4-bc60-d7b9efa4ff29\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm"
Jul 29 17:53:50.561855 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.561785    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6587876a-1047-45f4-bc60-d7b9efa4ff29-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm\" (UID: \"6587876a-1047-45f4-bc60-d7b9efa4ff29\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm"
Jul 29 17:53:50.561926 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:50.561884    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 17:53:50.561959 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.561908    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6587876a-1047-45f4-bc60-d7b9efa4ff29-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm\" (UID: \"6587876a-1047-45f4-bc60-d7b9efa4ff29\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm"
Jul 29 17:53:50.561959 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:50.561938    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls podName:e947e93d-98b4-4b2f-9626-e4ded066e91d nodeName:}" failed. No retries permitted until 2026-07-29 17:53:51.06192281 +0000 UTC m=+59.410150881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls") pod "cluster-samples-operator-6748489656-2g95t" (UID: "e947e93d-98b4-4b2f-9626-e4ded066e91d") : secret "samples-operator-tls" not found
Jul 29 17:53:50.562061 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.561986    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-stats-auth\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:50.562061 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.562044    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnfn6\" (UniqueName: \"kubernetes.io/projected/e947e93d-98b4-4b2f-9626-e4ded066e91d-kube-api-access-jnfn6\") pod \"cluster-samples-operator-6748489656-2g95t\" (UID: \"e947e93d-98b4-4b2f-9626-e4ded066e91d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"
Jul 29 17:53:50.562137 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.562093    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:50.562178 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.562137    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51ddc013-8a44-4e97-b81e-c38bea41403c-config\") pod \"service-ca-operator-5d6c75f84f-8ttjx\" (UID: \"51ddc013-8a44-4e97-b81e-c38bea41403c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx"
Jul 29 17:53:50.562221 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.562176    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-default-certificate\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:50.562221 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.562205    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51ddc013-8a44-4e97-b81e-c38bea41403c-serving-cert\") pod \"service-ca-operator-5d6c75f84f-8ttjx\" (UID: \"51ddc013-8a44-4e97-b81e-c38bea41403c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx"
Jul 29 17:53:50.562298 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.562233    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:50.562298 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.562261    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9d6c\" (UniqueName: \"kubernetes.io/projected/51ddc013-8a44-4e97-b81e-c38bea41403c-kube-api-access-c9d6c\") pod \"service-ca-operator-5d6c75f84f-8ttjx\" (UID: \"51ddc013-8a44-4e97-b81e-c38bea41403c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx"
Jul 29 17:53:50.562298 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.562280    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvwgg\" (UniqueName: \"kubernetes.io/projected/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-kube-api-access-gvwgg\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:50.562410 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.562280    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6587876a-1047-45f4-bc60-d7b9efa4ff29-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm\" (UID: \"6587876a-1047-45f4-bc60-d7b9efa4ff29\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm"
Jul 29 17:53:50.564913 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.564880    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx"]
Jul 29 17:53:50.565598 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.565579    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-546cd49bb7-sv6m9"]
Jul 29 17:53:50.566255 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.566234    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6587876a-1047-45f4-bc60-d7b9efa4ff29-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm\" (UID: \"6587876a-1047-45f4-bc60-d7b9efa4ff29\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm"
Jul 29 17:53:50.577317 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.577288    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnfn6\" (UniqueName: \"kubernetes.io/projected/e947e93d-98b4-4b2f-9626-e4ded066e91d-kube-api-access-jnfn6\") pod \"cluster-samples-operator-6748489656-2g95t\" (UID: \"e947e93d-98b4-4b2f-9626-e4ded066e91d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"
Jul 29 17:53:50.577908 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.577893    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkd57\" (UniqueName: \"kubernetes.io/projected/6587876a-1047-45f4-bc60-d7b9efa4ff29-kube-api-access-vkd57\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm\" (UID: \"6587876a-1047-45f4-bc60-d7b9efa4ff29\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm"
Jul 29 17:53:50.663421 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.663326    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-stats-auth\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:50.663421 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.663376    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:50.663421 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.663402    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51ddc013-8a44-4e97-b81e-c38bea41403c-config\") pod \"service-ca-operator-5d6c75f84f-8ttjx\" (UID: \"51ddc013-8a44-4e97-b81e-c38bea41403c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx"
Jul 29 17:53:50.663421 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.663426    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-default-certificate\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:50.663739 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.663443    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51ddc013-8a44-4e97-b81e-c38bea41403c-serving-cert\") pod \"service-ca-operator-5d6c75f84f-8ttjx\" (UID: \"51ddc013-8a44-4e97-b81e-c38bea41403c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx"
Jul 29 17:53:50.663739 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.663460    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:50.663739 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.663482    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9d6c\" (UniqueName: \"kubernetes.io/projected/51ddc013-8a44-4e97-b81e-c38bea41403c-kube-api-access-c9d6c\") pod \"service-ca-operator-5d6c75f84f-8ttjx\" (UID: \"51ddc013-8a44-4e97-b81e-c38bea41403c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx"
Jul 29 17:53:50.663739 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.663507    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvwgg\" (UniqueName: \"kubernetes.io/projected/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-kube-api-access-gvwgg\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:50.663739 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:50.663606    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 17:53:50.663739 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:50.663651    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle podName:8ac97ee1-977a-4117-a1c0-2c3212ca50cf nodeName:}" failed. No retries permitted until 2026-07-29 17:53:51.163628689 +0000 UTC m=+59.511856774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle") pod "router-default-546cd49bb7-sv6m9" (UID: "8ac97ee1-977a-4117-a1c0-2c3212ca50cf") : configmap references non-existent config key: service-ca.crt
Jul 29 17:53:50.663739 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:50.663681    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs podName:8ac97ee1-977a-4117-a1c0-2c3212ca50cf nodeName:}" failed. No retries permitted until 2026-07-29 17:53:51.163669983 +0000 UTC m=+59.511898061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs") pod "router-default-546cd49bb7-sv6m9" (UID: "8ac97ee1-977a-4117-a1c0-2c3212ca50cf") : secret "router-metrics-certs-default" not found
Jul 29 17:53:50.664145 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.664120    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/51ddc013-8a44-4e97-b81e-c38bea41403c-config\") pod \"service-ca-operator-5d6c75f84f-8ttjx\" (UID: \"51ddc013-8a44-4e97-b81e-c38bea41403c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx"
Jul 29 17:53:50.665822 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.665796    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/51ddc013-8a44-4e97-b81e-c38bea41403c-serving-cert\") pod \"service-ca-operator-5d6c75f84f-8ttjx\" (UID: \"51ddc013-8a44-4e97-b81e-c38bea41403c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx"
Jul 29 17:53:50.665929 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.665901    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-default-certificate\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:50.666039 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.666024    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-stats-auth\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:50.675166 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.675140    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9d6c\" (UniqueName: \"kubernetes.io/projected/51ddc013-8a44-4e97-b81e-c38bea41403c-kube-api-access-c9d6c\") pod \"service-ca-operator-5d6c75f84f-8ttjx\" (UID: \"51ddc013-8a44-4e97-b81e-c38bea41403c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx"
Jul 29 17:53:50.675365 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.675348    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvwgg\" (UniqueName: \"kubernetes.io/projected/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-kube-api-access-gvwgg\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:50.719885 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.719840    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm"
Jul 29 17:53:50.840785 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.840749    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm"]
Jul 29 17:53:50.844665 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:53:50.844640    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6587876a_1047_45f4_bc60_d7b9efa4ff29.slice/crio-3d6ca0a06413ffac0511ce2e2fb543f6a4f5f0574b32bfbd560729262f7773d0 WatchSource:0}: Error finding container 3d6ca0a06413ffac0511ce2e2fb543f6a4f5f0574b32bfbd560729262f7773d0: Status 404 returned error can't find the container with id 3d6ca0a06413ffac0511ce2e2fb543f6a4f5f0574b32bfbd560729262f7773d0
Jul 29 17:53:50.859801 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.859772    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx"
Jul 29 17:53:50.980640 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:50.980569    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx"]
Jul 29 17:53:50.983118 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:53:50.983094    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ddc013_8a44_4e97_b81e_c38bea41403c.slice/crio-3d26bd08c257a2a3b7c8cb8ff2fecc4d4fb15b23e3ca34ebb2b7d0c4fbe20ff4 WatchSource:0}: Error finding container 3d26bd08c257a2a3b7c8cb8ff2fecc4d4fb15b23e3ca34ebb2b7d0c4fbe20ff4: Status 404 returned error can't find the container with id 3d26bd08c257a2a3b7c8cb8ff2fecc4d4fb15b23e3ca34ebb2b7d0c4fbe20ff4
Jul 29 17:53:51.066946 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:51.066903    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2g95t\" (UID: \"e947e93d-98b4-4b2f-9626-e4ded066e91d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"
Jul 29 17:53:51.067142 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:51.067071    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 17:53:51.067182 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:51.067142    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls podName:e947e93d-98b4-4b2f-9626-e4ded066e91d nodeName:}" failed. No retries permitted until 2026-07-29 17:53:52.06712439 +0000 UTC m=+60.415352461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls") pod "cluster-samples-operator-6748489656-2g95t" (UID: "e947e93d-98b4-4b2f-9626-e4ded066e91d") : secret "samples-operator-tls" not found
Jul 29 17:53:51.167982 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:51.167943    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:51.168171 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:51.168025    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:51.168171 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:51.168125    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle podName:8ac97ee1-977a-4117-a1c0-2c3212ca50cf nodeName:}" failed. No retries permitted until 2026-07-29 17:53:52.168107426 +0000 UTC m=+60.516335500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle") pod "router-default-546cd49bb7-sv6m9" (UID: "8ac97ee1-977a-4117-a1c0-2c3212ca50cf") : configmap references non-existent config key: service-ca.crt
Jul 29 17:53:51.168171 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:51.168134    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 17:53:51.168281 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:51.168194    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs podName:8ac97ee1-977a-4117-a1c0-2c3212ca50cf nodeName:}" failed. No retries permitted until 2026-07-29 17:53:52.168179387 +0000 UTC m=+60.516407458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs") pod "router-default-546cd49bb7-sv6m9" (UID: "8ac97ee1-977a-4117-a1c0-2c3212ca50cf") : secret "router-metrics-certs-default" not found
Jul 29 17:53:51.309734 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:51.309703    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-64wqm"
Jul 29 17:53:51.388640 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:51.388597    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx" event={"ID":"51ddc013-8a44-4e97-b81e-c38bea41403c","Type":"ContainerStarted","Data":"3d26bd08c257a2a3b7c8cb8ff2fecc4d4fb15b23e3ca34ebb2b7d0c4fbe20ff4"}
Jul 29 17:53:51.389591 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:51.389560    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm" event={"ID":"6587876a-1047-45f4-bc60-d7b9efa4ff29","Type":"ContainerStarted","Data":"3d6ca0a06413ffac0511ce2e2fb543f6a4f5f0574b32bfbd560729262f7773d0"}
Jul 29 17:53:52.077009 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:52.076959    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2g95t\" (UID: \"e947e93d-98b4-4b2f-9626-e4ded066e91d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"
Jul 29 17:53:52.077447 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:52.077109    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 17:53:52.077447 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:52.077193    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls podName:e947e93d-98b4-4b2f-9626-e4ded066e91d nodeName:}" failed. No retries permitted until 2026-07-29 17:53:54.077171386 +0000 UTC m=+62.425399463 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls") pod "cluster-samples-operator-6748489656-2g95t" (UID: "e947e93d-98b4-4b2f-9626-e4ded066e91d") : secret "samples-operator-tls" not found
Jul 29 17:53:52.177459 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:52.177417    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:52.177672 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:52.177508    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:52.177672 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:52.177627    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle podName:8ac97ee1-977a-4117-a1c0-2c3212ca50cf nodeName:}" failed. No retries permitted until 2026-07-29 17:53:54.177605348 +0000 UTC m=+62.525833441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle") pod "router-default-546cd49bb7-sv6m9" (UID: "8ac97ee1-977a-4117-a1c0-2c3212ca50cf") : configmap references non-existent config key: service-ca.crt
Jul 29 17:53:52.177672 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:52.177661    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 17:53:52.177826 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:52.177706    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs podName:8ac97ee1-977a-4117-a1c0-2c3212ca50cf nodeName:}" failed. No retries permitted until 2026-07-29 17:53:54.177694415 +0000 UTC m=+62.525922495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs") pod "router-default-546cd49bb7-sv6m9" (UID: "8ac97ee1-977a-4117-a1c0-2c3212ca50cf") : secret "router-metrics-certs-default" not found
Jul 29 17:53:54.094488 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:54.094449    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2g95t\" (UID: \"e947e93d-98b4-4b2f-9626-e4ded066e91d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"
Jul 29 17:53:54.095105 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:54.094598    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 17:53:54.095105 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:54.094664    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls podName:e947e93d-98b4-4b2f-9626-e4ded066e91d nodeName:}" failed. No retries permitted until 2026-07-29 17:53:58.09464678 +0000 UTC m=+66.442874851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls") pod "cluster-samples-operator-6748489656-2g95t" (UID: "e947e93d-98b4-4b2f-9626-e4ded066e91d") : secret "samples-operator-tls" not found
Jul 29 17:53:54.195816 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:54.195776    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:54.196033 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:54.195846    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:54.196033 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:54.195948    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle podName:8ac97ee1-977a-4117-a1c0-2c3212ca50cf nodeName:}" failed. No retries permitted until 2026-07-29 17:53:58.19592866 +0000 UTC m=+66.544156754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle") pod "router-default-546cd49bb7-sv6m9" (UID: "8ac97ee1-977a-4117-a1c0-2c3212ca50cf") : configmap references non-existent config key: service-ca.crt
Jul 29 17:53:54.196152 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:54.196035    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 17:53:54.196152 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:54.196099    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs podName:8ac97ee1-977a-4117-a1c0-2c3212ca50cf nodeName:}" failed. No retries permitted until 2026-07-29 17:53:58.196080197 +0000 UTC m=+66.544308268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs") pod "router-default-546cd49bb7-sv6m9" (UID: "8ac97ee1-977a-4117-a1c0-2c3212ca50cf") : secret "router-metrics-certs-default" not found
Jul 29 17:53:54.399404 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:54.399310    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx" event={"ID":"51ddc013-8a44-4e97-b81e-c38bea41403c","Type":"ContainerStarted","Data":"7c48f0f4131ef77465e61df276635116a0b45666eedc9b6762b8074c8f47a355"}
Jul 29 17:53:54.400827 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:54.400796    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm" event={"ID":"6587876a-1047-45f4-bc60-d7b9efa4ff29","Type":"ContainerStarted","Data":"3cec610f994c3e8da8dabec88b3d5b8b276d2371f6d19b03a213bf62387c25c4"}
Jul 29 17:53:54.416627 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:54.416574    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx" podStartSLOduration=1.9601722499999998 podStartE2EDuration="4.416557018s" totalImagesPullingTime="2.456384768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:54.415881093 +0000 UTC m=+62.764109187" watchObservedRunningTime="2026-07-29 17:53:54.416557018 +0000 UTC m=+62.764785112"
Jul 29 17:53:54.432251 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:54.432199    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm" podStartSLOduration=1.8341531290000002 podStartE2EDuration="4.432181671s" totalImagesPullingTime="2.598028542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:54.430950022 +0000 UTC m=+62.779178125" watchObservedRunningTime="2026-07-29 17:53:54.432181671 +0000 UTC m=+62.780409764"
Jul 29 17:53:56.139134 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.139097    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xh4qt"]
Jul 29 17:53:56.141434 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.141417    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.144200 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.144171    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 17:53:56.144448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.144431    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 17:53:56.145430 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.145413    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qzmlr\""
Jul 29 17:53:56.145539 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.145466    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 17:53:56.145863 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.145765    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 17:53:56.160061 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.160033    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xh4qt"]
Jul 29 17:53:56.211079 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.211043    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.211248 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.211087    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db09b9f3-5469-4a8d-bb5c-3bda4626814a-crio-socket\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.211248 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.211181    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46rvj\" (UniqueName: \"kubernetes.io/projected/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-api-access-46rvj\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.211248 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.211233    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db09b9f3-5469-4a8d-bb5c-3bda4626814a-data-volume\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.211357 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.211273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.312286 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.312249    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.312506 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.312303    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db09b9f3-5469-4a8d-bb5c-3bda4626814a-crio-socket\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.312506 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.312355    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46rvj\" (UniqueName: \"kubernetes.io/projected/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-api-access-46rvj\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.312506 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:56.312394    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:56.312506 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.312461    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db09b9f3-5469-4a8d-bb5c-3bda4626814a-crio-socket\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.312506 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.312396    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db09b9f3-5469-4a8d-bb5c-3bda4626814a-data-volume\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.312506 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:56.312492    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls podName:db09b9f3-5469-4a8d-bb5c-3bda4626814a nodeName:}" failed. No retries permitted until 2026-07-29 17:53:56.812470629 +0000 UTC m=+65.160698700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xh4qt" (UID: "db09b9f3-5469-4a8d-bb5c-3bda4626814a") : secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:56.312701 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.312557    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.312701 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:56.312679    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 17:53:56.312761 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:56.312742    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm podName:db09b9f3-5469-4a8d-bb5c-3bda4626814a nodeName:}" failed. No retries permitted until 2026-07-29 17:53:56.81273004 +0000 UTC m=+65.160958115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xh4qt" (UID: "db09b9f3-5469-4a8d-bb5c-3bda4626814a") : configmap "kube-rbac-proxy" not found
Jul 29 17:53:56.312761 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.312681    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db09b9f3-5469-4a8d-bb5c-3bda4626814a-data-volume\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.321364 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.321336    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46rvj\" (UniqueName: \"kubernetes.io/projected/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-api-access-46rvj\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.816196 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.816143    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.816399 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:56.816263    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:56.816399 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:56.816284    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 17:53:56.816399 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:56.816355    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm podName:db09b9f3-5469-4a8d-bb5c-3bda4626814a nodeName:}" failed. No retries permitted until 2026-07-29 17:53:57.816334468 +0000 UTC m=+66.164562550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xh4qt" (UID: "db09b9f3-5469-4a8d-bb5c-3bda4626814a") : configmap "kube-rbac-proxy" not found
Jul 29 17:53:56.816574 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:56.816426    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:56.816574 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:56.816496    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls podName:db09b9f3-5469-4a8d-bb5c-3bda4626814a nodeName:}" failed. No retries permitted until 2026-07-29 17:53:57.816477091 +0000 UTC m=+66.164705183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xh4qt" (UID: "db09b9f3-5469-4a8d-bb5c-3bda4626814a") : secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:57.402239 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.402200    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-qr48c"]
Jul 29 17:53:57.404309 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.404293    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-qr48c"
Jul 29 17:53:57.406967 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.406943    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rrcdd\""
Jul 29 17:53:57.407120 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.406943    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 29 17:53:57.408060 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.408041    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 29 17:53:57.408060 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.408055    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 29 17:53:57.408219 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.408101    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 29 17:53:57.416121 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.416097    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-qr48c"]
Jul 29 17:53:57.522685 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.522643    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/752534a3-38bc-40e2-a648-01631425e0f6-signing-cabundle\") pod \"service-ca-658d7b7c78-qr48c\" (UID: \"752534a3-38bc-40e2-a648-01631425e0f6\") " pod="openshift-service-ca/service-ca-658d7b7c78-qr48c"
Jul 29 17:53:57.522891 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.522705    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/752534a3-38bc-40e2-a648-01631425e0f6-signing-key\") pod \"service-ca-658d7b7c78-qr48c\" (UID: \"752534a3-38bc-40e2-a648-01631425e0f6\") " pod="openshift-service-ca/service-ca-658d7b7c78-qr48c"
Jul 29 17:53:57.522891 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.522813    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zszn9\" (UniqueName: \"kubernetes.io/projected/752534a3-38bc-40e2-a648-01631425e0f6-kube-api-access-zszn9\") pod \"service-ca-658d7b7c78-qr48c\" (UID: \"752534a3-38bc-40e2-a648-01631425e0f6\") " pod="openshift-service-ca/service-ca-658d7b7c78-qr48c"
Jul 29 17:53:57.623914 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.623873    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zszn9\" (UniqueName: \"kubernetes.io/projected/752534a3-38bc-40e2-a648-01631425e0f6-kube-api-access-zszn9\") pod \"service-ca-658d7b7c78-qr48c\" (UID: \"752534a3-38bc-40e2-a648-01631425e0f6\") " pod="openshift-service-ca/service-ca-658d7b7c78-qr48c"
Jul 29 17:53:57.624135 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.624010    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/752534a3-38bc-40e2-a648-01631425e0f6-signing-cabundle\") pod \"service-ca-658d7b7c78-qr48c\" (UID: \"752534a3-38bc-40e2-a648-01631425e0f6\") " pod="openshift-service-ca/service-ca-658d7b7c78-qr48c"
Jul 29 17:53:57.624135 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.624056    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/752534a3-38bc-40e2-a648-01631425e0f6-signing-key\") pod \"service-ca-658d7b7c78-qr48c\" (UID: \"752534a3-38bc-40e2-a648-01631425e0f6\") " pod="openshift-service-ca/service-ca-658d7b7c78-qr48c"
Jul 29 17:53:57.624640 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.624620    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/752534a3-38bc-40e2-a648-01631425e0f6-signing-cabundle\") pod \"service-ca-658d7b7c78-qr48c\" (UID: \"752534a3-38bc-40e2-a648-01631425e0f6\") " pod="openshift-service-ca/service-ca-658d7b7c78-qr48c"
Jul 29 17:53:57.626468 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.626450    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/752534a3-38bc-40e2-a648-01631425e0f6-signing-key\") pod \"service-ca-658d7b7c78-qr48c\" (UID: \"752534a3-38bc-40e2-a648-01631425e0f6\") " pod="openshift-service-ca/service-ca-658d7b7c78-qr48c"
Jul 29 17:53:57.631882 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.631857    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zszn9\" (UniqueName: \"kubernetes.io/projected/752534a3-38bc-40e2-a648-01631425e0f6-kube-api-access-zszn9\") pod \"service-ca-658d7b7c78-qr48c\" (UID: \"752534a3-38bc-40e2-a648-01631425e0f6\") " pod="openshift-service-ca/service-ca-658d7b7c78-qr48c"
Jul 29 17:53:57.713873 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.713785    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-qr48c"
Jul 29 17:53:57.825893 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.825862    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:57.826081 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:57.826062    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:57.826133 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.826088    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:57.826133 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:57.826129    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls podName:db09b9f3-5469-4a8d-bb5c-3bda4626814a nodeName:}" failed. No retries permitted until 2026-07-29 17:53:59.826111844 +0000 UTC m=+68.174339914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xh4qt" (UID: "db09b9f3-5469-4a8d-bb5c-3bda4626814a") : secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:57.826215 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:57.826179    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 17:53:57.826215 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.826188    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs\") pod \"network-metrics-daemon-pb4m5\" (UID: \"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e\") " pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:53:57.826294 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:57.826245    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm podName:db09b9f3-5469-4a8d-bb5c-3bda4626814a nodeName:}" failed. No retries permitted until 2026-07-29 17:53:59.826214974 +0000 UTC m=+68.174443045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xh4qt" (UID: "db09b9f3-5469-4a8d-bb5c-3bda4626814a") : configmap "kube-rbac-proxy" not found
Jul 29 17:53:57.828824 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.828805    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 17:53:57.833862 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.833843    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-qr48c"]
Jul 29 17:53:57.836253 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:53:57.836233    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod752534a3_38bc_40e2_a648_01631425e0f6.slice/crio-ffc23b9bed39dbb5e9689491419024dba2742edc4267c8d48591744f9c87fe25 WatchSource:0}: Error finding container ffc23b9bed39dbb5e9689491419024dba2742edc4267c8d48591744f9c87fe25: Status 404 returned error can't find the container with id ffc23b9bed39dbb5e9689491419024dba2742edc4267c8d48591744f9c87fe25
Jul 29 17:53:57.836954 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:57.836940    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 17:53:57.837021 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:57.837008    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs podName:40ccf825-6a2b-4d4d-82b8-a8edb3f2168e nodeName:}" failed. No retries permitted until 2026-07-29 17:55:01.836976068 +0000 UTC m=+130.185204139 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs") pod "network-metrics-daemon-pb4m5" (UID: "40ccf825-6a2b-4d4d-82b8-a8edb3f2168e") : secret "metrics-daemon-secret" not found
Jul 29 17:53:57.927058 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.927026    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:57.927275 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.927249    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz7tq\" (UniqueName: \"kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq\") pod \"network-check-target-bdzwx\" (UID: \"d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab\") " pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:57.929885 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.929863    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 17:53:57.930010 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.929870    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 17:53:57.940271 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.940247    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71dd6af3-71f3-4859-af35-a7174b3b3fea-original-pull-secret\") pod \"global-pull-secret-syncer-d8t56\" (UID: \"71dd6af3-71f3-4859-af35-a7174b3b3fea\") " pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:57.940629 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.940614    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 17:53:57.951045 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:57.951025    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz7tq\" (UniqueName: \"kubernetes.io/projected/d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab-kube-api-access-sz7tq\") pod \"network-check-target-bdzwx\" (UID: \"d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab\") " pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:58.129414 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:58.129377    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2g95t\" (UID: \"e947e93d-98b4-4b2f-9626-e4ded066e91d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"
Jul 29 17:53:58.129593 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:58.129539    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 17:53:58.129636 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:58.129605    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls podName:e947e93d-98b4-4b2f-9626-e4ded066e91d nodeName:}" failed. No retries permitted until 2026-07-29 17:54:06.129589747 +0000 UTC m=+74.477817819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls") pod "cluster-samples-operator-6748489656-2g95t" (UID: "e947e93d-98b4-4b2f-9626-e4ded066e91d") : secret "samples-operator-tls" not found
Jul 29 17:53:58.178142 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:58.178106    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8t56"
Jul 29 17:53:58.194400 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:58.194374    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fmgk6\""
Jul 29 17:53:58.202025 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:58.201971    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:53:58.230486 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:58.230327    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:58.230486 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:58.230437    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:53:58.230688 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:58.230577    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 17:53:58.230688 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:58.230651    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle podName:8ac97ee1-977a-4117-a1c0-2c3212ca50cf nodeName:}" failed. No retries permitted until 2026-07-29 17:54:06.23062956 +0000 UTC m=+74.578857637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle") pod "router-default-546cd49bb7-sv6m9" (UID: "8ac97ee1-977a-4117-a1c0-2c3212ca50cf") : configmap references non-existent config key: service-ca.crt
Jul 29 17:53:58.230688 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:58.230670    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs podName:8ac97ee1-977a-4117-a1c0-2c3212ca50cf nodeName:}" failed. No retries permitted until 2026-07-29 17:54:06.230661634 +0000 UTC m=+74.578889705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs") pod "router-default-546cd49bb7-sv6m9" (UID: "8ac97ee1-977a-4117-a1c0-2c3212ca50cf") : secret "router-metrics-certs-default" not found
Jul 29 17:53:58.313496 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:58.313459    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d8t56"]
Jul 29 17:53:58.316944 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:53:58.316883    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71dd6af3_71f3_4859_af35_a7174b3b3fea.slice/crio-8488f8c78fffb3f9017b456908766581566b78310c7f17ecc4d76c9aeb177eab WatchSource:0}: Error finding container 8488f8c78fffb3f9017b456908766581566b78310c7f17ecc4d76c9aeb177eab: Status 404 returned error can't find the container with id 8488f8c78fffb3f9017b456908766581566b78310c7f17ecc4d76c9aeb177eab
Jul 29 17:53:58.341226 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:58.341204    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bdzwx"]
Jul 29 17:53:58.343473 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:53:58.343448    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3a2582f_3c06_4bca_a55b_c4e8a5bd62ab.slice/crio-02f56cad10ecc0cb5cbc7fab386cb55b3cbfd0669e229d385ab2200495daaf14 WatchSource:0}: Error finding container 02f56cad10ecc0cb5cbc7fab386cb55b3cbfd0669e229d385ab2200495daaf14: Status 404 returned error can't find the container with id 02f56cad10ecc0cb5cbc7fab386cb55b3cbfd0669e229d385ab2200495daaf14
Jul 29 17:53:58.412765 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:58.412671    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-qr48c" event={"ID":"752534a3-38bc-40e2-a648-01631425e0f6","Type":"ContainerStarted","Data":"f2d27fe42558aec451132151436e991d2b3cc00c8d4304ff2404518c9f04a3f0"}
Jul 29 17:53:58.412765 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:58.412731    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-qr48c" event={"ID":"752534a3-38bc-40e2-a648-01631425e0f6","Type":"ContainerStarted","Data":"ffc23b9bed39dbb5e9689491419024dba2742edc4267c8d48591744f9c87fe25"}
Jul 29 17:53:58.413833 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:58.413808    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d8t56" event={"ID":"71dd6af3-71f3-4859-af35-a7174b3b3fea","Type":"ContainerStarted","Data":"8488f8c78fffb3f9017b456908766581566b78310c7f17ecc4d76c9aeb177eab"}
Jul 29 17:53:58.414900 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:58.414877    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bdzwx" event={"ID":"d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab","Type":"ContainerStarted","Data":"02f56cad10ecc0cb5cbc7fab386cb55b3cbfd0669e229d385ab2200495daaf14"}
Jul 29 17:53:58.433418 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:58.433373    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-qr48c" podStartSLOduration=1.4333595670000001 podStartE2EDuration="1.433359567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:58.432655529 +0000 UTC m=+66.780883621" watchObservedRunningTime="2026-07-29 17:53:58.433359567 +0000 UTC m=+66.781587661"
Jul 29 17:53:58.533676 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:58.533645    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-89dgp_252bf4d1-9eab-471e-bb97-cdf6a537d8c6/dns-node-resolver/0.log"
Jul 29 17:53:59.443724 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:59.443664    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:53:59.444215 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:59.443768    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:53:59.444215 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:59.443922    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 17:53:59.444215 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:59.443983    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls podName:ebdbddd1-189b-45d4-83e8-86c08bd86158 nodeName:}" failed. No retries permitted until 2026-07-29 17:54:31.443964244 +0000 UTC m=+99.792192538 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls") pod "dns-default-7pxgj" (UID: "ebdbddd1-189b-45d4-83e8-86c08bd86158") : secret "dns-default-metrics-tls" not found
Jul 29 17:53:59.444215 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:59.444098    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 17:53:59.444215 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:59.444113    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8498fb9bb4-rv2h9: secret "image-registry-tls" not found
Jul 29 17:53:59.444215 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:59.444154    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls podName:1a02b69b-6318-4b41-a28d-1e942cd7e56b nodeName:}" failed. No retries permitted until 2026-07-29 17:54:31.444142595 +0000 UTC m=+99.792370683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls") pod "image-registry-8498fb9bb4-rv2h9" (UID: "1a02b69b-6318-4b41-a28d-1e942cd7e56b") : secret "image-registry-tls" not found
Jul 29 17:53:59.739078 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:59.739053    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vq6jk_6941e167-23bc-45b8-bf79-2c038f30311e/node-ca/0.log"
Jul 29 17:53:59.848745 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:59.848698    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:59.848930 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:53:59.848799    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:53:59.849257 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:59.849020    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:59.849257 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:59.849085    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls podName:db09b9f3-5469-4a8d-bb5c-3bda4626814a nodeName:}" failed. No retries permitted until 2026-07-29 17:54:03.849066859 +0000 UTC m=+72.197294934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xh4qt" (UID: "db09b9f3-5469-4a8d-bb5c-3bda4626814a") : secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:59.849257 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:59.849108    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 17:53:59.849257 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:53:59.849219    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm podName:db09b9f3-5469-4a8d-bb5c-3bda4626814a nodeName:}" failed. No retries permitted until 2026-07-29 17:54:03.849187429 +0000 UTC m=+72.197415502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xh4qt" (UID: "db09b9f3-5469-4a8d-bb5c-3bda4626814a") : configmap "kube-rbac-proxy" not found
Jul 29 17:54:00.338327 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:00.338293    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-txj5d_900f8d29-a89b-43bc-937b-d47b4a13fd3e/serve-healthcheck-canary/0.log"
Jul 29 17:54:00.935710 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:00.935679    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm_6587876a-1047-45f4-bc60-d7b9efa4ff29/kube-storage-version-migrator-operator/0.log"
Jul 29 17:54:03.887848 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:03.887740    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:54:03.887848 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:03.887811    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:54:03.888351 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:54:03.887895    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 17:54:03.888351 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:54:03.887900    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 17:54:03.888351 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:54:03.887946    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls podName:db09b9f3-5469-4a8d-bb5c-3bda4626814a nodeName:}" failed. No retries permitted until 2026-07-29 17:54:11.887932582 +0000 UTC m=+80.236160653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xh4qt" (UID: "db09b9f3-5469-4a8d-bb5c-3bda4626814a") : secret "insights-runtime-extractor-tls" not found
Jul 29 17:54:03.888351 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:54:03.887969    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm podName:db09b9f3-5469-4a8d-bb5c-3bda4626814a nodeName:}" failed. No retries permitted until 2026-07-29 17:54:11.887951431 +0000 UTC m=+80.236179516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xh4qt" (UID: "db09b9f3-5469-4a8d-bb5c-3bda4626814a") : configmap "kube-rbac-proxy" not found
Jul 29 17:54:04.436010 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:04.435946    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d8t56" event={"ID":"71dd6af3-71f3-4859-af35-a7174b3b3fea","Type":"ContainerStarted","Data":"4c3df5caaf21cc7edf037768d2b6e5beb31f21c496f07aa3e356c8c5d37a47b9"}
Jul 29 17:54:04.437340 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:04.437316    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bdzwx" event={"ID":"d3a2582f-3c06-4bca-a55b-c4e8a5bd62ab","Type":"ContainerStarted","Data":"c7fe2958b59130f5fe10d59a4267737389351a03846e067122655194ea9d442d"}
Jul 29 17:54:04.437482 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:04.437463    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:54:04.458827 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:04.458772    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d8t56" podStartSLOduration=67.283949825 podStartE2EDuration="1m12.458754329s" totalImagesPullingTime="5.174804504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:04.457592518 +0000 UTC m=+72.805820612" watchObservedRunningTime="2026-07-29 17:54:04.458754329 +0000 UTC m=+72.806982421"
Jul 29 17:54:04.476187 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:04.476140    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bdzwx" podStartSLOduration=67.333997671 podStartE2EDuration="1m12.476127091s" totalImagesPullingTime="5.14212942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:04.475435919 +0000 UTC m=+72.823664011" watchObservedRunningTime="2026-07-29 17:54:04.476127091 +0000 UTC m=+72.824355180"
Jul 29 17:54:06.207843 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:06.207804    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2g95t\" (UID: \"e947e93d-98b4-4b2f-9626-e4ded066e91d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"
Jul 29 17:54:06.210357 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:06.210331    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e947e93d-98b4-4b2f-9626-e4ded066e91d-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2g95t\" (UID: \"e947e93d-98b4-4b2f-9626-e4ded066e91d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"
Jul 29 17:54:06.308216 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:06.308182    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:54:06.308425 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:06.308243    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:54:06.308812 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:06.308791    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-service-ca-bundle\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:54:06.310558 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:06.310540    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ac97ee1-977a-4117-a1c0-2c3212ca50cf-metrics-certs\") pod \"router-default-546cd49bb7-sv6m9\" (UID: \"8ac97ee1-977a-4117-a1c0-2c3212ca50cf\") " pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:54:06.326927 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:06.326899    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jsd8c\""
Jul 29 17:54:06.335294 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:06.335277    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"
Jul 29 17:54:06.458174 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:06.458105    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nvxt4\""
Jul 29 17:54:06.462165 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:06.462137    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t"]
Jul 29 17:54:06.466403 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:06.466377    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:54:06.594618 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:06.594594    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-546cd49bb7-sv6m9"]
Jul 29 17:54:06.596196 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:54:06.596167    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac97ee1_977a_4117_a1c0_2c3212ca50cf.slice/crio-21cdfed0c9c70bd6495febc95b11934e254bd6dd85ed3c20fa9a8cd1cd0b4442 WatchSource:0}: Error finding container 21cdfed0c9c70bd6495febc95b11934e254bd6dd85ed3c20fa9a8cd1cd0b4442: Status 404 returned error can't find the container with id 21cdfed0c9c70bd6495febc95b11934e254bd6dd85ed3c20fa9a8cd1cd0b4442
Jul 29 17:54:07.448244 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:07.448203    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-546cd49bb7-sv6m9" event={"ID":"8ac97ee1-977a-4117-a1c0-2c3212ca50cf","Type":"ContainerStarted","Data":"de8b47520cfb68248d9b8b0c02c5057fcd64671d0f228b0ad0162e60353e4308"}
Jul 29 17:54:07.448693 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:07.448263    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-546cd49bb7-sv6m9" event={"ID":"8ac97ee1-977a-4117-a1c0-2c3212ca50cf","Type":"ContainerStarted","Data":"21cdfed0c9c70bd6495febc95b11934e254bd6dd85ed3c20fa9a8cd1cd0b4442"}
Jul 29 17:54:07.449452 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:07.449428    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t" event={"ID":"e947e93d-98b4-4b2f-9626-e4ded066e91d","Type":"ContainerStarted","Data":"a7ed2a5ee04ac10381bc0de46f0a135d0191460c0a387536a41087b4b4aac58e"}
Jul 29 17:54:07.467135 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:07.467110    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:54:07.469979 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:07.469932    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-546cd49bb7-sv6m9" podStartSLOduration=17.469919346 podStartE2EDuration="17.469919346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:07.469678803 +0000 UTC m=+75.817906895" watchObservedRunningTime="2026-07-29 17:54:07.469919346 +0000 UTC m=+75.818147433"
Jul 29 17:54:07.470115 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:07.470050    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:54:08.453509 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:08.453474    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:54:08.454830 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:08.454811    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-546cd49bb7-sv6m9"
Jul 29 17:54:09.458341 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:09.458296    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t" event={"ID":"e947e93d-98b4-4b2f-9626-e4ded066e91d","Type":"ContainerStarted","Data":"dd46b746afcca58d70704a16f86b1ea310d99c72beb973d04d4dd99721054d7e"}
Jul 29 17:54:09.458748 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:09.458360    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t" event={"ID":"e947e93d-98b4-4b2f-9626-e4ded066e91d","Type":"ContainerStarted","Data":"a04dd95b3ea669f539990ef8fed76abe558a3ffa6bf0cc0ee91dfe77ef57c613"}
Jul 29 17:54:09.478213 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:09.478157    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2g95t" podStartSLOduration=17.575880828 podStartE2EDuration="19.478140214s" totalImagesPullingTime="1.902259386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:09.477312226 +0000 UTC m=+77.825540321" watchObservedRunningTime="2026-07-29 17:54:09.478140214 +0000 UTC m=+77.826368307"
Jul 29 17:54:11.958317 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:11.958261    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:54:11.958708 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:11.958342    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:54:11.958818 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:11.958800    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db09b9f3-5469-4a8d-bb5c-3bda4626814a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:54:11.960524 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:11.960506    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db09b9f3-5469-4a8d-bb5c-3bda4626814a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xh4qt\" (UID: \"db09b9f3-5469-4a8d-bb5c-3bda4626814a\") " pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:54:12.053352 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:12.053318    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xh4qt"
Jul 29 17:54:12.180806 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:12.180782    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xh4qt"]
Jul 29 17:54:12.183030 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:54:12.183002    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb09b9f3_5469_4a8d_bb5c_3bda4626814a.slice/crio-febb3a899197d17d486887a543962a65af7fc2c6901388e5a952df4f514caeb9 WatchSource:0}: Error finding container febb3a899197d17d486887a543962a65af7fc2c6901388e5a952df4f514caeb9: Status 404 returned error can't find the container with id febb3a899197d17d486887a543962a65af7fc2c6901388e5a952df4f514caeb9
Jul 29 17:54:12.468202 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:12.468163    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xh4qt" event={"ID":"db09b9f3-5469-4a8d-bb5c-3bda4626814a","Type":"ContainerStarted","Data":"febb3a899197d17d486887a543962a65af7fc2c6901388e5a952df4f514caeb9"}
Jul 29 17:54:16.189057 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.189015    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"]
Jul 29 17:54:16.218185 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.218145    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-fk6v8"]
Jul 29 17:54:16.218361 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.218220    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.221494 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.221449    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 17:54:16.221717 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.221513    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 17:54:16.221717 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.221524    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 29 17:54:16.221717 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.221513    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 29 17:54:16.221899 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.221878    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 29 17:54:16.221964 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.221905    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 17:54:16.222625 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.222609    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 29 17:54:16.224750 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.224731    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"]
Jul 29 17:54:16.224884 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.224834    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fk6v8"
Jul 29 17:54:16.226037 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.225956    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-fk6v8"]
Jul 29 17:54:16.227711 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.227694    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 29 17:54:16.227830 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.227811    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zg9xb\""
Jul 29 17:54:16.228145 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.228127    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 29 17:54:16.294237 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.294206    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-hub\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.294430 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.294246    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41a7adcc-e20d-4257-a0f2-cc618e8be006-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-fk6v8\" (UID: \"41a7adcc-e20d-4257-a0f2-cc618e8be006\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fk6v8"
Jul 29 17:54:16.294430 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.294282    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg482\" (UniqueName: \"kubernetes.io/projected/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-kube-api-access-qg482\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.294430 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.294328    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-ca\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.294430 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.294419    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41a7adcc-e20d-4257-a0f2-cc618e8be006-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fk6v8\" (UID: \"41a7adcc-e20d-4257-a0f2-cc618e8be006\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fk6v8"
Jul 29 17:54:16.294646 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.294473    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.294646 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.294548    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.294646 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.294571    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.395982 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.395948    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-hub\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.396178 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.396013    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41a7adcc-e20d-4257-a0f2-cc618e8be006-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-fk6v8\" (UID: \"41a7adcc-e20d-4257-a0f2-cc618e8be006\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fk6v8"
Jul 29 17:54:16.396178 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.396042    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg482\" (UniqueName: \"kubernetes.io/projected/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-kube-api-access-qg482\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.396178 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.396075    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-ca\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.396178 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.396133    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41a7adcc-e20d-4257-a0f2-cc618e8be006-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fk6v8\" (UID: \"41a7adcc-e20d-4257-a0f2-cc618e8be006\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fk6v8"
Jul 29 17:54:16.396381 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.396248    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.396434 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.396385    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.396484 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.396442    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.397081 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.397035    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41a7adcc-e20d-4257-a0f2-cc618e8be006-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-fk6v8\" (UID: \"41a7adcc-e20d-4257-a0f2-cc618e8be006\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fk6v8"
Jul 29 17:54:16.397321 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.397278    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.399178 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.399133    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-ca\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.399277 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.399241    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-hub\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.399688 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.399667    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.399688 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.399677    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41a7adcc-e20d-4257-a0f2-cc618e8be006-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fk6v8\" (UID: \"41a7adcc-e20d-4257-a0f2-cc618e8be006\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fk6v8"
Jul 29 17:54:16.400165 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.400144    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.407757 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.407731    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg482\" (UniqueName: \"kubernetes.io/projected/44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706-kube-api-access-qg482\") pod \"cluster-proxy-proxy-agent-6b77ff4df8-6pq8w\" (UID: \"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.539071 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.539036    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"
Jul 29 17:54:16.545346 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:16.545326    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fk6v8"
Jul 29 17:54:17.143364 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:17.143270    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w"]
Jul 29 17:54:17.147230 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:54:17.147204    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44ea2b97_9f3f_4bd2_b6bf_9738e0c1d706.slice/crio-b9f2d92a5b4cffd25563921e7d7a4aeea8f2e3b07359ffb61883b60744aca333 WatchSource:0}: Error finding container b9f2d92a5b4cffd25563921e7d7a4aeea8f2e3b07359ffb61883b60744aca333: Status 404 returned error can't find the container with id b9f2d92a5b4cffd25563921e7d7a4aeea8f2e3b07359ffb61883b60744aca333
Jul 29 17:54:17.159540 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:17.159465    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-fk6v8"]
Jul 29 17:54:17.162507 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:54:17.162484    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a7adcc_e20d_4257_a0f2_cc618e8be006.slice/crio-4cdf2db35f11f47c2e00b8fb23e6ef648efb94560ae389205f4c0fd066a5b352 WatchSource:0}: Error finding container 4cdf2db35f11f47c2e00b8fb23e6ef648efb94560ae389205f4c0fd066a5b352: Status 404 returned error can't find the container with id 4cdf2db35f11f47c2e00b8fb23e6ef648efb94560ae389205f4c0fd066a5b352
Jul 29 17:54:17.486242 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:17.486214    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fk6v8" event={"ID":"41a7adcc-e20d-4257-a0f2-cc618e8be006","Type":"ContainerStarted","Data":"4cdf2db35f11f47c2e00b8fb23e6ef648efb94560ae389205f4c0fd066a5b352"}
Jul 29 17:54:17.487297 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:17.487276    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w" event={"ID":"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706","Type":"ContainerStarted","Data":"b9f2d92a5b4cffd25563921e7d7a4aeea8f2e3b07359ffb61883b60744aca333"}
Jul 29 17:54:17.488632 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:17.488612    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xh4qt" event={"ID":"db09b9f3-5469-4a8d-bb5c-3bda4626814a","Type":"ContainerStarted","Data":"efa8e062aa8a4aec52d72c202be176c9ca90af1b3f2a70c299862731a7ca408e"}
Jul 29 17:54:19.499711 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:19.499672    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fk6v8" event={"ID":"41a7adcc-e20d-4257-a0f2-cc618e8be006","Type":"ContainerStarted","Data":"e8c3a1fa3f2baabd2fd4d8dcfba7dc6379caf50a16050aef85bbfea8ce1c3539"}
Jul 29 17:54:19.516745 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:19.516672    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fk6v8" podStartSLOduration=1.8285839259999999 podStartE2EDuration="3.516614878s" totalImagesPullingTime="1.688030952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:19.515209796 +0000 UTC m=+87.863437891" watchObservedRunningTime="2026-07-29 17:54:19.516614878 +0000 UTC m=+87.864842989"
Jul 29 17:54:23.516373 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:23.516332    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w" event={"ID":"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706","Type":"ContainerStarted","Data":"c876cefbc1beda89273369ffc4a660eb7f2adeae752403a1aebf3fb56b960b0a"}
Jul 29 17:54:23.516803 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:23.516394    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w" event={"ID":"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706","Type":"ContainerStarted","Data":"6343bd14fd7a9a519faad2467d3666bebe20bf493bcb877d58346de60aea2e1c"}
Jul 29 17:54:23.516803 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:23.516410    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w" event={"ID":"44ea2b97-9f3f-4bd2-b6bf-9738e0c1d706","Type":"ContainerStarted","Data":"e8b69039b5246479dded1d7e872428acd5282f7d814a1f10deab96936b8b0e6d"}
Jul 29 17:54:23.518088 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:23.518064    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xh4qt" event={"ID":"db09b9f3-5469-4a8d-bb5c-3bda4626814a","Type":"ContainerStarted","Data":"e399a8278ca886dead3cfa44c784f52a4e274d450d5a7457a522c7691af82d56"}
Jul 29 17:54:23.539212 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:23.539160    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b77ff4df8-6pq8w" podStartSLOduration=1.813370371 podStartE2EDuration="7.539144509s" totalImagesPullingTime="5.725774138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:23.53726675 +0000 UTC m=+91.885494844" watchObservedRunningTime="2026-07-29 17:54:23.539144509 +0000 UTC m=+91.887372601"
Jul 29 17:54:27.534171 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:27.534131    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xh4qt" event={"ID":"db09b9f3-5469-4a8d-bb5c-3bda4626814a","Type":"ContainerStarted","Data":"e89055a1cd4545667d04b9dced73ae57f4ac5d10c6be3255ab786ab70f1223ce"}
Jul 29 17:54:27.553938 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:27.553889    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xh4qt" podStartSLOduration=17.214060603 podStartE2EDuration="31.553873834s" totalImagesPullingTime="14.339813231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:53:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:27.553647303 +0000 UTC m=+95.901875395" watchObservedRunningTime="2026-07-29 17:54:27.553873834 +0000 UTC m=+95.902101926"
Jul 29 17:54:28.272228 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.272194    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gqntt"]
Jul 29 17:54:28.275697 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.275679    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.278689 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.278669    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 17:54:28.279061 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.279042    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 17:54:28.280154 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.280013    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 17:54:28.280154 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.280022    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gr9c5\""
Jul 29 17:54:28.280154 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.280115    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 17:54:28.280469 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.280452    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 17:54:28.280616 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.280534    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 17:54:28.409050 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.409002    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2dc72d7-66c3-446f-8feb-9f2a437443c0-metrics-client-ca\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.409254 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.409077    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2dc72d7-66c3-446f-8feb-9f2a437443c0-root\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.409254 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.409108    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-textfile\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.409254 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.409138    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-wtmp\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.409254 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.409207    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.409466 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.409253    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.409466 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.409291    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-tls\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.409466 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.409342    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2dc72d7-66c3-446f-8feb-9f2a437443c0-sys\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.409466 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.409384    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49k7j\" (UniqueName: \"kubernetes.io/projected/f2dc72d7-66c3-446f-8feb-9f2a437443c0-kube-api-access-49k7j\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.510605 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.510559    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2dc72d7-66c3-446f-8feb-9f2a437443c0-sys\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.510605 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.510603    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49k7j\" (UniqueName: \"kubernetes.io/projected/f2dc72d7-66c3-446f-8feb-9f2a437443c0-kube-api-access-49k7j\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.510857 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.510624    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2dc72d7-66c3-446f-8feb-9f2a437443c0-metrics-client-ca\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.510857 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.510698    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2dc72d7-66c3-446f-8feb-9f2a437443c0-sys\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.510857 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.510789    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2dc72d7-66c3-446f-8feb-9f2a437443c0-root\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.510857 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.510831    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-textfile\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.511122 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.510867    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-wtmp\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.511122 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.510903    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2dc72d7-66c3-446f-8feb-9f2a437443c0-root\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.511122 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.510909    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.511122 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.510970    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.511122 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.511048    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-tls\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.511122 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.511106    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-wtmp\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.511417 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:54:28.511165    2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 17:54:28.511417 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.511227    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-textfile\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.511417 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:54:28.511234    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-tls podName:f2dc72d7-66c3-446f-8feb-9f2a437443c0 nodeName:}" failed. No retries permitted until 2026-07-29 17:54:29.011216006 +0000 UTC m=+97.359444090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-tls") pod "node-exporter-gqntt" (UID: "f2dc72d7-66c3-446f-8feb-9f2a437443c0") : secret "node-exporter-tls" not found
Jul 29 17:54:28.511417 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.511291    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2dc72d7-66c3-446f-8feb-9f2a437443c0-metrics-client-ca\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.511622 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.511606    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.513373 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.513347    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:28.519515 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:28.519484    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49k7j\" (UniqueName: \"kubernetes.io/projected/f2dc72d7-66c3-446f-8feb-9f2a437443c0-kube-api-access-49k7j\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:29.016530 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:29.016497    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-tls\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:29.018807 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:29.018777    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2dc72d7-66c3-446f-8feb-9f2a437443c0-node-exporter-tls\") pod \"node-exporter-gqntt\" (UID: \"f2dc72d7-66c3-446f-8feb-9f2a437443c0\") " pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:29.187205 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:29.187168    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gqntt"
Jul 29 17:54:29.201073 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:54:29.201042    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2dc72d7_66c3_446f_8feb_9f2a437443c0.slice/crio-5c911b4edc057bf8e6e7711fd7f224d92f64ae8fcb12fb31355412262176916f WatchSource:0}: Error finding container 5c911b4edc057bf8e6e7711fd7f224d92f64ae8fcb12fb31355412262176916f: Status 404 returned error can't find the container with id 5c911b4edc057bf8e6e7711fd7f224d92f64ae8fcb12fb31355412262176916f
Jul 29 17:54:29.541794 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:29.541757    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gqntt" event={"ID":"f2dc72d7-66c3-446f-8feb-9f2a437443c0","Type":"ContainerStarted","Data":"5c911b4edc057bf8e6e7711fd7f224d92f64ae8fcb12fb31355412262176916f"}
Jul 29 17:54:30.546119 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:30.546080    2567 generic.go:356] "Generic (PLEG): container finished" podID="f2dc72d7-66c3-446f-8feb-9f2a437443c0" containerID="95df9376bbdd21441e3271d5495cacabec4a245e981fab213dbe7c966e1a185a" exitCode=0
Jul 29 17:54:30.546502 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:30.546145    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gqntt" event={"ID":"f2dc72d7-66c3-446f-8feb-9f2a437443c0","Type":"ContainerDied","Data":"95df9376bbdd21441e3271d5495cacabec4a245e981fab213dbe7c966e1a185a"}
Jul 29 17:54:31.543599 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:31.543556    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:54:31.543788 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:31.543640    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:54:31.546043 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:31.546019    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ebdbddd1-189b-45d4-83e8-86c08bd86158-metrics-tls\") pod \"dns-default-7pxgj\" (UID: \"ebdbddd1-189b-45d4-83e8-86c08bd86158\") " pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:54:31.546195 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:31.546176    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls\") pod \"image-registry-8498fb9bb4-rv2h9\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") " pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:54:31.552105 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:31.552071    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gqntt" event={"ID":"f2dc72d7-66c3-446f-8feb-9f2a437443c0","Type":"ContainerStarted","Data":"80e4d819a07c89ddc818c24586cd1e20592ef459b0d43c0964936bffa756f9a0"}
Jul 29 17:54:31.552230 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:31.552161    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gqntt" event={"ID":"f2dc72d7-66c3-446f-8feb-9f2a437443c0","Type":"ContainerStarted","Data":"d689b987e6ef5491e16008591ff4af9083c9a74480a9373dab0690788ffddfca"}
Jul 29 17:54:31.572399 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:31.572342    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gqntt" podStartSLOduration=2.520932644 podStartE2EDuration="3.572326244s" totalImagesPullingTime="988.455882ms" totalInitContainerRuntime="62.937718ms" isStatefulPod=true podCreationTimestamp="2026-07-29 17:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:31.570227304 +0000 UTC m=+99.918455398" watchObservedRunningTime="2026-07-29 17:54:31.572326244 +0000 UTC m=+99.920554337"
Jul 29 17:54:31.769843 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:31.769808    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v4qcg\""
Jul 29 17:54:31.776902 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:31.776882    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:54:31.804932 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:31.804854    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pzsbz\""
Jul 29 17:54:31.813069 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:31.813044    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:54:31.923451 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:31.923416    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8498fb9bb4-rv2h9"]
Jul 29 17:54:31.926314 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:54:31.926281    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a02b69b_6318_4b41_a28d_1e942cd7e56b.slice/crio-fd40e698e5324cf8d9ad39a7884ecd42ec971c1faabbf2bff18abb166a09c8e7 WatchSource:0}: Error finding container fd40e698e5324cf8d9ad39a7884ecd42ec971c1faabbf2bff18abb166a09c8e7: Status 404 returned error can't find the container with id fd40e698e5324cf8d9ad39a7884ecd42ec971c1faabbf2bff18abb166a09c8e7
Jul 29 17:54:31.953541 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:31.953461    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7pxgj"]
Jul 29 17:54:31.959025 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:54:31.958975    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebdbddd1_189b_45d4_83e8_86c08bd86158.slice/crio-d41d0d8024ceba3cb9592c5ea92c86d30f980bcca0d8e3f964d064dbde9981eb WatchSource:0}: Error finding container d41d0d8024ceba3cb9592c5ea92c86d30f980bcca0d8e3f964d064dbde9981eb: Status 404 returned error can't find the container with id d41d0d8024ceba3cb9592c5ea92c86d30f980bcca0d8e3f964d064dbde9981eb
Jul 29 17:54:32.557355 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:32.557313    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7pxgj" event={"ID":"ebdbddd1-189b-45d4-83e8-86c08bd86158","Type":"ContainerStarted","Data":"d41d0d8024ceba3cb9592c5ea92c86d30f980bcca0d8e3f964d064dbde9981eb"}
Jul 29 17:54:32.558966 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:32.558935    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9" event={"ID":"1a02b69b-6318-4b41-a28d-1e942cd7e56b","Type":"ContainerStarted","Data":"1d94ea958d947e4ce60832c3faee3898235ba21943fefb7bd0d8305f088ca24d"}
Jul 29 17:54:32.559128 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:32.559016    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9" event={"ID":"1a02b69b-6318-4b41-a28d-1e942cd7e56b","Type":"ContainerStarted","Data":"fd40e698e5324cf8d9ad39a7884ecd42ec971c1faabbf2bff18abb166a09c8e7"}
Jul 29 17:54:32.559331 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:32.559287    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:54:32.582289 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:32.582231    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9" podStartSLOduration=100.582209987 podStartE2EDuration="1m40.582209987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:52:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:32.580531658 +0000 UTC m=+100.928759752" watchObservedRunningTime="2026-07-29 17:54:32.582209987 +0000 UTC m=+100.930438079"
Jul 29 17:54:34.567730 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:34.567691    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7pxgj" event={"ID":"ebdbddd1-189b-45d4-83e8-86c08bd86158","Type":"ContainerStarted","Data":"313fbf25b8bcdeee8d7123a97f5b98839ffa22cdaad419fb7e3d13c9d9d677a5"}
Jul 29 17:54:34.568155 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:34.567758    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7pxgj" event={"ID":"ebdbddd1-189b-45d4-83e8-86c08bd86158","Type":"ContainerStarted","Data":"68ecc08fa73d7433e26ec6ea5e17f2da0cbcfa951fb32611dbd4b2a3948fdd8a"}
Jul 29 17:54:34.568155 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:34.567815    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:54:34.587423 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:34.587371    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7pxgj" podStartSLOduration=65.92406967 podStartE2EDuration="1m7.587355934s" totalImagesPullingTime="1.663286264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:34.586284583 +0000 UTC m=+102.934512676" watchObservedRunningTime="2026-07-29 17:54:34.587355934 +0000 UTC m=+102.935584084"
Jul 29 17:54:35.442967 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:35.442936    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bdzwx"
Jul 29 17:54:39.152050 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:39.152013    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8498fb9bb4-rv2h9"]
Jul 29 17:54:44.576642 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:44.576607    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7pxgj"
Jul 29 17:54:49.158577 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:54:49.158551    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:55:01.890832 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:01.890790    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs\") pod \"network-metrics-daemon-pb4m5\" (UID: \"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e\") " pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:55:01.893093 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:01.893076    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/40ccf825-6a2b-4d4d-82b8-a8edb3f2168e-metrics-certs\") pod \"network-metrics-daemon-pb4m5\" (UID: \"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e\") " pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:55:02.087488 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:02.087459    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kkd97\""
Jul 29 17:55:02.096024 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:02.096001    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pb4m5"
Jul 29 17:55:02.261033 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:02.260937    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pb4m5"]
Jul 29 17:55:02.263717 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:55:02.263689    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ccf825_6a2b_4d4d_82b8_a8edb3f2168e.slice/crio-a1c177b1882762bf7d659a1b93a39e1580d286ce5d6a86ebdc0c4b4123467117 WatchSource:0}: Error finding container a1c177b1882762bf7d659a1b93a39e1580d286ce5d6a86ebdc0c4b4123467117: Status 404 returned error can't find the container with id a1c177b1882762bf7d659a1b93a39e1580d286ce5d6a86ebdc0c4b4123467117
Jul 29 17:55:02.668386 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:02.668345    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pb4m5" event={"ID":"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e","Type":"ContainerStarted","Data":"a1c177b1882762bf7d659a1b93a39e1580d286ce5d6a86ebdc0c4b4123467117"}
Jul 29 17:55:03.674120 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:03.674025    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pb4m5" event={"ID":"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e","Type":"ContainerStarted","Data":"347114c389c7a1136c98382ac745cac11a10bfff65c403324e07b1f2787b98d8"}
Jul 29 17:55:03.674120 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:03.674091    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pb4m5" event={"ID":"40ccf825-6a2b-4d4d-82b8-a8edb3f2168e","Type":"ContainerStarted","Data":"68444b0ef60dc74714c85b75b6e332ad27e9a7e870ada264c2d380b8c99900fe"}
Jul 29 17:55:03.691861 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:03.691795    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pb4m5" podStartSLOduration=130.621479303 podStartE2EDuration="2m11.691778598s" totalImagesPullingTime="1.070299295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:55:03.690151878 +0000 UTC m=+132.038379972" watchObservedRunningTime="2026-07-29 17:55:03.691778598 +0000 UTC m=+132.040006691"
Jul 29 17:55:04.170954 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.170907    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9" podUID="1a02b69b-6318-4b41-a28d-1e942cd7e56b" containerName="registry" containerID="cri-o://1d94ea958d947e4ce60832c3faee3898235ba21943fefb7bd0d8305f088ca24d" gracePeriod=30
Jul 29 17:55:04.409070 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.409045    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:55:04.513921 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.513884    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls\") pod \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") "
Jul 29 17:55:04.514131 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.513931    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1a02b69b-6318-4b41-a28d-1e942cd7e56b-installation-pull-secrets\") pod \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") "
Jul 29 17:55:04.514131 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.513951    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1a02b69b-6318-4b41-a28d-1e942cd7e56b-image-registry-private-configuration\") pod \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") "
Jul 29 17:55:04.514131 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.514028    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5qgj\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-kube-api-access-v5qgj\") pod \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") "
Jul 29 17:55:04.514131 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.514062    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1a02b69b-6318-4b41-a28d-1e942cd7e56b-ca-trust-extracted\") pod \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") "
Jul 29 17:55:04.514131 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.514096    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a02b69b-6318-4b41-a28d-1e942cd7e56b-trusted-ca\") pod \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") "
Jul 29 17:55:04.514131 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.514123    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-bound-sa-token\") pod \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") "
Jul 29 17:55:04.514501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.514151    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-certificates\") pod \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\" (UID: \"1a02b69b-6318-4b41-a28d-1e942cd7e56b\") "
Jul 29 17:55:04.515126 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.515088    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a02b69b-6318-4b41-a28d-1e942cd7e56b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1a02b69b-6318-4b41-a28d-1e942cd7e56b" (UID: "1a02b69b-6318-4b41-a28d-1e942cd7e56b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 17:55:04.515511 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.515474    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1a02b69b-6318-4b41-a28d-1e942cd7e56b" (UID: "1a02b69b-6318-4b41-a28d-1e942cd7e56b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 17:55:04.516810 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.516784    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1a02b69b-6318-4b41-a28d-1e942cd7e56b" (UID: "1a02b69b-6318-4b41-a28d-1e942cd7e56b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 17:55:04.516908 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.516829    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-kube-api-access-v5qgj" (OuterVolumeSpecName: "kube-api-access-v5qgj") pod "1a02b69b-6318-4b41-a28d-1e942cd7e56b" (UID: "1a02b69b-6318-4b41-a28d-1e942cd7e56b"). InnerVolumeSpecName "kube-api-access-v5qgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 17:55:04.517262 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.517233    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a02b69b-6318-4b41-a28d-1e942cd7e56b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1a02b69b-6318-4b41-a28d-1e942cd7e56b" (UID: "1a02b69b-6318-4b41-a28d-1e942cd7e56b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 17:55:04.517408 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.517380    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a02b69b-6318-4b41-a28d-1e942cd7e56b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1a02b69b-6318-4b41-a28d-1e942cd7e56b" (UID: "1a02b69b-6318-4b41-a28d-1e942cd7e56b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 17:55:04.517564 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.517546    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1a02b69b-6318-4b41-a28d-1e942cd7e56b" (UID: "1a02b69b-6318-4b41-a28d-1e942cd7e56b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 17:55:04.523207 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.523175    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a02b69b-6318-4b41-a28d-1e942cd7e56b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1a02b69b-6318-4b41-a28d-1e942cd7e56b" (UID: "1a02b69b-6318-4b41-a28d-1e942cd7e56b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 17:55:04.615064 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.615029    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-tls\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:55:04.615064 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.615060    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1a02b69b-6318-4b41-a28d-1e942cd7e56b-installation-pull-secrets\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:55:04.615256 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.615073    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1a02b69b-6318-4b41-a28d-1e942cd7e56b-image-registry-private-configuration\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:55:04.615256 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.615083    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5qgj\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-kube-api-access-v5qgj\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:55:04.615256 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.615092    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1a02b69b-6318-4b41-a28d-1e942cd7e56b-ca-trust-extracted\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:55:04.615256 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.615100    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1a02b69b-6318-4b41-a28d-1e942cd7e56b-trusted-ca\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:55:04.615256 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.615108    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1a02b69b-6318-4b41-a28d-1e942cd7e56b-bound-sa-token\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:55:04.615256 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.615116    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1a02b69b-6318-4b41-a28d-1e942cd7e56b-registry-certificates\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:55:04.678524 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.678487    2567 generic.go:356] "Generic (PLEG): container finished" podID="1a02b69b-6318-4b41-a28d-1e942cd7e56b" containerID="1d94ea958d947e4ce60832c3faee3898235ba21943fefb7bd0d8305f088ca24d" exitCode=0
Jul 29 17:55:04.679027 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.678538    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9"
Jul 29 17:55:04.679027 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.678575    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9" event={"ID":"1a02b69b-6318-4b41-a28d-1e942cd7e56b","Type":"ContainerDied","Data":"1d94ea958d947e4ce60832c3faee3898235ba21943fefb7bd0d8305f088ca24d"}
Jul 29 17:55:04.679027 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.678638    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8498fb9bb4-rv2h9" event={"ID":"1a02b69b-6318-4b41-a28d-1e942cd7e56b","Type":"ContainerDied","Data":"fd40e698e5324cf8d9ad39a7884ecd42ec971c1faabbf2bff18abb166a09c8e7"}
Jul 29 17:55:04.679027 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.678686    2567 scope.go:117] "RemoveContainer" containerID="1d94ea958d947e4ce60832c3faee3898235ba21943fefb7bd0d8305f088ca24d"
Jul 29 17:55:04.687493 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.687474    2567 scope.go:117] "RemoveContainer" containerID="1d94ea958d947e4ce60832c3faee3898235ba21943fefb7bd0d8305f088ca24d"
Jul 29 17:55:04.687782 ip-10-0-138-0 kubenswrapper[2567]: E0729 17:55:04.687760    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d94ea958d947e4ce60832c3faee3898235ba21943fefb7bd0d8305f088ca24d\": container with ID starting with 1d94ea958d947e4ce60832c3faee3898235ba21943fefb7bd0d8305f088ca24d not found: ID does not exist" containerID="1d94ea958d947e4ce60832c3faee3898235ba21943fefb7bd0d8305f088ca24d"
Jul 29 17:55:04.687849 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.687793    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d94ea958d947e4ce60832c3faee3898235ba21943fefb7bd0d8305f088ca24d"} err="failed to get container status \"1d94ea958d947e4ce60832c3faee3898235ba21943fefb7bd0d8305f088ca24d\": rpc error: code = NotFound desc = could not find container \"1d94ea958d947e4ce60832c3faee3898235ba21943fefb7bd0d8305f088ca24d\": container with ID starting with 1d94ea958d947e4ce60832c3faee3898235ba21943fefb7bd0d8305f088ca24d not found: ID does not exist"
Jul 29 17:55:04.699448 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.699420    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8498fb9bb4-rv2h9"]
Jul 29 17:55:04.703256 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:04.703234    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8498fb9bb4-rv2h9"]
Jul 29 17:55:06.071914 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:06.071874    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a02b69b-6318-4b41-a28d-1e942cd7e56b" path="/var/lib/kubelet/pods/1a02b69b-6318-4b41-a28d-1e942cd7e56b/volumes"
Jul 29 17:55:09.698901 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:09.698858    2567 generic.go:356] "Generic (PLEG): container finished" podID="51ddc013-8a44-4e97-b81e-c38bea41403c" containerID="7c48f0f4131ef77465e61df276635116a0b45666eedc9b6762b8074c8f47a355" exitCode=0
Jul 29 17:55:09.699393 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:09.698913    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx" event={"ID":"51ddc013-8a44-4e97-b81e-c38bea41403c","Type":"ContainerDied","Data":"7c48f0f4131ef77465e61df276635116a0b45666eedc9b6762b8074c8f47a355"}
Jul 29 17:55:09.699393 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:09.699338    2567 scope.go:117] "RemoveContainer" containerID="7c48f0f4131ef77465e61df276635116a0b45666eedc9b6762b8074c8f47a355"
Jul 29 17:55:10.707756 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:10.707721    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-8ttjx" event={"ID":"51ddc013-8a44-4e97-b81e-c38bea41403c","Type":"ContainerStarted","Data":"315567a0e262c922f9ac0f019597f72904e5f460ef177e3895d3219e03a2b9ea"}
Jul 29 17:55:29.774081 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:29.774046    2567 generic.go:356] "Generic (PLEG): container finished" podID="6587876a-1047-45f4-bc60-d7b9efa4ff29" containerID="3cec610f994c3e8da8dabec88b3d5b8b276d2371f6d19b03a213bf62387c25c4" exitCode=0
Jul 29 17:55:29.774451 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:29.774100    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm" event={"ID":"6587876a-1047-45f4-bc60-d7b9efa4ff29","Type":"ContainerDied","Data":"3cec610f994c3e8da8dabec88b3d5b8b276d2371f6d19b03a213bf62387c25c4"}
Jul 29 17:55:29.774451 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:29.774441    2567 scope.go:117] "RemoveContainer" containerID="3cec610f994c3e8da8dabec88b3d5b8b276d2371f6d19b03a213bf62387c25c4"
Jul 29 17:55:30.778958 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:55:30.778921    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm" event={"ID":"6587876a-1047-45f4-bc60-d7b9efa4ff29","Type":"ContainerStarted","Data":"739fff2113c758a4e29ed38ae407ec6d65e2a957d1156fc7cc06ea293b35e1fb"}
Jul 29 17:57:52.019887 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:52.019856    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 17:57:59.360794 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.360752    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"]
Jul 29 17:57:59.362309 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.361646    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a02b69b-6318-4b41-a28d-1e942cd7e56b" containerName="registry"
Jul 29 17:57:59.362309 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.361672    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a02b69b-6318-4b41-a28d-1e942cd7e56b" containerName="registry"
Jul 29 17:57:59.362309 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.361802    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a02b69b-6318-4b41-a28d-1e942cd7e56b" containerName="registry"
Jul 29 17:57:59.364473 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.364444    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"
Jul 29 17:57:59.367820 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.367799    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sd949\""
Jul 29 17:57:59.368116 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.368100    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 17:57:59.368687 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.368671    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 17:57:59.372530 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.372503    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"]
Jul 29 17:57:59.476113 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.476076    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l\" (UID: \"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"
Jul 29 17:57:59.476113 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.476123    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pwn4\" (UniqueName: \"kubernetes.io/projected/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-kube-api-access-8pwn4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l\" (UID: \"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"
Jul 29 17:57:59.476364 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.476198    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l\" (UID: \"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"
Jul 29 17:57:59.577453 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.577421    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l\" (UID: \"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"
Jul 29 17:57:59.577654 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.577467    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pwn4\" (UniqueName: \"kubernetes.io/projected/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-kube-api-access-8pwn4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l\" (UID: \"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"
Jul 29 17:57:59.577654 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.577522    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l\" (UID: \"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"
Jul 29 17:57:59.577864 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.577842    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l\" (UID: \"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"
Jul 29 17:57:59.577932 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.577879    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l\" (UID: \"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"
Jul 29 17:57:59.586615 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.586588    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pwn4\" (UniqueName: \"kubernetes.io/projected/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-kube-api-access-8pwn4\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l\" (UID: \"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"
Jul 29 17:57:59.676411 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.676311    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"
Jul 29 17:57:59.801749 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.801615    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"]
Jul 29 17:57:59.803876 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:57:59.803849    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce1e6b0_1749_4b0d_9c6a_ffecf7d3d453.slice/crio-8dd3702e6d9e0ab39ab4d38b086306d12d0cfee83721b41d07663b53c519267b WatchSource:0}: Error finding container 8dd3702e6d9e0ab39ab4d38b086306d12d0cfee83721b41d07663b53c519267b: Status 404 returned error can't find the container with id 8dd3702e6d9e0ab39ab4d38b086306d12d0cfee83721b41d07663b53c519267b
Jul 29 17:57:59.805898 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:57:59.805877    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 17:58:00.284855 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:00.284818    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l" event={"ID":"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453","Type":"ContainerStarted","Data":"8dd3702e6d9e0ab39ab4d38b086306d12d0cfee83721b41d07663b53c519267b"}
Jul 29 17:58:06.310547 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:06.310510    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l" event={"ID":"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453","Type":"ContainerStarted","Data":"7e60b1cf7fe8fee38044d65e7bcf167cadf92db6be855c1814b5e3f2aa5d6a65"}
Jul 29 17:58:07.315263 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:07.315228    2567 generic.go:356] "Generic (PLEG): container finished" podID="0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453" containerID="7e60b1cf7fe8fee38044d65e7bcf167cadf92db6be855c1814b5e3f2aa5d6a65" exitCode=0
Jul 29 17:58:07.315666 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:07.315313    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l" event={"ID":"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453","Type":"ContainerDied","Data":"7e60b1cf7fe8fee38044d65e7bcf167cadf92db6be855c1814b5e3f2aa5d6a65"}
Jul 29 17:58:10.327087 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:10.327051    2567 generic.go:356] "Generic (PLEG): container finished" podID="0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453" containerID="4eb9315865e14cc6018093b4221801ed0a6b654f862f40771ec05b532b251ca6" exitCode=0
Jul 29 17:58:10.327477 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:10.327144    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l" event={"ID":"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453","Type":"ContainerDied","Data":"4eb9315865e14cc6018093b4221801ed0a6b654f862f40771ec05b532b251ca6"}
Jul 29 17:58:18.362736 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:18.362701    2567 generic.go:356] "Generic (PLEG): container finished" podID="0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453" containerID="b5145f2ef83f8a97d8ef248e30694049b079251c025a920d76374b680600a3b9" exitCode=0
Jul 29 17:58:18.363154 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:18.362791    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l" event={"ID":"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453","Type":"ContainerDied","Data":"b5145f2ef83f8a97d8ef248e30694049b079251c025a920d76374b680600a3b9"}
Jul 29 17:58:19.488398 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:19.488370    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"
Jul 29 17:58:19.654739 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:19.654639    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pwn4\" (UniqueName: \"kubernetes.io/projected/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-kube-api-access-8pwn4\") pod \"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453\" (UID: \"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453\") "
Jul 29 17:58:19.654739 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:19.654700    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-bundle\") pod \"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453\" (UID: \"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453\") "
Jul 29 17:58:19.654964 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:19.654760    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-util\") pod \"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453\" (UID: \"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453\") "
Jul 29 17:58:19.656032 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:19.655954    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-bundle" (OuterVolumeSpecName: "bundle") pod "0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453" (UID: "0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 17:58:19.661368 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:19.661244    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-kube-api-access-8pwn4" (OuterVolumeSpecName: "kube-api-access-8pwn4") pod "0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453" (UID: "0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453"). InnerVolumeSpecName "kube-api-access-8pwn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 17:58:19.661759 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:19.661735    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-util" (OuterVolumeSpecName: "util") pod "0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453" (UID: "0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 17:58:19.755707 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:19.755662    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-util\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:58:19.755707 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:19.755701    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pwn4\" (UniqueName: \"kubernetes.io/projected/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-kube-api-access-8pwn4\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:58:19.755707 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:19.755716    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:58:20.372116 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:20.372030    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l" event={"ID":"0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453","Type":"ContainerDied","Data":"8dd3702e6d9e0ab39ab4d38b086306d12d0cfee83721b41d07663b53c519267b"}
Jul 29 17:58:20.372116 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:20.372087    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8dd3702e6d9e0ab39ab4d38b086306d12d0cfee83721b41d07663b53c519267b"
Jul 29 17:58:20.372116 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:20.372049    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vhm6l"
Jul 29 17:58:27.349939 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.349903    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fkv42"]
Jul 29 17:58:27.350378 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.350180    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453" containerName="pull"
Jul 29 17:58:27.350378 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.350191    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453" containerName="pull"
Jul 29 17:58:27.350378 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.350202    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453" containerName="util"
Jul 29 17:58:27.350378 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.350208    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453" containerName="util"
Jul 29 17:58:27.350378 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.350214    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453" containerName="extract"
Jul 29 17:58:27.350378 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.350220    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453" containerName="extract"
Jul 29 17:58:27.350378 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.350262    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ce1e6b0-1749-4b0d-9c6a-ffecf7d3d453" containerName="extract"
Jul 29 17:58:27.353316 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.353298    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fkv42"
Jul 29 17:58:27.356379 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.356350    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-9v9tr\""
Jul 29 17:58:27.356501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.356398    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 29 17:58:27.356501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.356465    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 29 17:58:27.370243 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.370218    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fkv42"]
Jul 29 17:58:27.510331 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.510291    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6pbq\" (UniqueName: \"kubernetes.io/projected/b3cd2a3c-3cf6-4110-9ef6-ef01faea33b2-kube-api-access-h6pbq\") pod \"cert-manager-operator-controller-manager-55c444bf86-fkv42\" (UID: \"b3cd2a3c-3cf6-4110-9ef6-ef01faea33b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fkv42"
Jul 29 17:58:27.510522 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.510348    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3cd2a3c-3cf6-4110-9ef6-ef01faea33b2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fkv42\" (UID: \"b3cd2a3c-3cf6-4110-9ef6-ef01faea33b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fkv42"
Jul 29 17:58:27.611686 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.611586    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6pbq\" (UniqueName: \"kubernetes.io/projected/b3cd2a3c-3cf6-4110-9ef6-ef01faea33b2-kube-api-access-h6pbq\") pod \"cert-manager-operator-controller-manager-55c444bf86-fkv42\" (UID: \"b3cd2a3c-3cf6-4110-9ef6-ef01faea33b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fkv42"
Jul 29 17:58:27.611686 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.611640    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3cd2a3c-3cf6-4110-9ef6-ef01faea33b2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fkv42\" (UID: \"b3cd2a3c-3cf6-4110-9ef6-ef01faea33b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fkv42"
Jul 29 17:58:27.611983 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.611965    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3cd2a3c-3cf6-4110-9ef6-ef01faea33b2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fkv42\" (UID: \"b3cd2a3c-3cf6-4110-9ef6-ef01faea33b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fkv42"
Jul 29 17:58:27.620913 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.620881    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6pbq\" (UniqueName: \"kubernetes.io/projected/b3cd2a3c-3cf6-4110-9ef6-ef01faea33b2-kube-api-access-h6pbq\") pod \"cert-manager-operator-controller-manager-55c444bf86-fkv42\" (UID: \"b3cd2a3c-3cf6-4110-9ef6-ef01faea33b2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fkv42"
Jul 29 17:58:27.663203 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.663167    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fkv42"
Jul 29 17:58:27.804854 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:27.804828    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fkv42"]
Jul 29 17:58:27.807265 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:58:27.807239    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3cd2a3c_3cf6_4110_9ef6_ef01faea33b2.slice/crio-229423c1e26be53f4384da8ceb08ce62ddba6a240a3c37153c87163f6fb23d08 WatchSource:0}: Error finding container 229423c1e26be53f4384da8ceb08ce62ddba6a240a3c37153c87163f6fb23d08: Status 404 returned error can't find the container with id 229423c1e26be53f4384da8ceb08ce62ddba6a240a3c37153c87163f6fb23d08
Jul 29 17:58:28.403053 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:28.403017    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fkv42" event={"ID":"b3cd2a3c-3cf6-4110-9ef6-ef01faea33b2","Type":"ContainerStarted","Data":"229423c1e26be53f4384da8ceb08ce62ddba6a240a3c37153c87163f6fb23d08"}
Jul 29 17:58:30.413131 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:30.413095    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fkv42" event={"ID":"b3cd2a3c-3cf6-4110-9ef6-ef01faea33b2","Type":"ContainerStarted","Data":"e2b206da60e0745fdf7af86a3bcba9e2471c5d8062996645dcbb5cef9a174cd8"}
Jul 29 17:58:30.435873 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:30.435822    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fkv42" podStartSLOduration=1.748302097 podStartE2EDuration="3.435804368s" totalImagesPullingTime="1.687502271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:58:30.433321059 +0000 UTC m=+338.781549152" watchObservedRunningTime="2026-07-29 17:58:30.435804368 +0000 UTC m=+338.784032461"
Jul 29 17:58:31.324443 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.324402    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"]
Jul 29 17:58:31.326682 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.326664    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"
Jul 29 17:58:31.339569 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.339543    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 17:58:31.339712 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.339583    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sd949\""
Jul 29 17:58:31.340549 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.340533    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 17:58:31.364662 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.364620    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"]
Jul 29 17:58:31.443148 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.443114    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9288\" (UniqueName: \"kubernetes.io/projected/c46601a4-695d-4e36-98f7-15b276d782ec-kube-api-access-x9288\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49\" (UID: \"c46601a4-695d-4e36-98f7-15b276d782ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"
Jul 29 17:58:31.443516 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.443188    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c46601a4-695d-4e36-98f7-15b276d782ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49\" (UID: \"c46601a4-695d-4e36-98f7-15b276d782ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"
Jul 29 17:58:31.443516 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.443215    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c46601a4-695d-4e36-98f7-15b276d782ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49\" (UID: \"c46601a4-695d-4e36-98f7-15b276d782ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"
Jul 29 17:58:31.544324 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.544283    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9288\" (UniqueName: \"kubernetes.io/projected/c46601a4-695d-4e36-98f7-15b276d782ec-kube-api-access-x9288\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49\" (UID: \"c46601a4-695d-4e36-98f7-15b276d782ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"
Jul 29 17:58:31.544528 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.544359    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c46601a4-695d-4e36-98f7-15b276d782ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49\" (UID: \"c46601a4-695d-4e36-98f7-15b276d782ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"
Jul 29 17:58:31.544528 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.544382    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c46601a4-695d-4e36-98f7-15b276d782ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49\" (UID: \"c46601a4-695d-4e36-98f7-15b276d782ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"
Jul 29 17:58:31.544715 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.544698    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c46601a4-695d-4e36-98f7-15b276d782ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49\" (UID: \"c46601a4-695d-4e36-98f7-15b276d782ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"
Jul 29 17:58:31.544801 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.544780    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c46601a4-695d-4e36-98f7-15b276d782ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49\" (UID: \"c46601a4-695d-4e36-98f7-15b276d782ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"
Jul 29 17:58:31.558087 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.558054    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9288\" (UniqueName: \"kubernetes.io/projected/c46601a4-695d-4e36-98f7-15b276d782ec-kube-api-access-x9288\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49\" (UID: \"c46601a4-695d-4e36-98f7-15b276d782ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"
Jul 29 17:58:31.635431 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.635341    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"
Jul 29 17:58:31.779962 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:31.779933    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"]
Jul 29 17:58:31.781425 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:58:31.781395    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46601a4_695d_4e36_98f7_15b276d782ec.slice/crio-62c089c078839f396349f6590310718121aa89b7988439e1facad8d2585a6acd WatchSource:0}: Error finding container 62c089c078839f396349f6590310718121aa89b7988439e1facad8d2585a6acd: Status 404 returned error can't find the container with id 62c089c078839f396349f6590310718121aa89b7988439e1facad8d2585a6acd
Jul 29 17:58:32.422547 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:32.422514    2567 generic.go:356] "Generic (PLEG): container finished" podID="c46601a4-695d-4e36-98f7-15b276d782ec" containerID="def12387aeea9763153ac305b2868a2a27f04b798fe66fe777f0c21efd1f428c" exitCode=0
Jul 29 17:58:32.422743 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:32.422601    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49" event={"ID":"c46601a4-695d-4e36-98f7-15b276d782ec","Type":"ContainerDied","Data":"def12387aeea9763153ac305b2868a2a27f04b798fe66fe777f0c21efd1f428c"}
Jul 29 17:58:32.422743 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:32.422654    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49" event={"ID":"c46601a4-695d-4e36-98f7-15b276d782ec","Type":"ContainerStarted","Data":"62c089c078839f396349f6590310718121aa89b7988439e1facad8d2585a6acd"}
Jul 29 17:58:34.432604 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:34.432571    2567 generic.go:356] "Generic (PLEG): container finished" podID="c46601a4-695d-4e36-98f7-15b276d782ec" containerID="740166bccd38f83acdd40f40b5415e7742089e7de8988d683d46b06cd85868b1" exitCode=0
Jul 29 17:58:34.433129 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:34.432646    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49" event={"ID":"c46601a4-695d-4e36-98f7-15b276d782ec","Type":"ContainerDied","Data":"740166bccd38f83acdd40f40b5415e7742089e7de8988d683d46b06cd85868b1"}
Jul 29 17:58:35.438427 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:35.438386    2567 generic.go:356] "Generic (PLEG): container finished" podID="c46601a4-695d-4e36-98f7-15b276d782ec" containerID="e63230e67a18a22872fcc7cfdd71d6ca7f7fedfaeea2ed4068c235fa22cf3658" exitCode=0
Jul 29 17:58:35.438880 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:35.438474    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49" event={"ID":"c46601a4-695d-4e36-98f7-15b276d782ec","Type":"ContainerDied","Data":"e63230e67a18a22872fcc7cfdd71d6ca7f7fedfaeea2ed4068c235fa22cf3658"}
Jul 29 17:58:36.564635 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:36.564611    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"
Jul 29 17:58:36.581337 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:36.581308    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c46601a4-695d-4e36-98f7-15b276d782ec-bundle\") pod \"c46601a4-695d-4e36-98f7-15b276d782ec\" (UID: \"c46601a4-695d-4e36-98f7-15b276d782ec\") "
Jul 29 17:58:36.581486 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:36.581397    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9288\" (UniqueName: \"kubernetes.io/projected/c46601a4-695d-4e36-98f7-15b276d782ec-kube-api-access-x9288\") pod \"c46601a4-695d-4e36-98f7-15b276d782ec\" (UID: \"c46601a4-695d-4e36-98f7-15b276d782ec\") "
Jul 29 17:58:36.581486 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:36.581419    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c46601a4-695d-4e36-98f7-15b276d782ec-util\") pod \"c46601a4-695d-4e36-98f7-15b276d782ec\" (UID: \"c46601a4-695d-4e36-98f7-15b276d782ec\") "
Jul 29 17:58:36.581736 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:36.581702    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46601a4-695d-4e36-98f7-15b276d782ec-bundle" (OuterVolumeSpecName: "bundle") pod "c46601a4-695d-4e36-98f7-15b276d782ec" (UID: "c46601a4-695d-4e36-98f7-15b276d782ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 17:58:36.583748 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:36.583718    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c46601a4-695d-4e36-98f7-15b276d782ec-kube-api-access-x9288" (OuterVolumeSpecName: "kube-api-access-x9288") pod "c46601a4-695d-4e36-98f7-15b276d782ec" (UID: "c46601a4-695d-4e36-98f7-15b276d782ec"). InnerVolumeSpecName "kube-api-access-x9288". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 17:58:36.587845 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:36.587818    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46601a4-695d-4e36-98f7-15b276d782ec-util" (OuterVolumeSpecName: "util") pod "c46601a4-695d-4e36-98f7-15b276d782ec" (UID: "c46601a4-695d-4e36-98f7-15b276d782ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 17:58:36.682187 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:36.682147    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9288\" (UniqueName: \"kubernetes.io/projected/c46601a4-695d-4e36-98f7-15b276d782ec-kube-api-access-x9288\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:58:36.682187 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:36.682180    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c46601a4-695d-4e36-98f7-15b276d782ec-util\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:58:36.682187 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:36.682188    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c46601a4-695d-4e36-98f7-15b276d782ec-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:58:37.448943 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:37.448909    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49" event={"ID":"c46601a4-695d-4e36-98f7-15b276d782ec","Type":"ContainerDied","Data":"62c089c078839f396349f6590310718121aa89b7988439e1facad8d2585a6acd"}
Jul 29 17:58:37.448943 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:37.448929    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqkc49"
Jul 29 17:58:37.449244 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:37.448956    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62c089c078839f396349f6590310718121aa89b7988439e1facad8d2585a6acd"
Jul 29 17:58:41.711832 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.711794    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhv"]
Jul 29 17:58:41.712332 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.712176    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c46601a4-695d-4e36-98f7-15b276d782ec" containerName="extract"
Jul 29 17:58:41.712332 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.712196    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46601a4-695d-4e36-98f7-15b276d782ec" containerName="extract"
Jul 29 17:58:41.712332 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.712210    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c46601a4-695d-4e36-98f7-15b276d782ec" containerName="util"
Jul 29 17:58:41.712332 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.712219    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46601a4-695d-4e36-98f7-15b276d782ec" containerName="util"
Jul 29 17:58:41.712332 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.712250    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c46601a4-695d-4e36-98f7-15b276d782ec" containerName="pull"
Jul 29 17:58:41.712332 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.712258    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46601a4-695d-4e36-98f7-15b276d782ec" containerName="pull"
Jul 29 17:58:41.712332 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.712330    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c46601a4-695d-4e36-98f7-15b276d782ec" containerName="extract"
Jul 29 17:58:41.714314 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.714294    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhv"
Jul 29 17:58:41.719267 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.719234    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 17:58:41.719429 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.719295    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 17:58:41.720463 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.720440    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-pqjww\""
Jul 29 17:58:41.727709 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.727677    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhv"]
Jul 29 17:58:41.812296 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.812259    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da72fe86-cfec-46b5-a1e0-8864b6c78ca1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vtbhv\" (UID: \"da72fe86-cfec-46b5-a1e0-8864b6c78ca1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhv"
Jul 29 17:58:41.812480 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.812308    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzfxs\" (UniqueName: \"kubernetes.io/projected/da72fe86-cfec-46b5-a1e0-8864b6c78ca1-kube-api-access-pzfxs\") pod \"openshift-lws-operator-fd8ccff4c-vtbhv\" (UID: \"da72fe86-cfec-46b5-a1e0-8864b6c78ca1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhv"
Jul 29 17:58:41.913014 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.912950    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da72fe86-cfec-46b5-a1e0-8864b6c78ca1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vtbhv\" (UID: \"da72fe86-cfec-46b5-a1e0-8864b6c78ca1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhv"
Jul 29 17:58:41.913190 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.913022    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzfxs\" (UniqueName: \"kubernetes.io/projected/da72fe86-cfec-46b5-a1e0-8864b6c78ca1-kube-api-access-pzfxs\") pod \"openshift-lws-operator-fd8ccff4c-vtbhv\" (UID: \"da72fe86-cfec-46b5-a1e0-8864b6c78ca1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhv"
Jul 29 17:58:41.913351 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.913329    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da72fe86-cfec-46b5-a1e0-8864b6c78ca1-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vtbhv\" (UID: \"da72fe86-cfec-46b5-a1e0-8864b6c78ca1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhv"
Jul 29 17:58:41.922672 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:41.922640    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzfxs\" (UniqueName: \"kubernetes.io/projected/da72fe86-cfec-46b5-a1e0-8864b6c78ca1-kube-api-access-pzfxs\") pod \"openshift-lws-operator-fd8ccff4c-vtbhv\" (UID: \"da72fe86-cfec-46b5-a1e0-8864b6c78ca1\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhv"
Jul 29 17:58:42.023655 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:42.023610    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhv"
Jul 29 17:58:42.158582 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:42.158546    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhv"]
Jul 29 17:58:42.161625 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:58:42.161588    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda72fe86_cfec_46b5_a1e0_8864b6c78ca1.slice/crio-5b82e2eb56754ed7e6321087c2a3a49abcbba32c56753adeea8c0aa903dd3157 WatchSource:0}: Error finding container 5b82e2eb56754ed7e6321087c2a3a49abcbba32c56753adeea8c0aa903dd3157: Status 404 returned error can't find the container with id 5b82e2eb56754ed7e6321087c2a3a49abcbba32c56753adeea8c0aa903dd3157
Jul 29 17:58:42.472845 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:42.472755    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhv" event={"ID":"da72fe86-cfec-46b5-a1e0-8864b6c78ca1","Type":"ContainerStarted","Data":"5b82e2eb56754ed7e6321087c2a3a49abcbba32c56753adeea8c0aa903dd3157"}
Jul 29 17:58:44.483217 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:44.483182    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhv" event={"ID":"da72fe86-cfec-46b5-a1e0-8864b6c78ca1","Type":"ContainerStarted","Data":"f3b87d1143df7e1bf084eda175b0c71460bf9cc566a793fbe876166698448ae8"}
Jul 29 17:58:44.500962 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:44.500903    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vtbhv" podStartSLOduration=2.042907226 podStartE2EDuration="3.500887551s" totalImagesPullingTime="1.457980325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:58:44.499540664 +0000 UTC m=+352.847768756" watchObservedRunningTime="2026-07-29 17:58:44.500887551 +0000 UTC m=+352.849115637"
Jul 29 17:58:47.039452 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.039411    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"]
Jul 29 17:58:47.042223 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.042200    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"
Jul 29 17:58:47.042653 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.042627    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-742qg\" (UniqueName: \"kubernetes.io/projected/fbceb1ec-8519-4c69-91d2-e89b371789ed-kube-api-access-742qg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz\" (UID: \"fbceb1ec-8519-4c69-91d2-e89b371789ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"
Jul 29 17:58:47.042736 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.042674    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbceb1ec-8519-4c69-91d2-e89b371789ed-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz\" (UID: \"fbceb1ec-8519-4c69-91d2-e89b371789ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"
Jul 29 17:58:47.042736 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.042693    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbceb1ec-8519-4c69-91d2-e89b371789ed-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz\" (UID: \"fbceb1ec-8519-4c69-91d2-e89b371789ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"
Jul 29 17:58:47.045185 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.045165    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 17:58:47.045559 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.045543    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sd949\""
Jul 29 17:58:47.046353 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.046332    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 17:58:47.069145 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.069115    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"]
Jul 29 17:58:47.143475 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.143443    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-742qg\" (UniqueName: \"kubernetes.io/projected/fbceb1ec-8519-4c69-91d2-e89b371789ed-kube-api-access-742qg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz\" (UID: \"fbceb1ec-8519-4c69-91d2-e89b371789ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"
Jul 29 17:58:47.143475 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.143479    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbceb1ec-8519-4c69-91d2-e89b371789ed-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz\" (UID: \"fbceb1ec-8519-4c69-91d2-e89b371789ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"
Jul 29 17:58:47.143691 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.143500    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbceb1ec-8519-4c69-91d2-e89b371789ed-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz\" (UID: \"fbceb1ec-8519-4c69-91d2-e89b371789ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"
Jul 29 17:58:47.143940 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.143919    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbceb1ec-8519-4c69-91d2-e89b371789ed-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz\" (UID: \"fbceb1ec-8519-4c69-91d2-e89b371789ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"
Jul 29 17:58:47.143981 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.143934    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbceb1ec-8519-4c69-91d2-e89b371789ed-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz\" (UID: \"fbceb1ec-8519-4c69-91d2-e89b371789ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"
Jul 29 17:58:47.165476 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.165450    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-742qg\" (UniqueName: \"kubernetes.io/projected/fbceb1ec-8519-4c69-91d2-e89b371789ed-kube-api-access-742qg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz\" (UID: \"fbceb1ec-8519-4c69-91d2-e89b371789ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"
Jul 29 17:58:47.351117 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.351036    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"
Jul 29 17:58:47.492838 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:47.492813    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"]
Jul 29 17:58:47.499512 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:58:47.495190    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbceb1ec_8519_4c69_91d2_e89b371789ed.slice/crio-0aeafbd8a7978601cd5b79e756cb8d0603ed1929cf2ca88d9cf3e889cab50180 WatchSource:0}: Error finding container 0aeafbd8a7978601cd5b79e756cb8d0603ed1929cf2ca88d9cf3e889cab50180: Status 404 returned error can't find the container with id 0aeafbd8a7978601cd5b79e756cb8d0603ed1929cf2ca88d9cf3e889cab50180
Jul 29 17:58:48.502945 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:48.502912    2567 generic.go:356] "Generic (PLEG): container finished" podID="fbceb1ec-8519-4c69-91d2-e89b371789ed" containerID="a8b08bab7705f4f30be4dc971be8dc5cca8704941557b48183480f6c62fdcd5a" exitCode=0
Jul 29 17:58:48.503347 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:48.503034    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz" event={"ID":"fbceb1ec-8519-4c69-91d2-e89b371789ed","Type":"ContainerDied","Data":"a8b08bab7705f4f30be4dc971be8dc5cca8704941557b48183480f6c62fdcd5a"}
Jul 29 17:58:48.503347 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:48.503104    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz" event={"ID":"fbceb1ec-8519-4c69-91d2-e89b371789ed","Type":"ContainerStarted","Data":"0aeafbd8a7978601cd5b79e756cb8d0603ed1929cf2ca88d9cf3e889cab50180"}
Jul 29 17:58:49.508255 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:49.508222    2567 generic.go:356] "Generic (PLEG): container finished" podID="fbceb1ec-8519-4c69-91d2-e89b371789ed" containerID="0f4a062015272e7d4ae13277db7a473fc93486aad33e04c0da5fa4c9d972cdde" exitCode=0
Jul 29 17:58:49.508734 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:49.508275    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz" event={"ID":"fbceb1ec-8519-4c69-91d2-e89b371789ed","Type":"ContainerDied","Data":"0f4a062015272e7d4ae13277db7a473fc93486aad33e04c0da5fa4c9d972cdde"}
Jul 29 17:58:50.515456 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:50.515417    2567 generic.go:356] "Generic (PLEG): container finished" podID="fbceb1ec-8519-4c69-91d2-e89b371789ed" containerID="39042d36604dae89c2d55ed3607c998af8013d0040f35ae43d5686b5e3052b52" exitCode=0
Jul 29 17:58:50.515843 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:50.515486    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz" event={"ID":"fbceb1ec-8519-4c69-91d2-e89b371789ed","Type":"ContainerDied","Data":"39042d36604dae89c2d55ed3607c998af8013d0040f35ae43d5686b5e3052b52"}
Jul 29 17:58:51.662301 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:51.662265    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"
Jul 29 17:58:51.674650 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:51.674625    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-742qg\" (UniqueName: \"kubernetes.io/projected/fbceb1ec-8519-4c69-91d2-e89b371789ed-kube-api-access-742qg\") pod \"fbceb1ec-8519-4c69-91d2-e89b371789ed\" (UID: \"fbceb1ec-8519-4c69-91d2-e89b371789ed\") "
Jul 29 17:58:51.674772 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:51.674674    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbceb1ec-8519-4c69-91d2-e89b371789ed-util\") pod \"fbceb1ec-8519-4c69-91d2-e89b371789ed\" (UID: \"fbceb1ec-8519-4c69-91d2-e89b371789ed\") "
Jul 29 17:58:51.674772 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:51.674718    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbceb1ec-8519-4c69-91d2-e89b371789ed-bundle\") pod \"fbceb1ec-8519-4c69-91d2-e89b371789ed\" (UID: \"fbceb1ec-8519-4c69-91d2-e89b371789ed\") "
Jul 29 17:58:51.675485 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:51.675454    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbceb1ec-8519-4c69-91d2-e89b371789ed-bundle" (OuterVolumeSpecName: "bundle") pod "fbceb1ec-8519-4c69-91d2-e89b371789ed" (UID: "fbceb1ec-8519-4c69-91d2-e89b371789ed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 17:58:51.676651 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:51.676624    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbceb1ec-8519-4c69-91d2-e89b371789ed-kube-api-access-742qg" (OuterVolumeSpecName: "kube-api-access-742qg") pod "fbceb1ec-8519-4c69-91d2-e89b371789ed" (UID: "fbceb1ec-8519-4c69-91d2-e89b371789ed"). InnerVolumeSpecName "kube-api-access-742qg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 17:58:51.680651 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:51.680625    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbceb1ec-8519-4c69-91d2-e89b371789ed-util" (OuterVolumeSpecName: "util") pod "fbceb1ec-8519-4c69-91d2-e89b371789ed" (UID: "fbceb1ec-8519-4c69-91d2-e89b371789ed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 17:58:51.775318 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:51.775221    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbceb1ec-8519-4c69-91d2-e89b371789ed-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:58:51.775318 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:51.775255    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-742qg\" (UniqueName: \"kubernetes.io/projected/fbceb1ec-8519-4c69-91d2-e89b371789ed-kube-api-access-742qg\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:58:51.775318 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:51.775269    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbceb1ec-8519-4c69-91d2-e89b371789ed-util\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 17:58:52.525348 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:52.525314    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz" event={"ID":"fbceb1ec-8519-4c69-91d2-e89b371789ed","Type":"ContainerDied","Data":"0aeafbd8a7978601cd5b79e756cb8d0603ed1929cf2ca88d9cf3e889cab50180"}
Jul 29 17:58:52.525348 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:52.525338    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpx2xz"
Jul 29 17:58:52.525559 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:58:52.525388    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0aeafbd8a7978601cd5b79e756cb8d0603ed1929cf2ca88d9cf3e889cab50180"
Jul 29 17:59:04.258965 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.258925    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"]
Jul 29 17:59:04.259473 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.259200    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbceb1ec-8519-4c69-91d2-e89b371789ed" containerName="pull"
Jul 29 17:59:04.259473 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.259210    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbceb1ec-8519-4c69-91d2-e89b371789ed" containerName="pull"
Jul 29 17:59:04.259473 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.259224    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbceb1ec-8519-4c69-91d2-e89b371789ed" containerName="util"
Jul 29 17:59:04.259473 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.259229    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbceb1ec-8519-4c69-91d2-e89b371789ed" containerName="util"
Jul 29 17:59:04.259473 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.259239    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbceb1ec-8519-4c69-91d2-e89b371789ed" containerName="extract"
Jul 29 17:59:04.259473 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.259245    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbceb1ec-8519-4c69-91d2-e89b371789ed" containerName="extract"
Jul 29 17:59:04.259473 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.259285    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbceb1ec-8519-4c69-91d2-e89b371789ed" containerName="extract"
Jul 29 17:59:04.263950 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.263928    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.266965 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.266941    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 17:59:04.267124 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.266941    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wwfrm\""
Jul 29 17:59:04.267124 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.266946    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 17:59:04.267292 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.267261    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 17:59:04.267391 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.267372    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 17:59:04.284064 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.284033    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"]
Jul 29 17:59:04.368709 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.368668    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04f668b2-4cdb-4c34-9519-743fd8102804-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml\" (UID: \"04f668b2-4cdb-4c34-9519-743fd8102804\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.368709 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.368713    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04f668b2-4cdb-4c34-9519-743fd8102804-manifests\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml\" (UID: \"04f668b2-4cdb-4c34-9519-743fd8102804\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.368940 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.368742    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04f668b2-4cdb-4c34-9519-743fd8102804-tmp\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml\" (UID: \"04f668b2-4cdb-4c34-9519-743fd8102804\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.368940 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.368789    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8lqn\" (UniqueName: \"kubernetes.io/projected/04f668b2-4cdb-4c34-9519-743fd8102804-kube-api-access-s8lqn\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml\" (UID: \"04f668b2-4cdb-4c34-9519-743fd8102804\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.368940 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.368836    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04f668b2-4cdb-4c34-9519-743fd8102804-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml\" (UID: \"04f668b2-4cdb-4c34-9519-743fd8102804\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.470149 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.470107    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04f668b2-4cdb-4c34-9519-743fd8102804-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml\" (UID: \"04f668b2-4cdb-4c34-9519-743fd8102804\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.470149 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.470151    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04f668b2-4cdb-4c34-9519-743fd8102804-manifests\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml\" (UID: \"04f668b2-4cdb-4c34-9519-743fd8102804\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.470413 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.470170    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04f668b2-4cdb-4c34-9519-743fd8102804-tmp\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml\" (UID: \"04f668b2-4cdb-4c34-9519-743fd8102804\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.470413 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.470194    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8lqn\" (UniqueName: \"kubernetes.io/projected/04f668b2-4cdb-4c34-9519-743fd8102804-kube-api-access-s8lqn\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml\" (UID: \"04f668b2-4cdb-4c34-9519-743fd8102804\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.470413 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.470380    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04f668b2-4cdb-4c34-9519-743fd8102804-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml\" (UID: \"04f668b2-4cdb-4c34-9519-743fd8102804\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.470619 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.470594    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/04f668b2-4cdb-4c34-9519-743fd8102804-manifests\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml\" (UID: \"04f668b2-4cdb-4c34-9519-743fd8102804\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.472677 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.472647    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/04f668b2-4cdb-4c34-9519-743fd8102804-tmp\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml\" (UID: \"04f668b2-4cdb-4c34-9519-743fd8102804\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.472780 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.472757    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/04f668b2-4cdb-4c34-9519-743fd8102804-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml\" (UID: \"04f668b2-4cdb-4c34-9519-743fd8102804\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.472870 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.472852    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04f668b2-4cdb-4c34-9519-743fd8102804-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml\" (UID: \"04f668b2-4cdb-4c34-9519-743fd8102804\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.488968 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.488937    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8lqn\" (UniqueName: \"kubernetes.io/projected/04f668b2-4cdb-4c34-9519-743fd8102804-kube-api-access-s8lqn\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml\" (UID: \"04f668b2-4cdb-4c34-9519-743fd8102804\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.573649 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.573543    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:04.717119 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:04.717093    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"]
Jul 29 17:59:04.719242 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:59:04.719211    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f668b2_4cdb_4c34_9519_743fd8102804.slice/crio-ff57dbdb84bb09b2d15b749f824bf6e9cb90744e12c593f0fb66571b8b8a3aa4 WatchSource:0}: Error finding container ff57dbdb84bb09b2d15b749f824bf6e9cb90744e12c593f0fb66571b8b8a3aa4: Status 404 returned error can't find the container with id ff57dbdb84bb09b2d15b749f824bf6e9cb90744e12c593f0fb66571b8b8a3aa4
Jul 29 17:59:05.580936 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:05.580860    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml" event={"ID":"04f668b2-4cdb-4c34-9519-743fd8102804","Type":"ContainerStarted","Data":"ff57dbdb84bb09b2d15b749f824bf6e9cb90744e12c593f0fb66571b8b8a3aa4"}
Jul 29 17:59:08.594410 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:08.594367    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml" event={"ID":"04f668b2-4cdb-4c34-9519-743fd8102804","Type":"ContainerStarted","Data":"86af139345c3ee74b47250776d4c677906b90842a194fa3c688d9f214d2b0f00"}
Jul 29 17:59:09.602167 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:09.602131    2567 generic.go:356] "Generic (PLEG): container finished" podID="04f668b2-4cdb-4c34-9519-743fd8102804" containerID="86af139345c3ee74b47250776d4c677906b90842a194fa3c688d9f214d2b0f00" exitCode=0
Jul 29 17:59:09.602567 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:09.602205    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml" event={"ID":"04f668b2-4cdb-4c34-9519-743fd8102804","Type":"ContainerDied","Data":"86af139345c3ee74b47250776d4c677906b90842a194fa3c688d9f214d2b0f00"}
Jul 29 17:59:10.608176 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:10.608133    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml" event={"ID":"04f668b2-4cdb-4c34-9519-743fd8102804","Type":"ContainerStarted","Data":"0885b90f6228136d79c81aac695f51ec4c23c4357b1f80a72fee8f4b027b2f07"}
Jul 29 17:59:10.608591 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:10.608266    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:10.631764 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:10.631703    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml" podStartSLOduration=2.384317267 podStartE2EDuration="6.631683157s" totalImagesPullingTime="3.19692923s" totalInitContainerRuntime="1.05043666s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:59:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:59:10.629955346 +0000 UTC m=+378.978183440" watchObservedRunningTime="2026-07-29 17:59:10.631683157 +0000 UTC m=+378.979911251"
Jul 29 17:59:21.614385 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:21.614351    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml"
Jul 29 17:59:32.310056 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.310023    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"]
Jul 29 17:59:32.314455 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.314437    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:32.318764 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.318738    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 17:59:32.319016 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.318739    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 17:59:32.319127 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.318740    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 17:59:32.319127 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.318811    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n9zcn\""
Jul 29 17:59:32.320464 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.320412    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"]
Jul 29 17:59:32.406501 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.406466    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c93dbda-785f-42b8-902a-259bb5e3eb36-cert\") pod \"lws-controller-manager-8569878f48-sr7ms\" (UID: \"3c93dbda-785f-42b8-902a-259bb5e3eb36\") " pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:32.406741 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.406524    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3c93dbda-785f-42b8-902a-259bb5e3eb36-manager-config\") pod \"lws-controller-manager-8569878f48-sr7ms\" (UID: \"3c93dbda-785f-42b8-902a-259bb5e3eb36\") " pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:32.406741 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.406558    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9gkd\" (UniqueName: \"kubernetes.io/projected/3c93dbda-785f-42b8-902a-259bb5e3eb36-kube-api-access-v9gkd\") pod \"lws-controller-manager-8569878f48-sr7ms\" (UID: \"3c93dbda-785f-42b8-902a-259bb5e3eb36\") " pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:32.406741 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.406629    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c93dbda-785f-42b8-902a-259bb5e3eb36-metrics-cert\") pod \"lws-controller-manager-8569878f48-sr7ms\" (UID: \"3c93dbda-785f-42b8-902a-259bb5e3eb36\") " pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:32.507417 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.507377    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c93dbda-785f-42b8-902a-259bb5e3eb36-metrics-cert\") pod \"lws-controller-manager-8569878f48-sr7ms\" (UID: \"3c93dbda-785f-42b8-902a-259bb5e3eb36\") " pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:32.507608 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.507442    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c93dbda-785f-42b8-902a-259bb5e3eb36-cert\") pod \"lws-controller-manager-8569878f48-sr7ms\" (UID: \"3c93dbda-785f-42b8-902a-259bb5e3eb36\") " pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:32.507608 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.507470    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3c93dbda-785f-42b8-902a-259bb5e3eb36-manager-config\") pod \"lws-controller-manager-8569878f48-sr7ms\" (UID: \"3c93dbda-785f-42b8-902a-259bb5e3eb36\") " pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:32.507608 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.507490    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9gkd\" (UniqueName: \"kubernetes.io/projected/3c93dbda-785f-42b8-902a-259bb5e3eb36-kube-api-access-v9gkd\") pod \"lws-controller-manager-8569878f48-sr7ms\" (UID: \"3c93dbda-785f-42b8-902a-259bb5e3eb36\") " pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:32.508271 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.508251    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3c93dbda-785f-42b8-902a-259bb5e3eb36-manager-config\") pod \"lws-controller-manager-8569878f48-sr7ms\" (UID: \"3c93dbda-785f-42b8-902a-259bb5e3eb36\") " pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:32.509937 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.509913    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c93dbda-785f-42b8-902a-259bb5e3eb36-cert\") pod \"lws-controller-manager-8569878f48-sr7ms\" (UID: \"3c93dbda-785f-42b8-902a-259bb5e3eb36\") " pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:32.510033 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.509981    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c93dbda-785f-42b8-902a-259bb5e3eb36-metrics-cert\") pod \"lws-controller-manager-8569878f48-sr7ms\" (UID: \"3c93dbda-785f-42b8-902a-259bb5e3eb36\") " pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:32.516283 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.516265    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9gkd\" (UniqueName: \"kubernetes.io/projected/3c93dbda-785f-42b8-902a-259bb5e3eb36-kube-api-access-v9gkd\") pod \"lws-controller-manager-8569878f48-sr7ms\" (UID: \"3c93dbda-785f-42b8-902a-259bb5e3eb36\") " pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:32.624639 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.624548    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:32.753008 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:32.752967    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"]
Jul 29 17:59:32.755737 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:59:32.755701    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c93dbda_785f_42b8_902a_259bb5e3eb36.slice/crio-85efc33835e654b08bd3402109943f925e6c40850414bea8ee77ebacff3f5c97 WatchSource:0}: Error finding container 85efc33835e654b08bd3402109943f925e6c40850414bea8ee77ebacff3f5c97: Status 404 returned error can't find the container with id 85efc33835e654b08bd3402109943f925e6c40850414bea8ee77ebacff3f5c97
Jul 29 17:59:33.708694 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:33.708653    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms" event={"ID":"3c93dbda-785f-42b8-902a-259bb5e3eb36","Type":"ContainerStarted","Data":"85efc33835e654b08bd3402109943f925e6c40850414bea8ee77ebacff3f5c97"}
Jul 29 17:59:34.714703 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:34.714601    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms" event={"ID":"3c93dbda-785f-42b8-902a-259bb5e3eb36","Type":"ContainerStarted","Data":"367c1abc5439c6fdd2882d92dce92bbf14885bda501780acf9a1c2bcac9568a5"}
Jul 29 17:59:34.715173 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:34.714754    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:34.749904 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:34.749845    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms" podStartSLOduration=1.148387653 podStartE2EDuration="2.74982766s" totalImagesPullingTime="1.601440007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:59:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:59:34.747962094 +0000 UTC m=+403.096190189" watchObservedRunningTime="2026-07-29 17:59:34.74982766 +0000 UTC m=+403.098055752"
Jul 29 17:59:42.710269 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.710231    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"]
Jul 29 17:59:42.717968 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.717944    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.720702 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.720679    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vp8r5\""
Jul 29 17:59:42.720840 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.720731    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 17:59:42.725081 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.725053    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"]
Jul 29 17:59:42.896158 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.896120    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d52d534-163f-4912-8c23-1cae4aa6f65f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.896350 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.896172    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d534-163f-4912-8c23-1cae4aa6f65f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.896350 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.896193    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d52d534-163f-4912-8c23-1cae4aa6f65f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.896350 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.896219    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d52d534-163f-4912-8c23-1cae4aa6f65f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.896350 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.896252    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d534-163f-4912-8c23-1cae4aa6f65f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.896350 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.896274    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dgjp\" (UniqueName: \"kubernetes.io/projected/6d52d534-163f-4912-8c23-1cae4aa6f65f-kube-api-access-6dgjp\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.896350 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.896335    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d52d534-163f-4912-8c23-1cae4aa6f65f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.896567 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.896356    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d52d534-163f-4912-8c23-1cae4aa6f65f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.896567 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.896383    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d52d534-163f-4912-8c23-1cae4aa6f65f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.997582 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.997546    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d534-163f-4912-8c23-1cae4aa6f65f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.997755 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.997591    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d52d534-163f-4912-8c23-1cae4aa6f65f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.997755 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.997619    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d52d534-163f-4912-8c23-1cae4aa6f65f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.997755 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.997655    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d534-163f-4912-8c23-1cae4aa6f65f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.997755 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.997686    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dgjp\" (UniqueName: \"kubernetes.io/projected/6d52d534-163f-4912-8c23-1cae4aa6f65f-kube-api-access-6dgjp\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.997755 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.997734    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d52d534-163f-4912-8c23-1cae4aa6f65f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.998008 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.997756    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d52d534-163f-4912-8c23-1cae4aa6f65f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.998008 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.997789    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d52d534-163f-4912-8c23-1cae4aa6f65f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.998008 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.997848    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d52d534-163f-4912-8c23-1cae4aa6f65f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.998149 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.998024    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d534-163f-4912-8c23-1cae4aa6f65f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.998149 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.998058    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d52d534-163f-4912-8c23-1cae4aa6f65f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.998256 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.998164    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52d534-163f-4912-8c23-1cae4aa6f65f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.998256 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.998234    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d52d534-163f-4912-8c23-1cae4aa6f65f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:42.998688 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:42.998667    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d52d534-163f-4912-8c23-1cae4aa6f65f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:43.000123 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:43.000103    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d52d534-163f-4912-8c23-1cae4aa6f65f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:43.000374 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:43.000353    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d52d534-163f-4912-8c23-1cae4aa6f65f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:43.006706 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:43.006678    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d52d534-163f-4912-8c23-1cae4aa6f65f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:43.006789 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:43.006682    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dgjp\" (UniqueName: \"kubernetes.io/projected/6d52d534-163f-4912-8c23-1cae4aa6f65f-kube-api-access-6dgjp\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v\" (UID: \"6d52d534-163f-4912-8c23-1cae4aa6f65f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:43.030856 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:43.030818    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:43.170797 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:43.170770    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"]
Jul 29 17:59:43.172710 ip-10-0-138-0 kubenswrapper[2567]: W0729 17:59:43.172681    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d52d534_163f_4912_8c23_1cae4aa6f65f.slice/crio-0f8763f98374e959e43fd1abbac3af50e8f2be44b2ee8caecc4021d3b8b92f0c WatchSource:0}: Error finding container 0f8763f98374e959e43fd1abbac3af50e8f2be44b2ee8caecc4021d3b8b92f0c: Status 404 returned error can't find the container with id 0f8763f98374e959e43fd1abbac3af50e8f2be44b2ee8caecc4021d3b8b92f0c
Jul 29 17:59:43.754286 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:43.754245    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v" event={"ID":"6d52d534-163f-4912-8c23-1cae4aa6f65f","Type":"ContainerStarted","Data":"0f8763f98374e959e43fd1abbac3af50e8f2be44b2ee8caecc4021d3b8b92f0c"}
Jul 29 17:59:45.721648 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:45.721613    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8569878f48-sr7ms"
Jul 29 17:59:46.197558 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:46.197515    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 17:59:46.197632 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:46.197601    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 17:59:46.197671 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:46.197632    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 17:59:46.770671 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:46.770639    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v" event={"ID":"6d52d534-163f-4912-8c23-1cae4aa6f65f","Type":"ContainerStarted","Data":"f0a0e12c7bec5091af39434f6b004b7efbf1b871d3fa331c7b5ef6fcbd012ca1"}
Jul 29 17:59:46.792066 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:46.792009    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v" podStartSLOduration=1.769609187 podStartE2EDuration="4.791979928s" totalImagesPullingTime="3.022370741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:59:46.790131821 +0000 UTC m=+415.138359929" watchObservedRunningTime="2026-07-29 17:59:46.791979928 +0000 UTC m=+415.140208020"
Jul 29 17:59:47.031797 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:47.031691    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:47.036250 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:47.036223    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:47.775443 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:47.775412    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 17:59:47.776498 ip-10-0-138-0 kubenswrapper[2567]: I0729 17:59:47.776476    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v"
Jul 29 18:00:25.033105 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.033020    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ssrxw"]
Jul 29 18:00:25.050061 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.050025    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ssrxw"
Jul 29 18:00:25.051796 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.051764    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ssrxw"]
Jul 29 18:00:25.053218 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.053193    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 18:00:25.053394 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.053301    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 18:00:25.054533 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.054509    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-tlq5f\""
Jul 29 18:00:25.140888 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.140853    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq8kq\" (UniqueName: \"kubernetes.io/projected/d53e5c24-dda2-489b-a353-9c7c1581e4af-kube-api-access-kq8kq\") pod \"kuadrant-operator-catalog-ssrxw\" (UID: \"d53e5c24-dda2-489b-a353-9c7c1581e4af\") " pod="kuadrant-system/kuadrant-operator-catalog-ssrxw"
Jul 29 18:00:25.242239 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.242193    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq8kq\" (UniqueName: \"kubernetes.io/projected/d53e5c24-dda2-489b-a353-9c7c1581e4af-kube-api-access-kq8kq\") pod \"kuadrant-operator-catalog-ssrxw\" (UID: \"d53e5c24-dda2-489b-a353-9c7c1581e4af\") " pod="kuadrant-system/kuadrant-operator-catalog-ssrxw"
Jul 29 18:00:25.260568 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.260530    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq8kq\" (UniqueName: \"kubernetes.io/projected/d53e5c24-dda2-489b-a353-9c7c1581e4af-kube-api-access-kq8kq\") pod \"kuadrant-operator-catalog-ssrxw\" (UID: \"d53e5c24-dda2-489b-a353-9c7c1581e4af\") " pod="kuadrant-system/kuadrant-operator-catalog-ssrxw"
Jul 29 18:00:25.360696 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.360601    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ssrxw"
Jul 29 18:00:25.385527 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.385496    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ssrxw"]
Jul 29 18:00:25.498492 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.498462    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ssrxw"]
Jul 29 18:00:25.500962 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:00:25.500935    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53e5c24_dda2_489b_a353_9c7c1581e4af.slice/crio-1711f9246305e15fab3c580d916fcf8d66f6116c21316fec5e3fc9808a8cb18c WatchSource:0}: Error finding container 1711f9246305e15fab3c580d916fcf8d66f6116c21316fec5e3fc9808a8cb18c: Status 404 returned error can't find the container with id 1711f9246305e15fab3c580d916fcf8d66f6116c21316fec5e3fc9808a8cb18c
Jul 29 18:00:25.589759 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.589724    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5rq96"]
Jul 29 18:00:25.594589 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.594569    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5rq96"
Jul 29 18:00:25.603951 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.603921    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5rq96"]
Jul 29 18:00:25.746027 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.745974    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdfqb\" (UniqueName: \"kubernetes.io/projected/00692e16-0f8f-4cd7-9cb6-a907f7e279e0-kube-api-access-vdfqb\") pod \"kuadrant-operator-catalog-5rq96\" (UID: \"00692e16-0f8f-4cd7-9cb6-a907f7e279e0\") " pod="kuadrant-system/kuadrant-operator-catalog-5rq96"
Jul 29 18:00:25.847249 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.847209    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdfqb\" (UniqueName: \"kubernetes.io/projected/00692e16-0f8f-4cd7-9cb6-a907f7e279e0-kube-api-access-vdfqb\") pod \"kuadrant-operator-catalog-5rq96\" (UID: \"00692e16-0f8f-4cd7-9cb6-a907f7e279e0\") " pod="kuadrant-system/kuadrant-operator-catalog-5rq96"
Jul 29 18:00:25.857304 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.857281    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdfqb\" (UniqueName: \"kubernetes.io/projected/00692e16-0f8f-4cd7-9cb6-a907f7e279e0-kube-api-access-vdfqb\") pod \"kuadrant-operator-catalog-5rq96\" (UID: \"00692e16-0f8f-4cd7-9cb6-a907f7e279e0\") " pod="kuadrant-system/kuadrant-operator-catalog-5rq96"
Jul 29 18:00:25.904407 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.904365    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5rq96"
Jul 29 18:00:25.940582 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:25.940543    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ssrxw" event={"ID":"d53e5c24-dda2-489b-a353-9c7c1581e4af","Type":"ContainerStarted","Data":"1711f9246305e15fab3c580d916fcf8d66f6116c21316fec5e3fc9808a8cb18c"}
Jul 29 18:00:26.039527 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:26.039397    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5rq96"]
Jul 29 18:00:26.042181 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:00:26.042149    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00692e16_0f8f_4cd7_9cb6_a907f7e279e0.slice/crio-bca192e8859a8ada15d2e85b8b5413229a1a106fc6bf9df9fa444dd4e15f26a2 WatchSource:0}: Error finding container bca192e8859a8ada15d2e85b8b5413229a1a106fc6bf9df9fa444dd4e15f26a2: Status 404 returned error can't find the container with id bca192e8859a8ada15d2e85b8b5413229a1a106fc6bf9df9fa444dd4e15f26a2
Jul 29 18:00:26.946390 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:26.946354    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5rq96" event={"ID":"00692e16-0f8f-4cd7-9cb6-a907f7e279e0","Type":"ContainerStarted","Data":"bca192e8859a8ada15d2e85b8b5413229a1a106fc6bf9df9fa444dd4e15f26a2"}
Jul 29 18:00:28.957609 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:28.957568    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ssrxw" event={"ID":"d53e5c24-dda2-489b-a353-9c7c1581e4af","Type":"ContainerStarted","Data":"5913664e6b2ebae7e648161a1bb649fffffbb7f689e499d8359ad14ce20fbef8"}
Jul 29 18:00:28.958124 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:28.957665    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ssrxw" podUID="d53e5c24-dda2-489b-a353-9c7c1581e4af" containerName="registry-server" containerID="cri-o://5913664e6b2ebae7e648161a1bb649fffffbb7f689e499d8359ad14ce20fbef8" gracePeriod=2
Jul 29 18:00:28.959094 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:28.959063    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5rq96" event={"ID":"00692e16-0f8f-4cd7-9cb6-a907f7e279e0","Type":"ContainerStarted","Data":"cfd4ac17851678436fc10225c52948ff4d2c05d6d9fad63da5c06f4384d42a59"}
Jul 29 18:00:28.980777 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:28.980727    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ssrxw" podStartSLOduration=1.364516107 podStartE2EDuration="3.980709227s" totalImagesPullingTime="2.61619312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:00:28.978967384 +0000 UTC m=+457.327195478" watchObservedRunningTime="2026-07-29 18:00:28.980709227 +0000 UTC m=+457.328937320"
Jul 29 18:00:29.001480 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:28.998022    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5rq96" podStartSLOduration=1.922505695 podStartE2EDuration="3.997984258s" totalImagesPullingTime="2.075478563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:00:28.995838927 +0000 UTC m=+457.344067021" watchObservedRunningTime="2026-07-29 18:00:28.997984258 +0000 UTC m=+457.346212354"
Jul 29 18:00:29.201664 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:29.201637    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ssrxw"
Jul 29 18:00:29.278736 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:29.278696    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq8kq\" (UniqueName: \"kubernetes.io/projected/d53e5c24-dda2-489b-a353-9c7c1581e4af-kube-api-access-kq8kq\") pod \"d53e5c24-dda2-489b-a353-9c7c1581e4af\" (UID: \"d53e5c24-dda2-489b-a353-9c7c1581e4af\") "
Jul 29 18:00:29.280905 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:29.280870    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d53e5c24-dda2-489b-a353-9c7c1581e4af-kube-api-access-kq8kq" (OuterVolumeSpecName: "kube-api-access-kq8kq") pod "d53e5c24-dda2-489b-a353-9c7c1581e4af" (UID: "d53e5c24-dda2-489b-a353-9c7c1581e4af"). InnerVolumeSpecName "kube-api-access-kq8kq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:00:29.380256 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:29.380216    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq8kq\" (UniqueName: \"kubernetes.io/projected/d53e5c24-dda2-489b-a353-9c7c1581e4af-kube-api-access-kq8kq\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:00:29.964145 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:29.964110    2567 generic.go:356] "Generic (PLEG): container finished" podID="d53e5c24-dda2-489b-a353-9c7c1581e4af" containerID="5913664e6b2ebae7e648161a1bb649fffffbb7f689e499d8359ad14ce20fbef8" exitCode=0
Jul 29 18:00:29.964544 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:29.964155    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ssrxw"
Jul 29 18:00:29.964544 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:29.964204    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ssrxw" event={"ID":"d53e5c24-dda2-489b-a353-9c7c1581e4af","Type":"ContainerDied","Data":"5913664e6b2ebae7e648161a1bb649fffffbb7f689e499d8359ad14ce20fbef8"}
Jul 29 18:00:29.964544 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:29.964286    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ssrxw" event={"ID":"d53e5c24-dda2-489b-a353-9c7c1581e4af","Type":"ContainerDied","Data":"1711f9246305e15fab3c580d916fcf8d66f6116c21316fec5e3fc9808a8cb18c"}
Jul 29 18:00:29.964544 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:29.964310    2567 scope.go:117] "RemoveContainer" containerID="5913664e6b2ebae7e648161a1bb649fffffbb7f689e499d8359ad14ce20fbef8"
Jul 29 18:00:29.973347 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:29.973329    2567 scope.go:117] "RemoveContainer" containerID="5913664e6b2ebae7e648161a1bb649fffffbb7f689e499d8359ad14ce20fbef8"
Jul 29 18:00:29.973609 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:00:29.973592    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5913664e6b2ebae7e648161a1bb649fffffbb7f689e499d8359ad14ce20fbef8\": container with ID starting with 5913664e6b2ebae7e648161a1bb649fffffbb7f689e499d8359ad14ce20fbef8 not found: ID does not exist" containerID="5913664e6b2ebae7e648161a1bb649fffffbb7f689e499d8359ad14ce20fbef8"
Jul 29 18:00:29.973663 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:29.973619    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5913664e6b2ebae7e648161a1bb649fffffbb7f689e499d8359ad14ce20fbef8"} err="failed to get container status \"5913664e6b2ebae7e648161a1bb649fffffbb7f689e499d8359ad14ce20fbef8\": rpc error: code = NotFound desc = could not find container \"5913664e6b2ebae7e648161a1bb649fffffbb7f689e499d8359ad14ce20fbef8\": container with ID starting with 5913664e6b2ebae7e648161a1bb649fffffbb7f689e499d8359ad14ce20fbef8 not found: ID does not exist"
Jul 29 18:00:29.985646 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:29.985616    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ssrxw"]
Jul 29 18:00:29.989429 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:29.989396    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ssrxw"]
Jul 29 18:00:30.073376 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:30.073346    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d53e5c24-dda2-489b-a353-9c7c1581e4af" path="/var/lib/kubelet/pods/d53e5c24-dda2-489b-a353-9c7c1581e4af/volumes"
Jul 29 18:00:35.905261 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:35.905216    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5rq96"
Jul 29 18:00:35.905747 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:35.905328    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5rq96"
Jul 29 18:00:35.926874 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:35.926848    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5rq96"
Jul 29 18:00:36.012299 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:36.012273    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5rq96"
Jul 29 18:00:37.434090 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.434043    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"]
Jul 29 18:00:37.434575 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.434462    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53e5c24-dda2-489b-a353-9c7c1581e4af" containerName="registry-server"
Jul 29 18:00:37.434575 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.434480    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53e5c24-dda2-489b-a353-9c7c1581e4af" containerName="registry-server"
Jul 29 18:00:37.434695 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.434579    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d53e5c24-dda2-489b-a353-9c7c1581e4af" containerName="registry-server"
Jul 29 18:00:37.439041 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.439020    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"
Jul 29 18:00:37.441886 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.441863    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mxn6k\""
Jul 29 18:00:37.447606 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.447583    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"]
Jul 29 18:00:37.550452 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.550407    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff48fc0e-864b-49e9-b585-43c56255c49b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l\" (UID: \"ff48fc0e-864b-49e9-b585-43c56255c49b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"
Jul 29 18:00:37.550632 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.550464    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l85wc\" (UniqueName: \"kubernetes.io/projected/ff48fc0e-864b-49e9-b585-43c56255c49b-kube-api-access-l85wc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l\" (UID: \"ff48fc0e-864b-49e9-b585-43c56255c49b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"
Jul 29 18:00:37.550632 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.550493    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff48fc0e-864b-49e9-b585-43c56255c49b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l\" (UID: \"ff48fc0e-864b-49e9-b585-43c56255c49b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"
Jul 29 18:00:37.651378 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.651344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff48fc0e-864b-49e9-b585-43c56255c49b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l\" (UID: \"ff48fc0e-864b-49e9-b585-43c56255c49b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"
Jul 29 18:00:37.651556 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.651397    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l85wc\" (UniqueName: \"kubernetes.io/projected/ff48fc0e-864b-49e9-b585-43c56255c49b-kube-api-access-l85wc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l\" (UID: \"ff48fc0e-864b-49e9-b585-43c56255c49b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"
Jul 29 18:00:37.651556 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.651513    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff48fc0e-864b-49e9-b585-43c56255c49b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l\" (UID: \"ff48fc0e-864b-49e9-b585-43c56255c49b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"
Jul 29 18:00:37.651755 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.651730    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff48fc0e-864b-49e9-b585-43c56255c49b-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l\" (UID: \"ff48fc0e-864b-49e9-b585-43c56255c49b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"
Jul 29 18:00:37.651877 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.651856    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff48fc0e-864b-49e9-b585-43c56255c49b-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l\" (UID: \"ff48fc0e-864b-49e9-b585-43c56255c49b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"
Jul 29 18:00:37.660141 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.660111    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l85wc\" (UniqueName: \"kubernetes.io/projected/ff48fc0e-864b-49e9-b585-43c56255c49b-kube-api-access-l85wc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l\" (UID: \"ff48fc0e-864b-49e9-b585-43c56255c49b\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"
Jul 29 18:00:37.749216 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.749175    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"
Jul 29 18:00:37.884349 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:37.884323    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"]
Jul 29 18:00:37.886724 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:00:37.886685    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff48fc0e_864b_49e9_b585_43c56255c49b.slice/crio-7daaf1266f02c5a03cb64618cf6a714e7e56ea49c5b3cdbb57d0ea63ec1c3255 WatchSource:0}: Error finding container 7daaf1266f02c5a03cb64618cf6a714e7e56ea49c5b3cdbb57d0ea63ec1c3255: Status 404 returned error can't find the container with id 7daaf1266f02c5a03cb64618cf6a714e7e56ea49c5b3cdbb57d0ea63ec1c3255
Jul 29 18:00:38.001906 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.001809    2567 generic.go:356] "Generic (PLEG): container finished" podID="ff48fc0e-864b-49e9-b585-43c56255c49b" containerID="78ab67ab80b1e4911f7b7cf14eae33c0f24b6f8ffbc33c5776617e270d10a71e" exitCode=0
Jul 29 18:00:38.001906 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.001851    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l" event={"ID":"ff48fc0e-864b-49e9-b585-43c56255c49b","Type":"ContainerDied","Data":"78ab67ab80b1e4911f7b7cf14eae33c0f24b6f8ffbc33c5776617e270d10a71e"}
Jul 29 18:00:38.001906 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.001896    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l" event={"ID":"ff48fc0e-864b-49e9-b585-43c56255c49b","Type":"ContainerStarted","Data":"7daaf1266f02c5a03cb64618cf6a714e7e56ea49c5b3cdbb57d0ea63ec1c3255"}
Jul 29 18:00:38.227263 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.227226    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"]
Jul 29 18:00:38.230852 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.230835    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"
Jul 29 18:00:38.241007 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.240971    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"]
Jul 29 18:00:38.358948 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.358856    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5baa1188-cee1-430c-a28e-1aa54be9f162-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn\" (UID: \"5baa1188-cee1-430c-a28e-1aa54be9f162\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"
Jul 29 18:00:38.358948 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.358898    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcv2j\" (UniqueName: \"kubernetes.io/projected/5baa1188-cee1-430c-a28e-1aa54be9f162-kube-api-access-pcv2j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn\" (UID: \"5baa1188-cee1-430c-a28e-1aa54be9f162\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"
Jul 29 18:00:38.359180 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.359014    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5baa1188-cee1-430c-a28e-1aa54be9f162-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn\" (UID: \"5baa1188-cee1-430c-a28e-1aa54be9f162\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"
Jul 29 18:00:38.460332 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.460294    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5baa1188-cee1-430c-a28e-1aa54be9f162-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn\" (UID: \"5baa1188-cee1-430c-a28e-1aa54be9f162\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"
Jul 29 18:00:38.460705 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.460339    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcv2j\" (UniqueName: \"kubernetes.io/projected/5baa1188-cee1-430c-a28e-1aa54be9f162-kube-api-access-pcv2j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn\" (UID: \"5baa1188-cee1-430c-a28e-1aa54be9f162\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"
Jul 29 18:00:38.460705 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.460402    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5baa1188-cee1-430c-a28e-1aa54be9f162-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn\" (UID: \"5baa1188-cee1-430c-a28e-1aa54be9f162\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"
Jul 29 18:00:38.460776 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.460754    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5baa1188-cee1-430c-a28e-1aa54be9f162-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn\" (UID: \"5baa1188-cee1-430c-a28e-1aa54be9f162\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"
Jul 29 18:00:38.460810 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.460754    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5baa1188-cee1-430c-a28e-1aa54be9f162-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn\" (UID: \"5baa1188-cee1-430c-a28e-1aa54be9f162\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"
Jul 29 18:00:38.469839 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.469805    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcv2j\" (UniqueName: \"kubernetes.io/projected/5baa1188-cee1-430c-a28e-1aa54be9f162-kube-api-access-pcv2j\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn\" (UID: \"5baa1188-cee1-430c-a28e-1aa54be9f162\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"
Jul 29 18:00:38.540571 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.540534    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"
Jul 29 18:00:38.681591 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.681568    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"]
Jul 29 18:00:38.683202 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:00:38.683177    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5baa1188_cee1_430c_a28e_1aa54be9f162.slice/crio-ec9bf61bf45c6026b111d140958ea86e5bd3b638ac2a15e6def5409aa749b535 WatchSource:0}: Error finding container ec9bf61bf45c6026b111d140958ea86e5bd3b638ac2a15e6def5409aa749b535: Status 404 returned error can't find the container with id ec9bf61bf45c6026b111d140958ea86e5bd3b638ac2a15e6def5409aa749b535
Jul 29 18:00:38.842420 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.842384    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"]
Jul 29 18:00:38.847022 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.846977    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"
Jul 29 18:00:38.854393 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.854361    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"]
Jul 29 18:00:38.965177 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.965140    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c12d3af-60a3-4eec-b668-ade3c3817d29-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9\" (UID: \"4c12d3af-60a3-4eec-b668-ade3c3817d29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"
Jul 29 18:00:38.965341 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.965181    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c12d3af-60a3-4eec-b668-ade3c3817d29-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9\" (UID: \"4c12d3af-60a3-4eec-b668-ade3c3817d29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"
Jul 29 18:00:38.965341 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:38.965206    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wnn2\" (UniqueName: \"kubernetes.io/projected/4c12d3af-60a3-4eec-b668-ade3c3817d29-kube-api-access-9wnn2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9\" (UID: \"4c12d3af-60a3-4eec-b668-ade3c3817d29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"
Jul 29 18:00:39.008611 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.008573    2567 generic.go:356] "Generic (PLEG): container finished" podID="ff48fc0e-864b-49e9-b585-43c56255c49b" containerID="1e3213d9ccdd247837399e0a714fa1081d95475ca722285242719c0d1f4eedef" exitCode=0
Jul 29 18:00:39.008803 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.008663    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l" event={"ID":"ff48fc0e-864b-49e9-b585-43c56255c49b","Type":"ContainerDied","Data":"1e3213d9ccdd247837399e0a714fa1081d95475ca722285242719c0d1f4eedef"}
Jul 29 18:00:39.010203 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.010178    2567 generic.go:356] "Generic (PLEG): container finished" podID="5baa1188-cee1-430c-a28e-1aa54be9f162" containerID="0ddfb9d5f4a50abbff3f0fb2bc04d4c0988e1d9cf56d98e2c5e2e0c82864aa2d" exitCode=0
Jul 29 18:00:39.010354 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.010214    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn" event={"ID":"5baa1188-cee1-430c-a28e-1aa54be9f162","Type":"ContainerDied","Data":"0ddfb9d5f4a50abbff3f0fb2bc04d4c0988e1d9cf56d98e2c5e2e0c82864aa2d"}
Jul 29 18:00:39.010354 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.010266    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn" event={"ID":"5baa1188-cee1-430c-a28e-1aa54be9f162","Type":"ContainerStarted","Data":"ec9bf61bf45c6026b111d140958ea86e5bd3b638ac2a15e6def5409aa749b535"}
Jul 29 18:00:39.066143 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.066110    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c12d3af-60a3-4eec-b668-ade3c3817d29-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9\" (UID: \"4c12d3af-60a3-4eec-b668-ade3c3817d29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"
Jul 29 18:00:39.066266 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.066153    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c12d3af-60a3-4eec-b668-ade3c3817d29-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9\" (UID: \"4c12d3af-60a3-4eec-b668-ade3c3817d29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"
Jul 29 18:00:39.066266 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.066173    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wnn2\" (UniqueName: \"kubernetes.io/projected/4c12d3af-60a3-4eec-b668-ade3c3817d29-kube-api-access-9wnn2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9\" (UID: \"4c12d3af-60a3-4eec-b668-ade3c3817d29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"
Jul 29 18:00:39.066570 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.066545    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c12d3af-60a3-4eec-b668-ade3c3817d29-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9\" (UID: \"4c12d3af-60a3-4eec-b668-ade3c3817d29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"
Jul 29 18:00:39.066629 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.066593    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c12d3af-60a3-4eec-b668-ade3c3817d29-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9\" (UID: \"4c12d3af-60a3-4eec-b668-ade3c3817d29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"
Jul 29 18:00:39.074874 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.074849    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wnn2\" (UniqueName: \"kubernetes.io/projected/4c12d3af-60a3-4eec-b668-ade3c3817d29-kube-api-access-9wnn2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9\" (UID: \"4c12d3af-60a3-4eec-b668-ade3c3817d29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"
Jul 29 18:00:39.188053 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.187937    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"
Jul 29 18:00:39.345222 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.345191    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"]
Jul 29 18:00:39.347697 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:00:39.347672    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c12d3af_60a3_4eec_b668_ade3c3817d29.slice/crio-cb5cb544fda25ab8a7eec8c89a8d223c9157deaba2f2e6b198c3ff7d9f8cda4b WatchSource:0}: Error finding container cb5cb544fda25ab8a7eec8c89a8d223c9157deaba2f2e6b198c3ff7d9f8cda4b: Status 404 returned error can't find the container with id cb5cb544fda25ab8a7eec8c89a8d223c9157deaba2f2e6b198c3ff7d9f8cda4b
Jul 29 18:00:39.449346 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.449315    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"]
Jul 29 18:00:39.452548 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.452528    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"
Jul 29 18:00:39.464606 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.464571    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"]
Jul 29 18:00:39.572633 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.572587    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/553b34ee-747c-41f8-8858-f2023e99d400-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc\" (UID: \"553b34ee-747c-41f8-8858-f2023e99d400\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"
Jul 29 18:00:39.572821 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.572637    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqktf\" (UniqueName: \"kubernetes.io/projected/553b34ee-747c-41f8-8858-f2023e99d400-kube-api-access-kqktf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc\" (UID: \"553b34ee-747c-41f8-8858-f2023e99d400\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"
Jul 29 18:00:39.572821 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.572725    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/553b34ee-747c-41f8-8858-f2023e99d400-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc\" (UID: \"553b34ee-747c-41f8-8858-f2023e99d400\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"
Jul 29 18:00:39.673439 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.673405    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/553b34ee-747c-41f8-8858-f2023e99d400-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc\" (UID: \"553b34ee-747c-41f8-8858-f2023e99d400\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"
Jul 29 18:00:39.673603 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.673453    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqktf\" (UniqueName: \"kubernetes.io/projected/553b34ee-747c-41f8-8858-f2023e99d400-kube-api-access-kqktf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc\" (UID: \"553b34ee-747c-41f8-8858-f2023e99d400\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"
Jul 29 18:00:39.673603 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.673501    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/553b34ee-747c-41f8-8858-f2023e99d400-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc\" (UID: \"553b34ee-747c-41f8-8858-f2023e99d400\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"
Jul 29 18:00:39.673805 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.673784    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/553b34ee-747c-41f8-8858-f2023e99d400-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc\" (UID: \"553b34ee-747c-41f8-8858-f2023e99d400\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"
Jul 29 18:00:39.673872 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.673855    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/553b34ee-747c-41f8-8858-f2023e99d400-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc\" (UID: \"553b34ee-747c-41f8-8858-f2023e99d400\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"
Jul 29 18:00:39.687852 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.687821    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqktf\" (UniqueName: \"kubernetes.io/projected/553b34ee-747c-41f8-8858-f2023e99d400-kube-api-access-kqktf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc\" (UID: \"553b34ee-747c-41f8-8858-f2023e99d400\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"
Jul 29 18:00:39.807962 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.807926    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"
Jul 29 18:00:39.942217 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:39.942181    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"]
Jul 29 18:00:39.943498 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:00:39.943470    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553b34ee_747c_41f8_8858_f2023e99d400.slice/crio-7d8c06c5a0d1c790555115cfdb20cee10f7ae67aecbff1e778f2fee1c6306268 WatchSource:0}: Error finding container 7d8c06c5a0d1c790555115cfdb20cee10f7ae67aecbff1e778f2fee1c6306268: Status 404 returned error can't find the container with id 7d8c06c5a0d1c790555115cfdb20cee10f7ae67aecbff1e778f2fee1c6306268
Jul 29 18:00:40.017109 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:40.017077    2567 generic.go:356] "Generic (PLEG): container finished" podID="4c12d3af-60a3-4eec-b668-ade3c3817d29" containerID="ac2284cd43cdacd22ece7728c333d7db9281f435d78b5b19f508118597580e3b" exitCode=0
Jul 29 18:00:40.017305 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:40.017163    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9" event={"ID":"4c12d3af-60a3-4eec-b668-ade3c3817d29","Type":"ContainerDied","Data":"ac2284cd43cdacd22ece7728c333d7db9281f435d78b5b19f508118597580e3b"}
Jul 29 18:00:40.017305 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:40.017217    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9" event={"ID":"4c12d3af-60a3-4eec-b668-ade3c3817d29","Type":"ContainerStarted","Data":"cb5cb544fda25ab8a7eec8c89a8d223c9157deaba2f2e6b198c3ff7d9f8cda4b"}
Jul 29 18:00:40.018919 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:40.018893    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc" event={"ID":"553b34ee-747c-41f8-8858-f2023e99d400","Type":"ContainerStarted","Data":"048e3ae60fc9c158c1820c7469dfb468d4168e3a80745604b07de971003f0858"}
Jul 29 18:00:40.019052 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:40.018939    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc" event={"ID":"553b34ee-747c-41f8-8858-f2023e99d400","Type":"ContainerStarted","Data":"7d8c06c5a0d1c790555115cfdb20cee10f7ae67aecbff1e778f2fee1c6306268"}
Jul 29 18:00:40.021372 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:40.021346    2567 generic.go:356] "Generic (PLEG): container finished" podID="ff48fc0e-864b-49e9-b585-43c56255c49b" containerID="b0d8ba0cd7a844ba2b78423152747c4d52fc06762542c21ce038fc89636a0d44" exitCode=0
Jul 29 18:00:40.021471 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:40.021420    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l" event={"ID":"ff48fc0e-864b-49e9-b585-43c56255c49b","Type":"ContainerDied","Data":"b0d8ba0cd7a844ba2b78423152747c4d52fc06762542c21ce038fc89636a0d44"}
Jul 29 18:00:41.028467 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:41.028428    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9" event={"ID":"4c12d3af-60a3-4eec-b668-ade3c3817d29","Type":"ContainerStarted","Data":"5d736db93f5e7753bfe2bf99b10a1865df159d86feab2effb72e98824b16cb1a"}
Jul 29 18:00:41.029942 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:41.029915    2567 generic.go:356] "Generic (PLEG): container finished" podID="553b34ee-747c-41f8-8858-f2023e99d400" containerID="048e3ae60fc9c158c1820c7469dfb468d4168e3a80745604b07de971003f0858" exitCode=0
Jul 29 18:00:41.030099 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:41.030014    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc" event={"ID":"553b34ee-747c-41f8-8858-f2023e99d400","Type":"ContainerDied","Data":"048e3ae60fc9c158c1820c7469dfb468d4168e3a80745604b07de971003f0858"}
Jul 29 18:00:41.032098 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:41.032070    2567 generic.go:356] "Generic (PLEG): container finished" podID="5baa1188-cee1-430c-a28e-1aa54be9f162" containerID="53144c3ecb4c96f274cd403cafc72ff709f6a0e3df9ddde2b0d60a799faf19f8" exitCode=0
Jul 29 18:00:41.032209 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:41.032099    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn" event={"ID":"5baa1188-cee1-430c-a28e-1aa54be9f162","Type":"ContainerDied","Data":"53144c3ecb4c96f274cd403cafc72ff709f6a0e3df9ddde2b0d60a799faf19f8"}
Jul 29 18:00:41.155459 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:41.155427    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"
Jul 29 18:00:41.289516 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:41.289484    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff48fc0e-864b-49e9-b585-43c56255c49b-util\") pod \"ff48fc0e-864b-49e9-b585-43c56255c49b\" (UID: \"ff48fc0e-864b-49e9-b585-43c56255c49b\") "
Jul 29 18:00:41.289715 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:41.289567    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff48fc0e-864b-49e9-b585-43c56255c49b-bundle\") pod \"ff48fc0e-864b-49e9-b585-43c56255c49b\" (UID: \"ff48fc0e-864b-49e9-b585-43c56255c49b\") "
Jul 29 18:00:41.289715 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:41.289632    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l85wc\" (UniqueName: \"kubernetes.io/projected/ff48fc0e-864b-49e9-b585-43c56255c49b-kube-api-access-l85wc\") pod \"ff48fc0e-864b-49e9-b585-43c56255c49b\" (UID: \"ff48fc0e-864b-49e9-b585-43c56255c49b\") "
Jul 29 18:00:41.290123 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:41.290088    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff48fc0e-864b-49e9-b585-43c56255c49b-bundle" (OuterVolumeSpecName: "bundle") pod "ff48fc0e-864b-49e9-b585-43c56255c49b" (UID: "ff48fc0e-864b-49e9-b585-43c56255c49b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:00:41.291677 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:41.291654    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff48fc0e-864b-49e9-b585-43c56255c49b-kube-api-access-l85wc" (OuterVolumeSpecName: "kube-api-access-l85wc") pod "ff48fc0e-864b-49e9-b585-43c56255c49b" (UID: "ff48fc0e-864b-49e9-b585-43c56255c49b"). InnerVolumeSpecName "kube-api-access-l85wc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:00:41.294319 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:41.294296    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff48fc0e-864b-49e9-b585-43c56255c49b-util" (OuterVolumeSpecName: "util") pod "ff48fc0e-864b-49e9-b585-43c56255c49b" (UID: "ff48fc0e-864b-49e9-b585-43c56255c49b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:00:41.390978 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:41.390941    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l85wc\" (UniqueName: \"kubernetes.io/projected/ff48fc0e-864b-49e9-b585-43c56255c49b-kube-api-access-l85wc\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:00:41.390978 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:41.390973    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff48fc0e-864b-49e9-b585-43c56255c49b-util\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:00:41.390978 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:41.390984    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff48fc0e-864b-49e9-b585-43c56255c49b-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:00:42.039064 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:42.039028    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l"
Jul 29 18:00:42.039470 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:42.039027    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l" event={"ID":"ff48fc0e-864b-49e9-b585-43c56255c49b","Type":"ContainerDied","Data":"7daaf1266f02c5a03cb64618cf6a714e7e56ea49c5b3cdbb57d0ea63ec1c3255"}
Jul 29 18:00:42.039470 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:42.039189    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7daaf1266f02c5a03cb64618cf6a714e7e56ea49c5b3cdbb57d0ea63ec1c3255"
Jul 29 18:00:42.041110 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:42.041080    2567 generic.go:356] "Generic (PLEG): container finished" podID="5baa1188-cee1-430c-a28e-1aa54be9f162" containerID="71ceeeae1f6158323789280e2003224d8302383d246e031459a8c854fd60b08f" exitCode=0
Jul 29 18:00:42.041233 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:42.041112    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn" event={"ID":"5baa1188-cee1-430c-a28e-1aa54be9f162","Type":"ContainerDied","Data":"71ceeeae1f6158323789280e2003224d8302383d246e031459a8c854fd60b08f"}
Jul 29 18:00:42.042893 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:42.042872    2567 generic.go:356] "Generic (PLEG): container finished" podID="4c12d3af-60a3-4eec-b668-ade3c3817d29" containerID="5d736db93f5e7753bfe2bf99b10a1865df159d86feab2effb72e98824b16cb1a" exitCode=0
Jul 29 18:00:42.043028 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:42.042958    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9" event={"ID":"4c12d3af-60a3-4eec-b668-ade3c3817d29","Type":"ContainerDied","Data":"5d736db93f5e7753bfe2bf99b10a1865df159d86feab2effb72e98824b16cb1a"}
Jul 29 18:00:42.044757 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:42.044735    2567 generic.go:356] "Generic (PLEG): container finished" podID="553b34ee-747c-41f8-8858-f2023e99d400" containerID="d443850c61bcf834b64c10fd7408b946decf3c9a552d1819ccbd9640691590cb" exitCode=0
Jul 29 18:00:42.044858 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:42.044787    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc" event={"ID":"553b34ee-747c-41f8-8858-f2023e99d400","Type":"ContainerDied","Data":"d443850c61bcf834b64c10fd7408b946decf3c9a552d1819ccbd9640691590cb"}
Jul 29 18:00:43.052466 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:43.052428    2567 generic.go:356] "Generic (PLEG): container finished" podID="4c12d3af-60a3-4eec-b668-ade3c3817d29" containerID="3345f62f5e8d597aa31cc5edaed008e144cf4b2ab268da3e60d497372b85b404" exitCode=0
Jul 29 18:00:43.052466 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:43.052467    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9" event={"ID":"4c12d3af-60a3-4eec-b668-ade3c3817d29","Type":"ContainerDied","Data":"3345f62f5e8d597aa31cc5edaed008e144cf4b2ab268da3e60d497372b85b404"}
Jul 29 18:00:43.054703 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:43.054673    2567 generic.go:356] "Generic (PLEG): container finished" podID="553b34ee-747c-41f8-8858-f2023e99d400" containerID="ab06ee76435aea1b6672b517db3a3df59fc12d533ce43dce5ae3348e2e94dcf7" exitCode=0
Jul 29 18:00:43.054812 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:43.054745    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc" event={"ID":"553b34ee-747c-41f8-8858-f2023e99d400","Type":"ContainerDied","Data":"ab06ee76435aea1b6672b517db3a3df59fc12d533ce43dce5ae3348e2e94dcf7"}
Jul 29 18:00:43.188512 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:43.188486    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"
Jul 29 18:00:43.307255 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:43.307159    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5baa1188-cee1-430c-a28e-1aa54be9f162-util\") pod \"5baa1188-cee1-430c-a28e-1aa54be9f162\" (UID: \"5baa1188-cee1-430c-a28e-1aa54be9f162\") "
Jul 29 18:00:43.307255 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:43.307234    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcv2j\" (UniqueName: \"kubernetes.io/projected/5baa1188-cee1-430c-a28e-1aa54be9f162-kube-api-access-pcv2j\") pod \"5baa1188-cee1-430c-a28e-1aa54be9f162\" (UID: \"5baa1188-cee1-430c-a28e-1aa54be9f162\") "
Jul 29 18:00:43.307442 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:43.307273    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5baa1188-cee1-430c-a28e-1aa54be9f162-bundle\") pod \"5baa1188-cee1-430c-a28e-1aa54be9f162\" (UID: \"5baa1188-cee1-430c-a28e-1aa54be9f162\") "
Jul 29 18:00:43.307891 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:43.307867    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5baa1188-cee1-430c-a28e-1aa54be9f162-bundle" (OuterVolumeSpecName: "bundle") pod "5baa1188-cee1-430c-a28e-1aa54be9f162" (UID: "5baa1188-cee1-430c-a28e-1aa54be9f162"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:00:43.309375 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:43.309346    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5baa1188-cee1-430c-a28e-1aa54be9f162-kube-api-access-pcv2j" (OuterVolumeSpecName: "kube-api-access-pcv2j") pod "5baa1188-cee1-430c-a28e-1aa54be9f162" (UID: "5baa1188-cee1-430c-a28e-1aa54be9f162"). InnerVolumeSpecName "kube-api-access-pcv2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:00:43.313269 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:43.313244    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5baa1188-cee1-430c-a28e-1aa54be9f162-util" (OuterVolumeSpecName: "util") pod "5baa1188-cee1-430c-a28e-1aa54be9f162" (UID: "5baa1188-cee1-430c-a28e-1aa54be9f162"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:00:43.408294 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:43.408253    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcv2j\" (UniqueName: \"kubernetes.io/projected/5baa1188-cee1-430c-a28e-1aa54be9f162-kube-api-access-pcv2j\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:00:43.408294 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:43.408283    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5baa1188-cee1-430c-a28e-1aa54be9f162-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:00:43.408533 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:43.408315    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5baa1188-cee1-430c-a28e-1aa54be9f162-util\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:00:44.060640 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.060610    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn"
Jul 29 18:00:44.061066 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.060646    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn" event={"ID":"5baa1188-cee1-430c-a28e-1aa54be9f162","Type":"ContainerDied","Data":"ec9bf61bf45c6026b111d140958ea86e5bd3b638ac2a15e6def5409aa749b535"}
Jul 29 18:00:44.061066 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.060698    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec9bf61bf45c6026b111d140958ea86e5bd3b638ac2a15e6def5409aa749b535"
Jul 29 18:00:44.227088 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.226979    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"
Jul 29 18:00:44.229395 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.229369    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"
Jul 29 18:00:44.415433 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.415330    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqktf\" (UniqueName: \"kubernetes.io/projected/553b34ee-747c-41f8-8858-f2023e99d400-kube-api-access-kqktf\") pod \"553b34ee-747c-41f8-8858-f2023e99d400\" (UID: \"553b34ee-747c-41f8-8858-f2023e99d400\") "
Jul 29 18:00:44.415433 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.415392    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wnn2\" (UniqueName: \"kubernetes.io/projected/4c12d3af-60a3-4eec-b668-ade3c3817d29-kube-api-access-9wnn2\") pod \"4c12d3af-60a3-4eec-b668-ade3c3817d29\" (UID: \"4c12d3af-60a3-4eec-b668-ade3c3817d29\") "
Jul 29 18:00:44.415433 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.415422    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c12d3af-60a3-4eec-b668-ade3c3817d29-util\") pod \"4c12d3af-60a3-4eec-b668-ade3c3817d29\" (UID: \"4c12d3af-60a3-4eec-b668-ade3c3817d29\") "
Jul 29 18:00:44.415656 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.415478    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c12d3af-60a3-4eec-b668-ade3c3817d29-bundle\") pod \"4c12d3af-60a3-4eec-b668-ade3c3817d29\" (UID: \"4c12d3af-60a3-4eec-b668-ade3c3817d29\") "
Jul 29 18:00:44.415656 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.415513    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/553b34ee-747c-41f8-8858-f2023e99d400-bundle\") pod \"553b34ee-747c-41f8-8858-f2023e99d400\" (UID: \"553b34ee-747c-41f8-8858-f2023e99d400\") "
Jul 29 18:00:44.415656 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.415562    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/553b34ee-747c-41f8-8858-f2023e99d400-util\") pod \"553b34ee-747c-41f8-8858-f2023e99d400\" (UID: \"553b34ee-747c-41f8-8858-f2023e99d400\") "
Jul 29 18:00:44.416128 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.416097    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c12d3af-60a3-4eec-b668-ade3c3817d29-bundle" (OuterVolumeSpecName: "bundle") pod "4c12d3af-60a3-4eec-b668-ade3c3817d29" (UID: "4c12d3af-60a3-4eec-b668-ade3c3817d29"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:00:44.416273 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.416098    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/553b34ee-747c-41f8-8858-f2023e99d400-bundle" (OuterVolumeSpecName: "bundle") pod "553b34ee-747c-41f8-8858-f2023e99d400" (UID: "553b34ee-747c-41f8-8858-f2023e99d400"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:00:44.417619 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.417588    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c12d3af-60a3-4eec-b668-ade3c3817d29-kube-api-access-9wnn2" (OuterVolumeSpecName: "kube-api-access-9wnn2") pod "4c12d3af-60a3-4eec-b668-ade3c3817d29" (UID: "4c12d3af-60a3-4eec-b668-ade3c3817d29"). InnerVolumeSpecName "kube-api-access-9wnn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:00:44.417868 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.417849    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/553b34ee-747c-41f8-8858-f2023e99d400-kube-api-access-kqktf" (OuterVolumeSpecName: "kube-api-access-kqktf") pod "553b34ee-747c-41f8-8858-f2023e99d400" (UID: "553b34ee-747c-41f8-8858-f2023e99d400"). InnerVolumeSpecName "kube-api-access-kqktf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:00:44.421424 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.421380    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/553b34ee-747c-41f8-8858-f2023e99d400-util" (OuterVolumeSpecName: "util") pod "553b34ee-747c-41f8-8858-f2023e99d400" (UID: "553b34ee-747c-41f8-8858-f2023e99d400"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:00:44.421722 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.421699    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c12d3af-60a3-4eec-b668-ade3c3817d29-util" (OuterVolumeSpecName: "util") pod "4c12d3af-60a3-4eec-b668-ade3c3817d29" (UID: "4c12d3af-60a3-4eec-b668-ade3c3817d29"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:00:44.516195 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.516164    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/553b34ee-747c-41f8-8858-f2023e99d400-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:00:44.516195 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.516189    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/553b34ee-747c-41f8-8858-f2023e99d400-util\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:00:44.516195 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.516198    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqktf\" (UniqueName: \"kubernetes.io/projected/553b34ee-747c-41f8-8858-f2023e99d400-kube-api-access-kqktf\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:00:44.516419 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.516208    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wnn2\" (UniqueName: \"kubernetes.io/projected/4c12d3af-60a3-4eec-b668-ade3c3817d29-kube-api-access-9wnn2\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:00:44.516419 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.516218    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c12d3af-60a3-4eec-b668-ade3c3817d29-util\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:00:44.516419 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:44.516226    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c12d3af-60a3-4eec-b668-ade3c3817d29-bundle\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:00:45.067190 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:45.067159    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9"
Jul 29 18:00:45.067648 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:45.067162    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9" event={"ID":"4c12d3af-60a3-4eec-b668-ade3c3817d29","Type":"ContainerDied","Data":"cb5cb544fda25ab8a7eec8c89a8d223c9157deaba2f2e6b198c3ff7d9f8cda4b"}
Jul 29 18:00:45.067648 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:45.067325    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb5cb544fda25ab8a7eec8c89a8d223c9157deaba2f2e6b198c3ff7d9f8cda4b"
Jul 29 18:00:45.069140 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:45.069112    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc"
Jul 29 18:00:45.069256 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:45.069145    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc" event={"ID":"553b34ee-747c-41f8-8858-f2023e99d400","Type":"ContainerDied","Data":"7d8c06c5a0d1c790555115cfdb20cee10f7ae67aecbff1e778f2fee1c6306268"}
Jul 29 18:00:45.069256 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:45.069175    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d8c06c5a0d1c790555115cfdb20cee10f7ae67aecbff1e778f2fee1c6306268"
Jul 29 18:00:54.213595 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.213542    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-86vqr"]
Jul 29 18:00:54.214226 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214202    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5baa1188-cee1-430c-a28e-1aa54be9f162" containerName="util"
Jul 29 18:00:54.214292 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214230    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5baa1188-cee1-430c-a28e-1aa54be9f162" containerName="util"
Jul 29 18:00:54.214292 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214246    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff48fc0e-864b-49e9-b585-43c56255c49b" containerName="pull"
Jul 29 18:00:54.214292 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214260    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff48fc0e-864b-49e9-b585-43c56255c49b" containerName="pull"
Jul 29 18:00:54.214292 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214273    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff48fc0e-864b-49e9-b585-43c56255c49b" containerName="extract"
Jul 29 18:00:54.214292 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214281    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff48fc0e-864b-49e9-b585-43c56255c49b" containerName="extract"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214296    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c12d3af-60a3-4eec-b668-ade3c3817d29" containerName="util"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214306    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c12d3af-60a3-4eec-b668-ade3c3817d29" containerName="util"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214316    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c12d3af-60a3-4eec-b668-ade3c3817d29" containerName="extract"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214324    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c12d3af-60a3-4eec-b668-ade3c3817d29" containerName="extract"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214343    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="553b34ee-747c-41f8-8858-f2023e99d400" containerName="pull"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214351    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="553b34ee-747c-41f8-8858-f2023e99d400" containerName="pull"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214362    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff48fc0e-864b-49e9-b585-43c56255c49b" containerName="util"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214369    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff48fc0e-864b-49e9-b585-43c56255c49b" containerName="util"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214386    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c12d3af-60a3-4eec-b668-ade3c3817d29" containerName="pull"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214394    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c12d3af-60a3-4eec-b668-ade3c3817d29" containerName="pull"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214415    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="553b34ee-747c-41f8-8858-f2023e99d400" containerName="extract"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214423    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="553b34ee-747c-41f8-8858-f2023e99d400" containerName="extract"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214444    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5baa1188-cee1-430c-a28e-1aa54be9f162" containerName="pull"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214452    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5baa1188-cee1-430c-a28e-1aa54be9f162" containerName="pull"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214467    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="553b34ee-747c-41f8-8858-f2023e99d400" containerName="util"
Jul 29 18:00:54.214487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214475    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="553b34ee-747c-41f8-8858-f2023e99d400" containerName="util"
Jul 29 18:00:54.214983 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214497    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5baa1188-cee1-430c-a28e-1aa54be9f162" containerName="extract"
Jul 29 18:00:54.214983 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214506    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5baa1188-cee1-430c-a28e-1aa54be9f162" containerName="extract"
Jul 29 18:00:54.214983 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214679    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5baa1188-cee1-430c-a28e-1aa54be9f162" containerName="extract"
Jul 29 18:00:54.214983 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214707    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="553b34ee-747c-41f8-8858-f2023e99d400" containerName="extract"
Jul 29 18:00:54.214983 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214819    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c12d3af-60a3-4eec-b668-ade3c3817d29" containerName="extract"
Jul 29 18:00:54.214983 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.214830    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff48fc0e-864b-49e9-b585-43c56255c49b" containerName="extract"
Jul 29 18:00:54.218926 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.218909    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86vqr"
Jul 29 18:00:54.222245 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.222224    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 29 18:00:54.222376 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.222358    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zg4x2\""
Jul 29 18:00:54.226382 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.226354    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-86vqr"]
Jul 29 18:00:54.286283 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.286241    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96h58\" (UniqueName: \"kubernetes.io/projected/adf95a2e-df33-4ca8-ab3e-d8db3756876e-kube-api-access-96h58\") pod \"dns-operator-controller-manager-864dd78c4c-86vqr\" (UID: \"adf95a2e-df33-4ca8-ab3e-d8db3756876e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86vqr"
Jul 29 18:00:54.386870 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.386827    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96h58\" (UniqueName: \"kubernetes.io/projected/adf95a2e-df33-4ca8-ab3e-d8db3756876e-kube-api-access-96h58\") pod \"dns-operator-controller-manager-864dd78c4c-86vqr\" (UID: \"adf95a2e-df33-4ca8-ab3e-d8db3756876e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86vqr"
Jul 29 18:00:54.397484 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.397445    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96h58\" (UniqueName: \"kubernetes.io/projected/adf95a2e-df33-4ca8-ab3e-d8db3756876e-kube-api-access-96h58\") pod \"dns-operator-controller-manager-864dd78c4c-86vqr\" (UID: \"adf95a2e-df33-4ca8-ab3e-d8db3756876e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86vqr"
Jul 29 18:00:54.529741 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.529704    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86vqr"
Jul 29 18:00:54.664781 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:54.664753    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-86vqr"]
Jul 29 18:00:54.666512 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:00:54.666483    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf95a2e_df33_4ca8_ab3e_d8db3756876e.slice/crio-454088a67ccbaabaac878d572c02415f4803df8f12cb3af6934e5800cd1b2ec1 WatchSource:0}: Error finding container 454088a67ccbaabaac878d572c02415f4803df8f12cb3af6934e5800cd1b2ec1: Status 404 returned error can't find the container with id 454088a67ccbaabaac878d572c02415f4803df8f12cb3af6934e5800cd1b2ec1
Jul 29 18:00:55.120577 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:55.120544    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86vqr" event={"ID":"adf95a2e-df33-4ca8-ab3e-d8db3756876e","Type":"ContainerStarted","Data":"454088a67ccbaabaac878d572c02415f4803df8f12cb3af6934e5800cd1b2ec1"}
Jul 29 18:00:58.136881 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:58.136777    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86vqr" event={"ID":"adf95a2e-df33-4ca8-ab3e-d8db3756876e","Type":"ContainerStarted","Data":"2e2a2b8e0bf0e78560ad74baadf4fea47a0714efbbb1a108654b15cdd767add9"}
Jul 29 18:00:58.137343 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:58.136884    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86vqr"
Jul 29 18:00:58.162228 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:00:58.162170    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86vqr" podStartSLOduration=0.972542932 podStartE2EDuration="4.162153322s" totalImagesPullingTime="3.18961039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:00:58.159588222 +0000 UTC m=+486.507816315" watchObservedRunningTime="2026-07-29 18:00:58.162153322 +0000 UTC m=+486.510381416"
Jul 29 18:01:02.655498 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:02.655459    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"]
Jul 29 18:01:02.659458 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:02.659436    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:02.662218 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:02.662194    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vznvv\""
Jul 29 18:01:02.677388 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:02.677354    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"]
Jul 29 18:01:02.762432 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:02.762392    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfqqn\" (UniqueName: \"kubernetes.io/projected/05d69e7c-1796-4449-a966-e2b9202e8937-kube-api-access-gfqqn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vvbqr\" (UID: \"05d69e7c-1796-4449-a966-e2b9202e8937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:02.762614 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:02.762442    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05d69e7c-1796-4449-a966-e2b9202e8937-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vvbqr\" (UID: \"05d69e7c-1796-4449-a966-e2b9202e8937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:02.863783 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:02.863739    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqqn\" (UniqueName: \"kubernetes.io/projected/05d69e7c-1796-4449-a966-e2b9202e8937-kube-api-access-gfqqn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vvbqr\" (UID: \"05d69e7c-1796-4449-a966-e2b9202e8937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:02.864012 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:02.863798    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05d69e7c-1796-4449-a966-e2b9202e8937-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vvbqr\" (UID: \"05d69e7c-1796-4449-a966-e2b9202e8937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:02.864201 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:02.864181    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05d69e7c-1796-4449-a966-e2b9202e8937-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vvbqr\" (UID: \"05d69e7c-1796-4449-a966-e2b9202e8937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:02.872664 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:02.872641    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfqqn\" (UniqueName: \"kubernetes.io/projected/05d69e7c-1796-4449-a966-e2b9202e8937-kube-api-access-gfqqn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vvbqr\" (UID: \"05d69e7c-1796-4449-a966-e2b9202e8937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:02.969067 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:02.968961    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:03.130309 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:03.130280    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"]
Jul 29 18:01:03.132589 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:01:03.132559    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d69e7c_1796_4449_a966_e2b9202e8937.slice/crio-15020bf0bad713b572d3729a567155f4babc979ae8662d51f3ee820dfd20470e WatchSource:0}: Error finding container 15020bf0bad713b572d3729a567155f4babc979ae8662d51f3ee820dfd20470e: Status 404 returned error can't find the container with id 15020bf0bad713b572d3729a567155f4babc979ae8662d51f3ee820dfd20470e
Jul 29 18:01:03.161617 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:03.161575    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr" event={"ID":"05d69e7c-1796-4449-a966-e2b9202e8937","Type":"ContainerStarted","Data":"15020bf0bad713b572d3729a567155f4babc979ae8662d51f3ee820dfd20470e"}
Jul 29 18:01:05.908067 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:05.908025    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nbtn6"]
Jul 29 18:01:05.911144 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:05.911122    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbtn6"
Jul 29 18:01:05.914464 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:05.914432    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rgwn2\""
Jul 29 18:01:05.928950 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:05.928919    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nbtn6"]
Jul 29 18:01:05.994406 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:05.994365    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h9wv\" (UniqueName: \"kubernetes.io/projected/ce866513-f321-4883-b84f-ed98c04163e4-kube-api-access-6h9wv\") pod \"authorino-operator-75cc8d5cb7-nbtn6\" (UID: \"ce866513-f321-4883-b84f-ed98c04163e4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbtn6"
Jul 29 18:01:06.095882 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:06.095845    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h9wv\" (UniqueName: \"kubernetes.io/projected/ce866513-f321-4883-b84f-ed98c04163e4-kube-api-access-6h9wv\") pod \"authorino-operator-75cc8d5cb7-nbtn6\" (UID: \"ce866513-f321-4883-b84f-ed98c04163e4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbtn6"
Jul 29 18:01:06.117230 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:06.117199    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h9wv\" (UniqueName: \"kubernetes.io/projected/ce866513-f321-4883-b84f-ed98c04163e4-kube-api-access-6h9wv\") pod \"authorino-operator-75cc8d5cb7-nbtn6\" (UID: \"ce866513-f321-4883-b84f-ed98c04163e4\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbtn6"
Jul 29 18:01:06.225760 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:06.225654    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbtn6"
Jul 29 18:01:06.375299 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:06.375269    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-nbtn6"]
Jul 29 18:01:06.376982 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:01:06.376953    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce866513_f321_4883_b84f_ed98c04163e4.slice/crio-79122addaefded4b158d84510e9e2a976a34b2ac7d84e31953c5176cc75a286f WatchSource:0}: Error finding container 79122addaefded4b158d84510e9e2a976a34b2ac7d84e31953c5176cc75a286f: Status 404 returned error can't find the container with id 79122addaefded4b158d84510e9e2a976a34b2ac7d84e31953c5176cc75a286f
Jul 29 18:01:07.188217 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:07.188166    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbtn6" event={"ID":"ce866513-f321-4883-b84f-ed98c04163e4","Type":"ContainerStarted","Data":"79122addaefded4b158d84510e9e2a976a34b2ac7d84e31953c5176cc75a286f"}
Jul 29 18:01:08.197267 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:08.196740    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr" event={"ID":"05d69e7c-1796-4449-a966-e2b9202e8937","Type":"ContainerStarted","Data":"200a58982dada438d0fd7f1317c19aa00688393be8124c0ea65a22f5c55259bf"}
Jul 29 18:01:08.197267 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:08.196847    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:08.219023 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:08.218930    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr" podStartSLOduration=1.62936142 podStartE2EDuration="6.218908315s" totalImagesPullingTime="4.589546895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:01:08.216816496 +0000 UTC m=+496.565044584" watchObservedRunningTime="2026-07-29 18:01:08.218908315 +0000 UTC m=+496.567136404"
Jul 29 18:01:09.144963 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:09.144928    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-86vqr"
Jul 29 18:01:10.211046 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:10.210963    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbtn6" event={"ID":"ce866513-f321-4883-b84f-ed98c04163e4","Type":"ContainerStarted","Data":"737773fe64222c74be99f2f3d6822552b656c05b83160ba79d2373d2afb9a79d"}
Jul 29 18:01:10.211452 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:10.211061    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbtn6"
Jul 29 18:01:10.227344 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:10.227287    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbtn6" podStartSLOduration=2.228932622 podStartE2EDuration="5.227269754s" totalImagesPullingTime="2.998337132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:01:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:01:10.226136738 +0000 UTC m=+498.574364831" watchObservedRunningTime="2026-07-29 18:01:10.227269754 +0000 UTC m=+498.575497847"
Jul 29 18:01:19.207293 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:19.207256    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:20.975867 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:20.975832    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"]
Jul 29 18:01:20.976326 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:20.976034    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr" podUID="05d69e7c-1796-4449-a966-e2b9202e8937" containerName="manager" containerID="cri-o://200a58982dada438d0fd7f1317c19aa00688393be8124c0ea65a22f5c55259bf" gracePeriod=2
Jul 29 18:01:20.988679 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:20.988648    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"]
Jul 29 18:01:20.990931 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:01:20.990886    2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"05d69e7c-1796-4449-a966-e2b9202e8937\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-vvbqr\": pods \"kuadrant-operator-controller-manager-8684c9ff49-vvbqr\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:21.008416 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.008379    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"]
Jul 29 18:01:21.008865 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.008843    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05d69e7c-1796-4449-a966-e2b9202e8937" containerName="manager"
Jul 29 18:01:21.008927 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.008871    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="05d69e7c-1796-4449-a966-e2b9202e8937" containerName="manager"
Jul 29 18:01:21.009002 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.008979    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="05d69e7c-1796-4449-a966-e2b9202e8937" containerName="manager"
Jul 29 18:01:21.011334 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.011311    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"
Jul 29 18:01:21.032816 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.032784    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"]
Jul 29 18:01:21.047350 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:01:21.047308    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vvbqr\" is forbidden: User \"system:node:ip-10-0-138-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-0.ec2.internal' and this object" podUID="05d69e7c-1796-4449-a966-e2b9202e8937" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:21.130614 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.130581    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad59a05-731e-4105-9693-84f6539d9f53-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v8hx8\" (UID: \"cad59a05-731e-4105-9693-84f6539d9f53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"
Jul 29 18:01:21.130614 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.130620    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crxt4\" (UniqueName: \"kubernetes.io/projected/cad59a05-731e-4105-9693-84f6539d9f53-kube-api-access-crxt4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v8hx8\" (UID: \"cad59a05-731e-4105-9693-84f6539d9f53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"
Jul 29 18:01:21.221682 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.221654    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-nbtn6"
Jul 29 18:01:21.223005 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.222970    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:21.224160 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:01:21.224137    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vvbqr\" is forbidden: User \"system:node:ip-10-0-138-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-0.ec2.internal' and this object" podUID="05d69e7c-1796-4449-a966-e2b9202e8937" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:21.231131 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.231088    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad59a05-731e-4105-9693-84f6539d9f53-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v8hx8\" (UID: \"cad59a05-731e-4105-9693-84f6539d9f53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"
Jul 29 18:01:21.231131 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.231118    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crxt4\" (UniqueName: \"kubernetes.io/projected/cad59a05-731e-4105-9693-84f6539d9f53-kube-api-access-crxt4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v8hx8\" (UID: \"cad59a05-731e-4105-9693-84f6539d9f53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"
Jul 29 18:01:21.231442 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.231424    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad59a05-731e-4105-9693-84f6539d9f53-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v8hx8\" (UID: \"cad59a05-731e-4105-9693-84f6539d9f53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"
Jul 29 18:01:21.243631 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.243597    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crxt4\" (UniqueName: \"kubernetes.io/projected/cad59a05-731e-4105-9693-84f6539d9f53-kube-api-access-crxt4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-v8hx8\" (UID: \"cad59a05-731e-4105-9693-84f6539d9f53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"
Jul 29 18:01:21.250879 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:01:21.250846    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vvbqr\" is forbidden: User \"system:node:ip-10-0-138-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-0.ec2.internal' and this object" podUID="05d69e7c-1796-4449-a966-e2b9202e8937" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:21.271437 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.271401    2567 generic.go:356] "Generic (PLEG): container finished" podID="05d69e7c-1796-4449-a966-e2b9202e8937" containerID="200a58982dada438d0fd7f1317c19aa00688393be8124c0ea65a22f5c55259bf" exitCode=0
Jul 29 18:01:21.271624 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.271446    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:21.271624 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.271499    2567 scope.go:117] "RemoveContainer" containerID="200a58982dada438d0fd7f1317c19aa00688393be8124c0ea65a22f5c55259bf"
Jul 29 18:01:21.274086 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:01:21.274050    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vvbqr\" is forbidden: User \"system:node:ip-10-0-138-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-0.ec2.internal' and this object" podUID="05d69e7c-1796-4449-a966-e2b9202e8937" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:21.281569 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.281547    2567 scope.go:117] "RemoveContainer" containerID="200a58982dada438d0fd7f1317c19aa00688393be8124c0ea65a22f5c55259bf"
Jul 29 18:01:21.281883 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:01:21.281862    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"200a58982dada438d0fd7f1317c19aa00688393be8124c0ea65a22f5c55259bf\": container with ID starting with 200a58982dada438d0fd7f1317c19aa00688393be8124c0ea65a22f5c55259bf not found: ID does not exist" containerID="200a58982dada438d0fd7f1317c19aa00688393be8124c0ea65a22f5c55259bf"
Jul 29 18:01:21.281959 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.281891    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"200a58982dada438d0fd7f1317c19aa00688393be8124c0ea65a22f5c55259bf"} err="failed to get container status \"200a58982dada438d0fd7f1317c19aa00688393be8124c0ea65a22f5c55259bf\": rpc error: code = NotFound desc = could not find container \"200a58982dada438d0fd7f1317c19aa00688393be8124c0ea65a22f5c55259bf\": container with ID starting with 200a58982dada438d0fd7f1317c19aa00688393be8124c0ea65a22f5c55259bf not found: ID does not exist"
Jul 29 18:01:21.332100 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.332064    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfqqn\" (UniqueName: \"kubernetes.io/projected/05d69e7c-1796-4449-a966-e2b9202e8937-kube-api-access-gfqqn\") pod \"05d69e7c-1796-4449-a966-e2b9202e8937\" (UID: \"05d69e7c-1796-4449-a966-e2b9202e8937\") "
Jul 29 18:01:21.332282 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.332151    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05d69e7c-1796-4449-a966-e2b9202e8937-extensions-socket-volume\") pod \"05d69e7c-1796-4449-a966-e2b9202e8937\" (UID: \"05d69e7c-1796-4449-a966-e2b9202e8937\") "
Jul 29 18:01:21.332686 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.332657    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d69e7c-1796-4449-a966-e2b9202e8937-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "05d69e7c-1796-4449-a966-e2b9202e8937" (UID: "05d69e7c-1796-4449-a966-e2b9202e8937"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:01:21.334256 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.334228    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05d69e7c-1796-4449-a966-e2b9202e8937-kube-api-access-gfqqn" (OuterVolumeSpecName: "kube-api-access-gfqqn") pod "05d69e7c-1796-4449-a966-e2b9202e8937" (UID: "05d69e7c-1796-4449-a966-e2b9202e8937"). InnerVolumeSpecName "kube-api-access-gfqqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:01:21.360085 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.360049    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"
Jul 29 18:01:21.433502 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.433470    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfqqn\" (UniqueName: \"kubernetes.io/projected/05d69e7c-1796-4449-a966-e2b9202e8937-kube-api-access-gfqqn\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:01:21.433502 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.433499    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/05d69e7c-1796-4449-a966-e2b9202e8937-extensions-socket-volume\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:01:21.500287 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:21.500263    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"]
Jul 29 18:01:21.502826 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:01:21.502795    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad59a05_731e_4105_9693_84f6539d9f53.slice/crio-7a3c6f38f9c112e6afada5ec01702f154dcf6cfb56cbcdd58d0d6fe2982f1a16 WatchSource:0}: Error finding container 7a3c6f38f9c112e6afada5ec01702f154dcf6cfb56cbcdd58d0d6fe2982f1a16: Status 404 returned error can't find the container with id 7a3c6f38f9c112e6afada5ec01702f154dcf6cfb56cbcdd58d0d6fe2982f1a16
Jul 29 18:01:21.583368 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:01:21.583334    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vvbqr\" is forbidden: User \"system:node:ip-10-0-138-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-0.ec2.internal' and this object" podUID="05d69e7c-1796-4449-a966-e2b9202e8937" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:22.075056 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:01:22.075012    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vvbqr\" is forbidden: User \"system:node:ip-10-0-138-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-0.ec2.internal' and this object" podUID="05d69e7c-1796-4449-a966-e2b9202e8937" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vvbqr"
Jul 29 18:01:22.077909 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:22.077877    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05d69e7c-1796-4449-a966-e2b9202e8937" path="/var/lib/kubelet/pods/05d69e7c-1796-4449-a966-e2b9202e8937/volumes"
Jul 29 18:01:22.278491 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:22.278448    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8" event={"ID":"cad59a05-731e-4105-9693-84f6539d9f53","Type":"ContainerStarted","Data":"0a1d5d328106e6185ff3b402af0a8491cadcac006d7cf9d54ae7a8b25cd1df4d"}
Jul 29 18:01:22.278681 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:22.278569    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8" event={"ID":"cad59a05-731e-4105-9693-84f6539d9f53","Type":"ContainerStarted","Data":"7a3c6f38f9c112e6afada5ec01702f154dcf6cfb56cbcdd58d0d6fe2982f1a16"}
Jul 29 18:01:22.278681 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:22.278602    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"
Jul 29 18:01:22.313036 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:22.312957    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8" podStartSLOduration=2.312940461 podStartE2EDuration="2.312940461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:01:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:01:22.310649367 +0000 UTC m=+510.658877459" watchObservedRunningTime="2026-07-29 18:01:22.312940461 +0000 UTC m=+510.661168554"
Jul 29 18:01:33.287559 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:33.287517    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"
Jul 29 18:01:50.636154 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:50.636072    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"]
Jul 29 18:01:50.636616 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:50.636300    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8" podUID="cad59a05-731e-4105-9693-84f6539d9f53" containerName="manager" containerID="cri-o://0a1d5d328106e6185ff3b402af0a8491cadcac006d7cf9d54ae7a8b25cd1df4d" gracePeriod=10
Jul 29 18:01:50.883960 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:50.883932    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"
Jul 29 18:01:50.994432 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:50.994400    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crxt4\" (UniqueName: \"kubernetes.io/projected/cad59a05-731e-4105-9693-84f6539d9f53-kube-api-access-crxt4\") pod \"cad59a05-731e-4105-9693-84f6539d9f53\" (UID: \"cad59a05-731e-4105-9693-84f6539d9f53\") "
Jul 29 18:01:50.994603 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:50.994459    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad59a05-731e-4105-9693-84f6539d9f53-extensions-socket-volume\") pod \"cad59a05-731e-4105-9693-84f6539d9f53\" (UID: \"cad59a05-731e-4105-9693-84f6539d9f53\") "
Jul 29 18:01:50.994891 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:50.994868    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cad59a05-731e-4105-9693-84f6539d9f53-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cad59a05-731e-4105-9693-84f6539d9f53" (UID: "cad59a05-731e-4105-9693-84f6539d9f53"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:01:50.996578 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:50.996552    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cad59a05-731e-4105-9693-84f6539d9f53-kube-api-access-crxt4" (OuterVolumeSpecName: "kube-api-access-crxt4") pod "cad59a05-731e-4105-9693-84f6539d9f53" (UID: "cad59a05-731e-4105-9693-84f6539d9f53"). InnerVolumeSpecName "kube-api-access-crxt4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:01:51.095707 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:51.095643    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crxt4\" (UniqueName: \"kubernetes.io/projected/cad59a05-731e-4105-9693-84f6539d9f53-kube-api-access-crxt4\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:01:51.095707 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:51.095679    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cad59a05-731e-4105-9693-84f6539d9f53-extensions-socket-volume\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:01:51.429749 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:51.429653    2567 generic.go:356] "Generic (PLEG): container finished" podID="cad59a05-731e-4105-9693-84f6539d9f53" containerID="0a1d5d328106e6185ff3b402af0a8491cadcac006d7cf9d54ae7a8b25cd1df4d" exitCode=0
Jul 29 18:01:51.429749 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:51.429705    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"
Jul 29 18:01:51.429749 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:51.429714    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8" event={"ID":"cad59a05-731e-4105-9693-84f6539d9f53","Type":"ContainerDied","Data":"0a1d5d328106e6185ff3b402af0a8491cadcac006d7cf9d54ae7a8b25cd1df4d"}
Jul 29 18:01:51.429973 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:51.429763    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8" event={"ID":"cad59a05-731e-4105-9693-84f6539d9f53","Type":"ContainerDied","Data":"7a3c6f38f9c112e6afada5ec01702f154dcf6cfb56cbcdd58d0d6fe2982f1a16"}
Jul 29 18:01:51.429973 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:51.429788    2567 scope.go:117] "RemoveContainer" containerID="0a1d5d328106e6185ff3b402af0a8491cadcac006d7cf9d54ae7a8b25cd1df4d"
Jul 29 18:01:51.439388 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:51.439367    2567 scope.go:117] "RemoveContainer" containerID="0a1d5d328106e6185ff3b402af0a8491cadcac006d7cf9d54ae7a8b25cd1df4d"
Jul 29 18:01:51.439722 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:01:51.439695    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a1d5d328106e6185ff3b402af0a8491cadcac006d7cf9d54ae7a8b25cd1df4d\": container with ID starting with 0a1d5d328106e6185ff3b402af0a8491cadcac006d7cf9d54ae7a8b25cd1df4d not found: ID does not exist" containerID="0a1d5d328106e6185ff3b402af0a8491cadcac006d7cf9d54ae7a8b25cd1df4d"
Jul 29 18:01:51.439825 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:51.439730    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a1d5d328106e6185ff3b402af0a8491cadcac006d7cf9d54ae7a8b25cd1df4d"} err="failed to get container status \"0a1d5d328106e6185ff3b402af0a8491cadcac006d7cf9d54ae7a8b25cd1df4d\": rpc error: code = NotFound desc = could not find container \"0a1d5d328106e6185ff3b402af0a8491cadcac006d7cf9d54ae7a8b25cd1df4d\": container with ID starting with 0a1d5d328106e6185ff3b402af0a8491cadcac006d7cf9d54ae7a8b25cd1df4d not found: ID does not exist"
Jul 29 18:01:51.455360 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:51.455327    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"]
Jul 29 18:01:51.464717 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:51.464682    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-v8hx8"]
Jul 29 18:01:52.073369 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:01:52.073337    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cad59a05-731e-4105-9693-84f6539d9f53" path="/var/lib/kubelet/pods/cad59a05-731e-4105-9693-84f6539d9f53/volumes"
Jul 29 18:02:06.969186 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:06.969140    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"]
Jul 29 18:02:06.969793 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:06.969502    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cad59a05-731e-4105-9693-84f6539d9f53" containerName="manager"
Jul 29 18:02:06.969793 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:06.969525    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cad59a05-731e-4105-9693-84f6539d9f53" containerName="manager"
Jul 29 18:02:06.969793 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:06.969593    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cad59a05-731e-4105-9693-84f6539d9f53" containerName="manager"
Jul 29 18:02:06.973053 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:06.973033    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:06.976061 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:06.976039    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sd7tk\""
Jul 29 18:02:06.985574 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:06.985546    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"]
Jul 29 18:02:07.031664 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.031619    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.031664 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.031671    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.031945 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.031728    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.031945 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.031766    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djt7l\" (UniqueName: \"kubernetes.io/projected/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-kube-api-access-djt7l\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.031945 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.031814    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.031945 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.031846    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.031945 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.031863    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.031945 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.031897    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.031945 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.031938    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.133093 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.133041    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.133093 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.133100    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djt7l\" (UniqueName: \"kubernetes.io/projected/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-kube-api-access-djt7l\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.133365 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.133130    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.133365 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.133167    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.133365 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.133184    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.133522 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.133402    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.133522 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.133498    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.133630 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.133540    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.133630 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.133595    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.133903 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.133875    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.134022 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.133979    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.134150 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.134068    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.134150 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.134086    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.134150 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.134108    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.135891 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.135854    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.136028 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.135901    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.141850 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.141827    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.141946 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.141909    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djt7l\" (UniqueName: \"kubernetes.io/projected/3b6fc28e-85e4-4c46-accb-51d1b30e3d03-kube-api-access-djt7l\") pod \"maas-default-gateway-openshift-default-78bb78ff78-7tdnw\" (UID: \"3b6fc28e-85e4-4c46-accb-51d1b30e3d03\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.283618 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.283578    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:07.446699 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.446670    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"]
Jul 29 18:02:07.448751 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:02:07.448724    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6fc28e_85e4_4c46_accb_51d1b30e3d03.slice/crio-790652450bc1a5e519b3e762eb0053254555c9216c0eafe86839b6cd5e4c2d6e WatchSource:0}: Error finding container 790652450bc1a5e519b3e762eb0053254555c9216c0eafe86839b6cd5e4c2d6e: Status 404 returned error can't find the container with id 790652450bc1a5e519b3e762eb0053254555c9216c0eafe86839b6cd5e4c2d6e
Jul 29 18:02:07.451034 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.450971    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:02:07.451099 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.451087    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:02:07.451138 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.451127    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:02:07.511959 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:07.511927    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw" event={"ID":"3b6fc28e-85e4-4c46-accb-51d1b30e3d03","Type":"ContainerStarted","Data":"790652450bc1a5e519b3e762eb0053254555c9216c0eafe86839b6cd5e4c2d6e"}
Jul 29 18:02:08.518211 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:08.518176    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw" event={"ID":"3b6fc28e-85e4-4c46-accb-51d1b30e3d03","Type":"ContainerStarted","Data":"db6064da386317017450411ace6268efa6741085c71bc9c625eb86d326be3739"}
Jul 29 18:02:08.539617 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:08.539558    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw" podStartSLOduration=2.5395416280000003 podStartE2EDuration="2.539541628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:02:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:02:08.537565414 +0000 UTC m=+556.885793511" watchObservedRunningTime="2026-07-29 18:02:08.539541628 +0000 UTC m=+556.887769721"
Jul 29 18:02:09.284623 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:09.284581    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:09.289445 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:09.289416    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:09.523057 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:09.523026    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:09.523981 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:09.523962    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:02:13.352796 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.352756    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:02:13.355274 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.355257    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"
Jul 29 18:02:13.357682 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.357652    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 18:02:13.357682 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.357676    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mxn6k\""
Jul 29 18:02:13.363229 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.363202    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:02:13.391450 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.391413    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:02:13.492723 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.492666    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/922d68f1-65cc-4def-857a-b2c7fe3dae7e-config-file\") pod \"limitador-limitador-54d6d988d5-dxf2z\" (UID: \"922d68f1-65cc-4def-857a-b2c7fe3dae7e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"
Jul 29 18:02:13.492909 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.492788    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9txj\" (UniqueName: \"kubernetes.io/projected/922d68f1-65cc-4def-857a-b2c7fe3dae7e-kube-api-access-g9txj\") pod \"limitador-limitador-54d6d988d5-dxf2z\" (UID: \"922d68f1-65cc-4def-857a-b2c7fe3dae7e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"
Jul 29 18:02:13.593412 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.593351    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9txj\" (UniqueName: \"kubernetes.io/projected/922d68f1-65cc-4def-857a-b2c7fe3dae7e-kube-api-access-g9txj\") pod \"limitador-limitador-54d6d988d5-dxf2z\" (UID: \"922d68f1-65cc-4def-857a-b2c7fe3dae7e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"
Jul 29 18:02:13.593412 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.593429    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/922d68f1-65cc-4def-857a-b2c7fe3dae7e-config-file\") pod \"limitador-limitador-54d6d988d5-dxf2z\" (UID: \"922d68f1-65cc-4def-857a-b2c7fe3dae7e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"
Jul 29 18:02:13.594102 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.594085    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/922d68f1-65cc-4def-857a-b2c7fe3dae7e-config-file\") pod \"limitador-limitador-54d6d988d5-dxf2z\" (UID: \"922d68f1-65cc-4def-857a-b2c7fe3dae7e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"
Jul 29 18:02:13.603011 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.602929    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9txj\" (UniqueName: \"kubernetes.io/projected/922d68f1-65cc-4def-857a-b2c7fe3dae7e-kube-api-access-g9txj\") pod \"limitador-limitador-54d6d988d5-dxf2z\" (UID: \"922d68f1-65cc-4def-857a-b2c7fe3dae7e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"
Jul 29 18:02:13.666944 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.666901    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"
Jul 29 18:02:13.773175 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.773139    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-kmtgx"]
Jul 29 18:02:13.776273 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.776243    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kmtgx"
Jul 29 18:02:13.778877 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.778851    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4w7sd\""
Jul 29 18:02:13.784636 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.784608    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kmtgx"]
Jul 29 18:02:13.810114 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.810080    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:02:13.811803 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:02:13.811777    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922d68f1_65cc_4def_857a_b2c7fe3dae7e.slice/crio-e35cfd76dc80992f62a244062ecfabeb0169576f20ca2d834d7428f77c39cc67 WatchSource:0}: Error finding container e35cfd76dc80992f62a244062ecfabeb0169576f20ca2d834d7428f77c39cc67: Status 404 returned error can't find the container with id e35cfd76dc80992f62a244062ecfabeb0169576f20ca2d834d7428f77c39cc67
Jul 29 18:02:13.896367 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.896270    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk7sw\" (UniqueName: \"kubernetes.io/projected/cf8e190b-9089-48ac-84e8-f7d9121e5ab7-kube-api-access-wk7sw\") pod \"authorino-58cd955675-kmtgx\" (UID: \"cf8e190b-9089-48ac-84e8-f7d9121e5ab7\") " pod="kuadrant-system/authorino-58cd955675-kmtgx"
Jul 29 18:02:13.996685 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:13.996645    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk7sw\" (UniqueName: \"kubernetes.io/projected/cf8e190b-9089-48ac-84e8-f7d9121e5ab7-kube-api-access-wk7sw\") pod \"authorino-58cd955675-kmtgx\" (UID: \"cf8e190b-9089-48ac-84e8-f7d9121e5ab7\") " pod="kuadrant-system/authorino-58cd955675-kmtgx"
Jul 29 18:02:14.005054 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:14.005013    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk7sw\" (UniqueName: \"kubernetes.io/projected/cf8e190b-9089-48ac-84e8-f7d9121e5ab7-kube-api-access-wk7sw\") pod \"authorino-58cd955675-kmtgx\" (UID: \"cf8e190b-9089-48ac-84e8-f7d9121e5ab7\") " pod="kuadrant-system/authorino-58cd955675-kmtgx"
Jul 29 18:02:14.088386 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:14.088350    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kmtgx"
Jul 29 18:02:14.218944 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:14.218877    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-kmtgx"]
Jul 29 18:02:14.221135 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:02:14.221105    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf8e190b_9089_48ac_84e8_f7d9121e5ab7.slice/crio-c567620071d374dbb8c07b92d3eec41ceaf87a67f0a22721d19f12a543abed68 WatchSource:0}: Error finding container c567620071d374dbb8c07b92d3eec41ceaf87a67f0a22721d19f12a543abed68: Status 404 returned error can't find the container with id c567620071d374dbb8c07b92d3eec41ceaf87a67f0a22721d19f12a543abed68
Jul 29 18:02:14.551599 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:14.551520    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kmtgx" event={"ID":"cf8e190b-9089-48ac-84e8-f7d9121e5ab7","Type":"ContainerStarted","Data":"c567620071d374dbb8c07b92d3eec41ceaf87a67f0a22721d19f12a543abed68"}
Jul 29 18:02:14.554338 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:14.554295    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dxf2z" event={"ID":"922d68f1-65cc-4def-857a-b2c7fe3dae7e","Type":"ContainerStarted","Data":"e35cfd76dc80992f62a244062ecfabeb0169576f20ca2d834d7428f77c39cc67"}
Jul 29 18:02:18.580836 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:18.580796    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kmtgx" event={"ID":"cf8e190b-9089-48ac-84e8-f7d9121e5ab7","Type":"ContainerStarted","Data":"582c9f417cda5e768d3e968b6a6cd8c0fcac7a0dfeb83bda6a4a11c5df69aaa7"}
Jul 29 18:02:18.582458 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:18.582433    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dxf2z" event={"ID":"922d68f1-65cc-4def-857a-b2c7fe3dae7e","Type":"ContainerStarted","Data":"55671f9b69a21542ccdc086c4287fccd89131c0cf7dbfa64e179848e8f0c997b"}
Jul 29 18:02:18.582569 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:18.582491    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"
Jul 29 18:02:18.596765 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:18.596707    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-kmtgx" podStartSLOduration=1.596315273 podStartE2EDuration="5.596690152s" totalImagesPullingTime="4.000374879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:02:18.595891042 +0000 UTC m=+566.944119137" watchObservedRunningTime="2026-07-29 18:02:18.596690152 +0000 UTC m=+566.944918245"
Jul 29 18:02:18.613176 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:18.613123    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dxf2z" podStartSLOduration=1.206738577 podStartE2EDuration="5.613102893s" totalImagesPullingTime="4.406364316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:02:18.611831789 +0000 UTC m=+566.960059883" watchObservedRunningTime="2026-07-29 18:02:18.613102893 +0000 UTC m=+566.961330982"
Jul 29 18:02:18.809053 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:18.809014    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kmtgx"]
Jul 29 18:02:20.593009 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:20.592922    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-kmtgx" podUID="cf8e190b-9089-48ac-84e8-f7d9121e5ab7" containerName="authorino" containerID="cri-o://582c9f417cda5e768d3e968b6a6cd8c0fcac7a0dfeb83bda6a4a11c5df69aaa7" gracePeriod=30
Jul 29 18:02:20.839696 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:20.839666    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kmtgx"
Jul 29 18:02:20.961887 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:20.961796    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk7sw\" (UniqueName: \"kubernetes.io/projected/cf8e190b-9089-48ac-84e8-f7d9121e5ab7-kube-api-access-wk7sw\") pod \"cf8e190b-9089-48ac-84e8-f7d9121e5ab7\" (UID: \"cf8e190b-9089-48ac-84e8-f7d9121e5ab7\") "
Jul 29 18:02:20.964042 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:20.963985    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf8e190b-9089-48ac-84e8-f7d9121e5ab7-kube-api-access-wk7sw" (OuterVolumeSpecName: "kube-api-access-wk7sw") pod "cf8e190b-9089-48ac-84e8-f7d9121e5ab7" (UID: "cf8e190b-9089-48ac-84e8-f7d9121e5ab7"). InnerVolumeSpecName "kube-api-access-wk7sw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:02:21.062647 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:21.062587    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk7sw\" (UniqueName: \"kubernetes.io/projected/cf8e190b-9089-48ac-84e8-f7d9121e5ab7-kube-api-access-wk7sw\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:02:21.599721 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:21.599677    2567 generic.go:356] "Generic (PLEG): container finished" podID="cf8e190b-9089-48ac-84e8-f7d9121e5ab7" containerID="582c9f417cda5e768d3e968b6a6cd8c0fcac7a0dfeb83bda6a4a11c5df69aaa7" exitCode=0
Jul 29 18:02:21.600202 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:21.599739    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-kmtgx"
Jul 29 18:02:21.600202 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:21.599761    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kmtgx" event={"ID":"cf8e190b-9089-48ac-84e8-f7d9121e5ab7","Type":"ContainerDied","Data":"582c9f417cda5e768d3e968b6a6cd8c0fcac7a0dfeb83bda6a4a11c5df69aaa7"}
Jul 29 18:02:21.600202 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:21.599808    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-kmtgx" event={"ID":"cf8e190b-9089-48ac-84e8-f7d9121e5ab7","Type":"ContainerDied","Data":"c567620071d374dbb8c07b92d3eec41ceaf87a67f0a22721d19f12a543abed68"}
Jul 29 18:02:21.600202 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:21.599825    2567 scope.go:117] "RemoveContainer" containerID="582c9f417cda5e768d3e968b6a6cd8c0fcac7a0dfeb83bda6a4a11c5df69aaa7"
Jul 29 18:02:21.608922 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:21.608902    2567 scope.go:117] "RemoveContainer" containerID="582c9f417cda5e768d3e968b6a6cd8c0fcac7a0dfeb83bda6a4a11c5df69aaa7"
Jul 29 18:02:21.609282 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:02:21.609262    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"582c9f417cda5e768d3e968b6a6cd8c0fcac7a0dfeb83bda6a4a11c5df69aaa7\": container with ID starting with 582c9f417cda5e768d3e968b6a6cd8c0fcac7a0dfeb83bda6a4a11c5df69aaa7 not found: ID does not exist" containerID="582c9f417cda5e768d3e968b6a6cd8c0fcac7a0dfeb83bda6a4a11c5df69aaa7"
Jul 29 18:02:21.609361 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:21.609292    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"582c9f417cda5e768d3e968b6a6cd8c0fcac7a0dfeb83bda6a4a11c5df69aaa7"} err="failed to get container status \"582c9f417cda5e768d3e968b6a6cd8c0fcac7a0dfeb83bda6a4a11c5df69aaa7\": rpc error: code = NotFound desc = could not find container \"582c9f417cda5e768d3e968b6a6cd8c0fcac7a0dfeb83bda6a4a11c5df69aaa7\": container with ID starting with 582c9f417cda5e768d3e968b6a6cd8c0fcac7a0dfeb83bda6a4a11c5df69aaa7 not found: ID does not exist"
Jul 29 18:02:21.620381 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:21.620352    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-kmtgx"]
Jul 29 18:02:21.623436 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:21.623406    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-kmtgx"]
Jul 29 18:02:22.074129 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:22.074093    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf8e190b-9089-48ac-84e8-f7d9121e5ab7" path="/var/lib/kubelet/pods/cf8e190b-9089-48ac-84e8-f7d9121e5ab7/volumes"
Jul 29 18:02:29.589094 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:02:29.589050    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"
Jul 29 18:03:30.629584 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:30.629492    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:03:37.987167 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:37.987135    2567 generic.go:356] "Generic (PLEG): container finished" podID="3b6fc28e-85e4-4c46-accb-51d1b30e3d03" containerID="db6064da386317017450411ace6268efa6741085c71bc9c625eb86d326be3739" exitCode=0
Jul 29 18:03:37.987568 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:37.987214    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw" event={"ID":"3b6fc28e-85e4-4c46-accb-51d1b30e3d03","Type":"ContainerDied","Data":"db6064da386317017450411ace6268efa6741085c71bc9c625eb86d326be3739"}
Jul 29 18:03:37.987644 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:37.987627    2567 scope.go:117] "RemoveContainer" containerID="db6064da386317017450411ace6268efa6741085c71bc9c625eb86d326be3739"
Jul 29 18:03:37.988688 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:37.988663    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:03:37.988736 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:37.988729    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:03:37.988777 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:37.988764    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:03:38.994313 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:38.994279    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw" event={"ID":"3b6fc28e-85e4-4c46-accb-51d1b30e3d03","Type":"ContainerStarted","Data":"143c0114db679bc4e94b1d44b320062bc751028e093f7f0fc0056b0e5f81c1a5"}
Jul 29 18:03:39.283938 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:39.283846    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:03:39.285082 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:39.285053    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-7tdnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 29 18:03:39.285199 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:39.285107    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw" podUID="3b6fc28e-85e4-4c46-accb-51d1b30e3d03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 29 18:03:39.523603 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:39.523564    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:03:40.284685 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:40.284645    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-7tdnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 29 18:03:40.285219 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:40.284751    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw" podUID="3b6fc28e-85e4-4c46-accb-51d1b30e3d03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 29 18:03:41.284252 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:41.284209    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-7tdnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 29 18:03:41.284480 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:41.284298    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw" podUID="3b6fc28e-85e4-4c46-accb-51d1b30e3d03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 29 18:03:42.284486 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:42.284443    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-7tdnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 29 18:03:42.284908 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:42.284504    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw" podUID="3b6fc28e-85e4-4c46-accb-51d1b30e3d03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 29 18:03:43.288940 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:43.288909    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:03:43.290020 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:03:43.289983    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tdnw"
Jul 29 18:04:00.835868 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.835823    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"]
Jul 29 18:04:00.836522 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.836312    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf8e190b-9089-48ac-84e8-f7d9121e5ab7" containerName="authorino"
Jul 29 18:04:00.836522 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.836332    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf8e190b-9089-48ac-84e8-f7d9121e5ab7" containerName="authorino"
Jul 29 18:04:00.836522 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.836458    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf8e190b-9089-48ac-84e8-f7d9121e5ab7" containerName="authorino"
Jul 29 18:04:00.838663 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.838643    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.842256 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.842236    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 18:04:00.843427 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.843408    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 18:04:00.843427 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.843419    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 29 18:04:00.843580 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.843469    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-68jvk\""
Jul 29 18:04:00.852225 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.852199    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"]
Jul 29 18:04:00.889978 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.889935    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.890218 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.890016    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.890218 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.890058    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.890218 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.890083    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.890218 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.890108    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdkpk\" (UniqueName: \"kubernetes.io/projected/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-kube-api-access-xdkpk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.890218 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.890145    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.991161 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.991116    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.991161 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.991171    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.991413 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.991192    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.991413 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.991214    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdkpk\" (UniqueName: \"kubernetes.io/projected/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-kube-api-access-xdkpk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.991413 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.991249    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.991413 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.991329    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.991631 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.991609    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.991693 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.991611    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.991693 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.991662    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.993639 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.993621    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:00.993766 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:00.993750    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:01.002734 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:01.002705    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdkpk\" (UniqueName: \"kubernetes.io/projected/f1b1e45c-ee75-4e48-a462-4db3b556e5b8-kube-api-access-xdkpk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk\" (UID: \"f1b1e45c-ee75-4e48-a462-4db3b556e5b8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:01.149214 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:01.149116    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:01.288149 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:01.288118    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"]
Jul 29 18:04:01.289976 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:04:01.289951    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1b1e45c_ee75_4e48_a462_4db3b556e5b8.slice/crio-3ef4477d9b5dded694dae131ea08f204501e4729a203cf618d6aa200ee129dc1 WatchSource:0}: Error finding container 3ef4477d9b5dded694dae131ea08f204501e4729a203cf618d6aa200ee129dc1: Status 404 returned error can't find the container with id 3ef4477d9b5dded694dae131ea08f204501e4729a203cf618d6aa200ee129dc1
Jul 29 18:04:01.291316 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:01.291297    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 18:04:01.341261 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:01.341223    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:04:02.105259 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:02.105211    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk" event={"ID":"f1b1e45c-ee75-4e48-a462-4db3b556e5b8","Type":"ContainerStarted","Data":"3ef4477d9b5dded694dae131ea08f204501e4729a203cf618d6aa200ee129dc1"}
Jul 29 18:04:03.111682 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:03.111645    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk" event={"ID":"f1b1e45c-ee75-4e48-a462-4db3b556e5b8","Type":"ContainerStarted","Data":"923990f3305cf9cd01d4c10b3490d75c77f8b5028fd01e16cfbae8841c01da66"}
Jul 29 18:04:03.134704 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:03.134651    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk" podStartSLOduration=2.088678721 podStartE2EDuration="3.134633534s" totalImagesPullingTime="1.045954813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:04:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:04:03.133137322 +0000 UTC m=+671.481365416" watchObservedRunningTime="2026-07-29 18:04:03.134633534 +0000 UTC m=+671.482861627"
Jul 29 18:04:05.727179 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:05.727141    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:04:11.150921 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:11.150880    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:11.151543 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:11.151062    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:11.165983 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:11.165951    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:11.815146 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:11.815110    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:04:12.170201 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:12.170107    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk"
Jul 29 18:04:23.818321 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:23.818286    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:04:42.821018 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:42.820965    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:04:43.973936 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:43.973896    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"]
Jul 29 18:04:43.976481 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:43.976463    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:43.979508 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:43.979485    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 29 18:04:43.987801 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:43.987772    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"]
Jul 29 18:04:44.078168 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.078116    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ca3d0a2-9768-447e-91af-030a1023097c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.078168 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.078168    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca3d0a2-9768-447e-91af-030a1023097c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.078425 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.078213    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ca3d0a2-9768-447e-91af-030a1023097c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.078425 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.078247    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ca3d0a2-9768-447e-91af-030a1023097c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.078425 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.078274    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca3d0a2-9768-447e-91af-030a1023097c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.078425 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.078315    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2px6h\" (UniqueName: \"kubernetes.io/projected/8ca3d0a2-9768-447e-91af-030a1023097c-kube-api-access-2px6h\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.179485 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.179446    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ca3d0a2-9768-447e-91af-030a1023097c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.179668 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.179629    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca3d0a2-9768-447e-91af-030a1023097c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.179734 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.179688    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ca3d0a2-9768-447e-91af-030a1023097c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.179856 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.179827    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ca3d0a2-9768-447e-91af-030a1023097c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.179944 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.179874    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca3d0a2-9768-447e-91af-030a1023097c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.180050 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.180025    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2px6h\" (UniqueName: \"kubernetes.io/projected/8ca3d0a2-9768-447e-91af-030a1023097c-kube-api-access-2px6h\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.180121 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.180061    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ca3d0a2-9768-447e-91af-030a1023097c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.180177 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.180132    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca3d0a2-9768-447e-91af-030a1023097c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.180177 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.180160    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ca3d0a2-9768-447e-91af-030a1023097c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.181892 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.181868    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ca3d0a2-9768-447e-91af-030a1023097c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.182302 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.182286    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca3d0a2-9768-447e-91af-030a1023097c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.191096 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.191075    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2px6h\" (UniqueName: \"kubernetes.io/projected/8ca3d0a2-9768-447e-91af-030a1023097c-kube-api-access-2px6h\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq\" (UID: \"8ca3d0a2-9768-447e-91af-030a1023097c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.286460 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.286425    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:44.422584 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:44.422558    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"]
Jul 29 18:04:44.424201 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:04:44.424172    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ca3d0a2_9768_447e_91af_030a1023097c.slice/crio-2700b6f52afcdef016619dac2fedf725a3073000be2c7596a3324dceaa05ba59 WatchSource:0}: Error finding container 2700b6f52afcdef016619dac2fedf725a3073000be2c7596a3324dceaa05ba59: Status 404 returned error can't find the container with id 2700b6f52afcdef016619dac2fedf725a3073000be2c7596a3324dceaa05ba59
Jul 29 18:04:45.325365 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:45.325325    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq" event={"ID":"8ca3d0a2-9768-447e-91af-030a1023097c","Type":"ContainerStarted","Data":"3c80928751c84f9d3964ead1856e83cb55f2030ac7be4e2845002597f5edfcc9"}
Jul 29 18:04:45.325771 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:45.325375    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq" event={"ID":"8ca3d0a2-9768-447e-91af-030a1023097c","Type":"ContainerStarted","Data":"2700b6f52afcdef016619dac2fedf725a3073000be2c7596a3324dceaa05ba59"}
Jul 29 18:04:45.344232 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:45.344180    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq" podStartSLOduration=2.146685464 podStartE2EDuration="2.344164843s" totalImagesPullingTime="197.479379ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:04:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:04:45.341835503 +0000 UTC m=+713.690063596" watchObservedRunningTime="2026-07-29 18:04:45.344164843 +0000 UTC m=+713.692392935"
Jul 29 18:04:54.287249 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:54.287208    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:54.287731 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:54.287269    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:54.299908 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:54.299876    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:54.379366 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:54.379330    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq"
Jul 29 18:04:55.118049 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:04:55.118011    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:05:53.149205 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:53.149164    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b48f889d4-xgbrl"]
Jul 29 18:05:53.151810 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:53.151787    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b48f889d4-xgbrl"
Jul 29 18:05:53.155392 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:53.155362    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 29 18:05:53.155392 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:53.155375    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4w7sd\""
Jul 29 18:05:53.159515 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:53.159490    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b48f889d4-xgbrl"]
Jul 29 18:05:53.285867 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:53.285831    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90beaa21-a7fc-43da-b820-6ee556f31441-tls-cert\") pod \"authorino-b48f889d4-xgbrl\" (UID: \"90beaa21-a7fc-43da-b820-6ee556f31441\") " pod="kuadrant-system/authorino-b48f889d4-xgbrl"
Jul 29 18:05:53.285867 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:53.285869    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phnrv\" (UniqueName: \"kubernetes.io/projected/90beaa21-a7fc-43da-b820-6ee556f31441-kube-api-access-phnrv\") pod \"authorino-b48f889d4-xgbrl\" (UID: \"90beaa21-a7fc-43da-b820-6ee556f31441\") " pod="kuadrant-system/authorino-b48f889d4-xgbrl"
Jul 29 18:05:53.387142 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:53.387107    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90beaa21-a7fc-43da-b820-6ee556f31441-tls-cert\") pod \"authorino-b48f889d4-xgbrl\" (UID: \"90beaa21-a7fc-43da-b820-6ee556f31441\") " pod="kuadrant-system/authorino-b48f889d4-xgbrl"
Jul 29 18:05:53.387142 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:53.387146    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phnrv\" (UniqueName: \"kubernetes.io/projected/90beaa21-a7fc-43da-b820-6ee556f31441-kube-api-access-phnrv\") pod \"authorino-b48f889d4-xgbrl\" (UID: \"90beaa21-a7fc-43da-b820-6ee556f31441\") " pod="kuadrant-system/authorino-b48f889d4-xgbrl"
Jul 29 18:05:53.389524 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:53.389503    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/90beaa21-a7fc-43da-b820-6ee556f31441-tls-cert\") pod \"authorino-b48f889d4-xgbrl\" (UID: \"90beaa21-a7fc-43da-b820-6ee556f31441\") " pod="kuadrant-system/authorino-b48f889d4-xgbrl"
Jul 29 18:05:53.395253 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:53.395218    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phnrv\" (UniqueName: \"kubernetes.io/projected/90beaa21-a7fc-43da-b820-6ee556f31441-kube-api-access-phnrv\") pod \"authorino-b48f889d4-xgbrl\" (UID: \"90beaa21-a7fc-43da-b820-6ee556f31441\") " pod="kuadrant-system/authorino-b48f889d4-xgbrl"
Jul 29 18:05:53.462237 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:53.462154    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b48f889d4-xgbrl"
Jul 29 18:05:53.592294 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:53.592272    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b48f889d4-xgbrl"]
Jul 29 18:05:53.593617 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:05:53.593565    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90beaa21_a7fc_43da_b820_6ee556f31441.slice/crio-60e9fbc75ccbcfb9f767f22785b47a8a7b8dc0bea294136919d9e7c9688e02c6 WatchSource:0}: Error finding container 60e9fbc75ccbcfb9f767f22785b47a8a7b8dc0bea294136919d9e7c9688e02c6: Status 404 returned error can't find the container with id 60e9fbc75ccbcfb9f767f22785b47a8a7b8dc0bea294136919d9e7c9688e02c6
Jul 29 18:05:53.659641 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:53.659605    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b48f889d4-xgbrl" event={"ID":"90beaa21-a7fc-43da-b820-6ee556f31441","Type":"ContainerStarted","Data":"60e9fbc75ccbcfb9f767f22785b47a8a7b8dc0bea294136919d9e7c9688e02c6"}
Jul 29 18:05:54.668473 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:54.668431    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b48f889d4-xgbrl" event={"ID":"90beaa21-a7fc-43da-b820-6ee556f31441","Type":"ContainerStarted","Data":"a29597bd50f529613454d5acf8d36cacceaa5588d59da87c9655cc03590fb192"}
Jul 29 18:05:54.695114 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:05:54.694910    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b48f889d4-xgbrl" podStartSLOduration=1.21053126 podStartE2EDuration="1.694887952s" totalImagesPullingTime="484.356692ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:05:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:05:54.694499186 +0000 UTC m=+783.042727275" watchObservedRunningTime="2026-07-29 18:05:54.694887952 +0000 UTC m=+783.043116044"
Jul 29 18:06:24.014223 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:06:24.013979    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:06:34.116711 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:06:34.116673    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:06:42.917938 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:06:42.917901    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:08:24.914437 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:08:24.914391    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:08:37.919036 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:08:37.918985    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:08:50.714863 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:08:50.714821    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:08:59.419273 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:08:59.419237    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:09:18.316094 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:09:18.316006    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:09:28.116934 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:09:28.116900    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:09:37.324445 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:09:37.324408    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:09:43.321386 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:09:43.321344    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:09:53.725032 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:09:53.724976    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:10:03.416767 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:10:03.416726    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:10:14.524406 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:10:14.524361    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:10:24.615020 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:10:24.614970    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:10:49.728175 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:10:49.728098    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:10:59.115720 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:10:59.115680    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:11:23.126971 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:11:23.126932    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:11:33.823725 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:11:33.823684    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:11:44.611763 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:11:44.611726    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:12:03.217166 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:12:03.217129    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:12:12.820026 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:12:12.819976    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:12:22.726498 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:12:22.726407    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:12:34.619210 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:12:34.619170    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:12:45.131896 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:12:45.131862    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:12:55.413519 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:12:55.413481    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:14:40.413830 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:14:40.413794    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:14:50.211102 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:14:50.211066    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:15:04.819208 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:15:04.819168    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:15:16.618089 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:15:16.617983    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:15:27.922611 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:15:27.922571    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:15:37.419108 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:15:37.419069    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:15:48.221747 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:15:48.221702    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:15:58.718534 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:15:58.718499    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:16:08.115250 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:16:08.115212    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:16:17.716360 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:16:17.716324    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:16:28.515729 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:16:28.515692    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:16:52.720139 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:16:52.720057    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:17:00.615086 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:00.615048    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:17:17.130082 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.130044    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"]
Jul 29 18:17:17.132910 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.132890    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.135689 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.135665    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-86953ea5-kserve-self-signed-certs\""
Jul 29 18:17:17.148968 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.148937    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"]
Jul 29 18:17:17.229987 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.229945    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdjkn\" (UniqueName: \"kubernetes.io/projected/8465ac86-acad-43f4-8085-b453f06e4a1d-kube-api-access-vdjkn\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.230201 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.230042    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-dshm\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.230201 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.230065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-model-cache\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.230201 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.230088    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-home\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.230201 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.230109    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-tmp-dir\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.230388 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.230213    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8465ac86-acad-43f4-8085-b453f06e4a1d-tls-certs\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.330693 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.330648    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-home\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.330906 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.330700    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-tmp-dir\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.330906 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.330747    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8465ac86-acad-43f4-8085-b453f06e4a1d-tls-certs\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.330906 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.330806    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdjkn\" (UniqueName: \"kubernetes.io/projected/8465ac86-acad-43f4-8085-b453f06e4a1d-kube-api-access-vdjkn\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.330906 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.330848    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-dshm\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.331162 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.331030    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-model-cache\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.331162 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.331123    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-home\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.331276 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.331175    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-tmp-dir\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.331276 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.331253    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-model-cache\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.333204 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.333182    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-dshm\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.333338 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.333320    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8465ac86-acad-43f4-8085-b453f06e4a1d-tls-certs\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.339161 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.339142    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdjkn\" (UniqueName: \"kubernetes.io/projected/8465ac86-acad-43f4-8085-b453f06e4a1d-kube-api-access-vdjkn\") pod \"e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") " pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.441784 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.441676    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:17.571880 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:17.571852    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"]
Jul 29 18:17:17.573813 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:17:17.573790    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8465ac86_acad_43f4_8085_b453f06e4a1d.slice/crio-0423bfdb14f2be8110ea8072fa19f2d03f46d70946cf103d147701a0664486d4 WatchSource:0}: Error finding container 0423bfdb14f2be8110ea8072fa19f2d03f46d70946cf103d147701a0664486d4: Status 404 returned error can't find the container with id 0423bfdb14f2be8110ea8072fa19f2d03f46d70946cf103d147701a0664486d4
Jul 29 18:17:18.138586 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:18.138546    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6" event={"ID":"8465ac86-acad-43f4-8085-b453f06e4a1d","Type":"ContainerStarted","Data":"9157d496c124f094e3b07f802e2a692132a92ef767588bf477fb19d0b2f14b6c"}
Jul 29 18:17:18.139043 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:18.138593    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6" event={"ID":"8465ac86-acad-43f4-8085-b453f06e4a1d","Type":"ContainerStarted","Data":"0423bfdb14f2be8110ea8072fa19f2d03f46d70946cf103d147701a0664486d4"}
Jul 29 18:17:18.156096 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:18.156040    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6" podStartSLOduration=1.156024729 podStartE2EDuration="1.156024729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:17:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:17:18.154430458 +0000 UTC m=+1466.502658554" watchObservedRunningTime="2026-07-29 18:17:18.156024729 +0000 UTC m=+1466.504252821"
Jul 29 18:17:20.322357 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:20.322321    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:17:27.442180 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:27.442067    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:27.442180 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:27.442131    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:27.454857 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:27.454826    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:28.202046 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:28.202015    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:17:36.425303 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:17:36.425270    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:18:01.825537 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:01.825505    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"]
Jul 29 18:18:05.712174 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:05.712136    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:18:16.844470 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:16.844379    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6" podUID="8465ac86-acad-43f4-8085-b453f06e4a1d" containerName="main" containerID="cri-o://9157d496c124f094e3b07f802e2a692132a92ef767588bf477fb19d0b2f14b6c" gracePeriod=45
Jul 29 18:18:17.102816 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.102758    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:18:17.156666 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.156637    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-home\") pod \"8465ac86-acad-43f4-8085-b453f06e4a1d\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") "
Jul 29 18:18:17.156823 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.156680    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-dshm\") pod \"8465ac86-acad-43f4-8085-b453f06e4a1d\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") "
Jul 29 18:18:17.156823 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.156732    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-model-cache\") pod \"8465ac86-acad-43f4-8085-b453f06e4a1d\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") "
Jul 29 18:18:17.156823 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.156762    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdjkn\" (UniqueName: \"kubernetes.io/projected/8465ac86-acad-43f4-8085-b453f06e4a1d-kube-api-access-vdjkn\") pod \"8465ac86-acad-43f4-8085-b453f06e4a1d\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") "
Jul 29 18:18:17.156973 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.156828    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-tmp-dir\") pod \"8465ac86-acad-43f4-8085-b453f06e4a1d\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") "
Jul 29 18:18:17.156973 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.156881    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8465ac86-acad-43f4-8085-b453f06e4a1d-tls-certs\") pod \"8465ac86-acad-43f4-8085-b453f06e4a1d\" (UID: \"8465ac86-acad-43f4-8085-b453f06e4a1d\") "
Jul 29 18:18:17.156973 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.156942    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-home" (OuterVolumeSpecName: "home") pod "8465ac86-acad-43f4-8085-b453f06e4a1d" (UID: "8465ac86-acad-43f4-8085-b453f06e4a1d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:18:17.157158 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.157058    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-model-cache" (OuterVolumeSpecName: "model-cache") pod "8465ac86-acad-43f4-8085-b453f06e4a1d" (UID: "8465ac86-acad-43f4-8085-b453f06e4a1d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:18:17.157158 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.157104    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8465ac86-acad-43f4-8085-b453f06e4a1d" (UID: "8465ac86-acad-43f4-8085-b453f06e4a1d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:18:17.157158 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.157133    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-home\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:18:17.159040 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.159016    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8465ac86-acad-43f4-8085-b453f06e4a1d-kube-api-access-vdjkn" (OuterVolumeSpecName: "kube-api-access-vdjkn") pod "8465ac86-acad-43f4-8085-b453f06e4a1d" (UID: "8465ac86-acad-43f4-8085-b453f06e4a1d"). InnerVolumeSpecName "kube-api-access-vdjkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:18:17.159040 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.159022    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8465ac86-acad-43f4-8085-b453f06e4a1d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8465ac86-acad-43f4-8085-b453f06e4a1d" (UID: "8465ac86-acad-43f4-8085-b453f06e4a1d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 18:18:17.159147 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.159071    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-dshm" (OuterVolumeSpecName: "dshm") pod "8465ac86-acad-43f4-8085-b453f06e4a1d" (UID: "8465ac86-acad-43f4-8085-b453f06e4a1d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:18:17.257773 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.257737    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-tmp-dir\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:18:17.257773 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.257767    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8465ac86-acad-43f4-8085-b453f06e4a1d-tls-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:18:17.257773 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.257776    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-dshm\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:18:17.258025 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.257784    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8465ac86-acad-43f4-8085-b453f06e4a1d-model-cache\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:18:17.258025 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.257794    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdjkn\" (UniqueName: \"kubernetes.io/projected/8465ac86-acad-43f4-8085-b453f06e4a1d-kube-api-access-vdjkn\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:18:17.442157 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.442068    2567 generic.go:356] "Generic (PLEG): container finished" podID="8465ac86-acad-43f4-8085-b453f06e4a1d" containerID="9157d496c124f094e3b07f802e2a692132a92ef767588bf477fb19d0b2f14b6c" exitCode=0
Jul 29 18:18:17.442157 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.442111    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"
Jul 29 18:18:17.442157 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.442129    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6" event={"ID":"8465ac86-acad-43f4-8085-b453f06e4a1d","Type":"ContainerDied","Data":"9157d496c124f094e3b07f802e2a692132a92ef767588bf477fb19d0b2f14b6c"}
Jul 29 18:18:17.442157 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.442159    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6" event={"ID":"8465ac86-acad-43f4-8085-b453f06e4a1d","Type":"ContainerDied","Data":"0423bfdb14f2be8110ea8072fa19f2d03f46d70946cf103d147701a0664486d4"}
Jul 29 18:18:17.442453 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.442175    2567 scope.go:117] "RemoveContainer" containerID="9157d496c124f094e3b07f802e2a692132a92ef767588bf477fb19d0b2f14b6c"
Jul 29 18:18:17.454323 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.454301    2567 scope.go:117] "RemoveContainer" containerID="9157d496c124f094e3b07f802e2a692132a92ef767588bf477fb19d0b2f14b6c"
Jul 29 18:18:17.454614 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:18:17.454594    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9157d496c124f094e3b07f802e2a692132a92ef767588bf477fb19d0b2f14b6c\": container with ID starting with 9157d496c124f094e3b07f802e2a692132a92ef767588bf477fb19d0b2f14b6c not found: ID does not exist" containerID="9157d496c124f094e3b07f802e2a692132a92ef767588bf477fb19d0b2f14b6c"
Jul 29 18:18:17.454685 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.454627    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9157d496c124f094e3b07f802e2a692132a92ef767588bf477fb19d0b2f14b6c"} err="failed to get container status \"9157d496c124f094e3b07f802e2a692132a92ef767588bf477fb19d0b2f14b6c\": rpc error: code = NotFound desc = could not find container \"9157d496c124f094e3b07f802e2a692132a92ef767588bf477fb19d0b2f14b6c\": container with ID starting with 9157d496c124f094e3b07f802e2a692132a92ef767588bf477fb19d0b2f14b6c not found: ID does not exist"
Jul 29 18:18:17.465812 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.465791    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"]
Jul 29 18:18:17.469147 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:17.469126    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-86953ea5-kserve-58b8cc757f-9knv6"]
Jul 29 18:18:18.073881 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:18.073847    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8465ac86-acad-43f4-8085-b453f06e4a1d" path="/var/lib/kubelet/pods/8465ac86-acad-43f4-8085-b453f06e4a1d/volumes"
Jul 29 18:18:19.816725 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:19.816681    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:18:26.521009 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:26.520955    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:18:42.720606 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:42.720560    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:18:56.917179 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:18:56.917137    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:19:06.815239 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:19:06.815205    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:19:20.926003 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:19:20.925962    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:19:31.723774 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:19:31.723734    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:19:48.509855 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:19:48.509771    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:20:02.422823 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:20:02.422784    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:20:14.914721 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:20:14.914682    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:20:26.716343 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:20:26.716306    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:20:34.621568 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:20:34.621515    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:20:46.520385 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:20:46.520344    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:20:57.712475 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:20:57.712434    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:21:08.525114 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:08.525063    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:21:16.815110 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:16.815016    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:21:30.012608 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:30.012569    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:21:39.912929 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:39.912886    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:21:49.321045 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.320986    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"]
Jul 29 18:21:49.321579 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.321557    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8465ac86-acad-43f4-8085-b453f06e4a1d" containerName="main"
Jul 29 18:21:49.321790 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.321769    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8465ac86-acad-43f4-8085-b453f06e4a1d" containerName="main"
Jul 29 18:21:49.321948 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.321934    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8465ac86-acad-43f4-8085-b453f06e4a1d" containerName="main"
Jul 29 18:21:49.325215 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.325193    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.328235 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.328210    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a1d6b581-openshift-default-dockercfg-pnpwz\""
Jul 29 18:21:49.343951 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.343916    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"]
Jul 29 18:21:49.441510 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.441465    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-data\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.441710 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.441537    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-podinfo\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.441710 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.441558    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istiod-ca-cert\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.441710 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.441575    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-token\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.441710 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.441642    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-workload-certs\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.441710 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.441687    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-credential-socket\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.441710 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.441706    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-envoy\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.441910 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.441730    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qw9t\" (UniqueName: \"kubernetes.io/projected/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-kube-api-access-6qw9t\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.441910 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.441775    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-workload-socket\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.542378 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.542335    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-data\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.542593 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.542422    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-podinfo\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.542593 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.542450    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istiod-ca-cert\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.542593 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.542472    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-token\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.542593 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.542500    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-workload-certs\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.542593 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.542526    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-credential-socket\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.542593 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.542549    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-envoy\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.543046 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.543025    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-workload-certs\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.543046 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.543036    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qw9t\" (UniqueName: \"kubernetes.io/projected/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-kube-api-access-6qw9t\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.543186 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.542881    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-credential-socket\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.543186 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.542811    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-data\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.543186 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.543106    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-workload-socket\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.543320 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.543263    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istiod-ca-cert\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.543415 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.543397    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-workload-socket\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.544948 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.544927    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-envoy\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.545169 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.545150    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-podinfo\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.552207 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.552174    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qw9t\" (UniqueName: \"kubernetes.io/projected/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-kube-api-access-6qw9t\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.552500 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.552468    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-token\") pod \"e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") " pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.636324 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.636223    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:49.777639 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.777604    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"]
Jul 29 18:21:49.778693 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:21:49.778668    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e9756d8_bc8d_45d4_abc2_85e123f1c2c4.slice/crio-07b5c9101b08fa1b524e2bf2970d0efc772333ab904667f00a89b2e56bf4ac86 WatchSource:0}: Error finding container 07b5c9101b08fa1b524e2bf2970d0efc772333ab904667f00a89b2e56bf4ac86: Status 404 returned error can't find the container with id 07b5c9101b08fa1b524e2bf2970d0efc772333ab904667f00a89b2e56bf4ac86
Jul 29 18:21:49.781365 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.781327    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:21:49.781462 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.781401    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:21:49.781462 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:49.781431    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:21:50.216787 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:50.216754    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:21:50.531119 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:50.531074    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9" event={"ID":"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4","Type":"ContainerStarted","Data":"c7e76c60ef55890d8e99a4e0c2216801b66f3933f31040a13f0a588a879b78f3"}
Jul 29 18:21:50.531536 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:50.531133    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9" event={"ID":"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4","Type":"ContainerStarted","Data":"07b5c9101b08fa1b524e2bf2970d0efc772333ab904667f00a89b2e56bf4ac86"}
Jul 29 18:21:50.554447 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:50.554385    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9" podStartSLOduration=1.554366331 podStartE2EDuration="1.554366331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:21:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:21:50.552416598 +0000 UTC m=+1738.900644696" watchObservedRunningTime="2026-07-29 18:21:50.554366331 +0000 UTC m=+1738.902594424"
Jul 29 18:21:50.637212 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:50.637162    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:50.642224 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:50.642195    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:51.536986 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:51.536953    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:51.537976 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:51.537957    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:21:59.022278 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:21:59.022241    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:22:07.196129 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:07.194976    2567 patch_prober.go:28] interesting pod/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": read tcp 10.132.0.2:51082->10.132.0.42:15021: read: connection reset by peer" start-of-body=
Jul 29 18:22:07.196129 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:07.195087    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9" podUID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": read tcp 10.132.0.2:51082->10.132.0.42:15021: read: connection reset by peer"
Jul 29 18:22:07.622677 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:07.622641    2567 generic.go:356] "Generic (PLEG): container finished" podID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerID="c7e76c60ef55890d8e99a4e0c2216801b66f3933f31040a13f0a588a879b78f3" exitCode=0
Jul 29 18:22:07.622868 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:07.622715    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9" event={"ID":"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4","Type":"ContainerDied","Data":"c7e76c60ef55890d8e99a4e0c2216801b66f3933f31040a13f0a588a879b78f3"}
Jul 29 18:22:07.623114 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:07.623099    2567 scope.go:117] "RemoveContainer" containerID="c7e76c60ef55890d8e99a4e0c2216801b66f3933f31040a13f0a588a879b78f3"
Jul 29 18:22:07.624161 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:07.624136    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:22:07.624226 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:07.624200    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:22:07.624261 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:07.624246    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:22:08.630072 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:08.630034    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9" event={"ID":"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4","Type":"ContainerStarted","Data":"1acfc64a3af8b4b7178b4a39f5f635ccb388da026cf05ca0cc0d3c968c9a31a8"}
Jul 29 18:22:08.636716 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:08.636681    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:22:08.636940 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:08.636918    2567 patch_prober.go:28] interesting pod/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 29 18:22:08.636984 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:08.636965    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9" podUID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 29 18:22:09.636677 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:09.636638    2567 patch_prober.go:28] interesting pod/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 29 18:22:09.637237 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:09.636690    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9" podUID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 29 18:22:10.637256 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:10.637210    2567 patch_prober.go:28] interesting pod/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 29 18:22:10.637698 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:10.637282    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9" podUID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 29 18:22:11.637056 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:11.637016    2567 patch_prober.go:28] interesting pod/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 29 18:22:11.637245 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:11.637078    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9" podUID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 29 18:22:12.637312 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:12.637274    2567 patch_prober.go:28] interesting pod/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 29 18:22:12.637769 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:12.637331    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9" podUID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 29 18:22:13.640377 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:13.640345    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:22:13.640854 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:13.640822    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:22:13.641605 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:13.641587    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:22:23.818477 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:23.818437    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"]
Jul 29 18:22:23.819035 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:23.818671    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9" podUID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerName="istio-proxy" containerID="cri-o://1acfc64a3af8b4b7178b4a39f5f635ccb388da026cf05ca0cc0d3c968c9a31a8" gracePeriod=30
Jul 29 18:22:27.817896 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:27.817856    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:22:28.642891 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:28.642854    2567 patch_prober.go:28] interesting pod/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 18:22:28.643085 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:28.642913    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9" podUID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 18:22:29.071507 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.071477    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:22:29.111055 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.111027    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-credential-socket\") pod \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") "
Jul 29 18:22:29.111253 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.111062    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-podinfo\") pod \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") "
Jul 29 18:22:29.111253 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.111089    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istiod-ca-cert\") pod \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") "
Jul 29 18:22:29.111253 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.111111    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-envoy\") pod \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") "
Jul 29 18:22:29.111253 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.111241    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-workload-socket\") pod \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") "
Jul 29 18:22:29.111509 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.111306    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-token\") pod \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") "
Jul 29 18:22:29.111509 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.111359    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-data\") pod \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") "
Jul 29 18:22:29.111509 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.111382    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-workload-certs\") pod \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") "
Jul 29 18:22:29.111509 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.111360    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" (UID: "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:22:29.111509 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.111483    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" (UID: "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:22:29.111774 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.111596    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" (UID: "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:22:29.111774 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.111689    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-credential-socket\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:22:29.111774 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.111709    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istiod-ca-cert\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:22:29.111943 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.111778    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" (UID: "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:22:29.112248 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.112224    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" (UID: "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:22:29.113674 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.113649    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" (UID: "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:22:29.113774 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.113720    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" (UID: "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:22:29.113857 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.113830    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" (UID: "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 18:22:29.212177 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.212076    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qw9t\" (UniqueName: \"kubernetes.io/projected/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-kube-api-access-6qw9t\") pod \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\" (UID: \"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4\") "
Jul 29 18:22:29.212356 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.212334    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-token\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:22:29.212356 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.212353    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-data\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:22:29.212463 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.212366    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-workload-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:22:29.212463 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.212378    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-podinfo\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:22:29.212463 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.212390    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-istio-envoy\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:22:29.212463 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.212403    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-workload-socket\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:22:29.214121 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.214096    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-kube-api-access-6qw9t" (OuterVolumeSpecName: "kube-api-access-6qw9t") pod "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" (UID: "8e9756d8-bc8d-45d4-abc2-85e123f1c2c4"). InnerVolumeSpecName "kube-api-access-6qw9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:22:29.313118 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.313088    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qw9t\" (UniqueName: \"kubernetes.io/projected/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4-kube-api-access-6qw9t\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:22:29.748377 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.748344    2567 generic.go:356] "Generic (PLEG): container finished" podID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerID="1acfc64a3af8b4b7178b4a39f5f635ccb388da026cf05ca0cc0d3c968c9a31a8" exitCode=0
Jul 29 18:22:29.748560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.748396    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"
Jul 29 18:22:29.748560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.748422    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9" event={"ID":"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4","Type":"ContainerDied","Data":"1acfc64a3af8b4b7178b4a39f5f635ccb388da026cf05ca0cc0d3c968c9a31a8"}
Jul 29 18:22:29.748560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.748479    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9" event={"ID":"8e9756d8-bc8d-45d4-abc2-85e123f1c2c4","Type":"ContainerDied","Data":"07b5c9101b08fa1b524e2bf2970d0efc772333ab904667f00a89b2e56bf4ac86"}
Jul 29 18:22:29.748560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.748504    2567 scope.go:117] "RemoveContainer" containerID="1acfc64a3af8b4b7178b4a39f5f635ccb388da026cf05ca0cc0d3c968c9a31a8"
Jul 29 18:22:29.758530 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.758508    2567 scope.go:117] "RemoveContainer" containerID="c7e76c60ef55890d8e99a4e0c2216801b66f3933f31040a13f0a588a879b78f3"
Jul 29 18:22:29.766688 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.766668    2567 scope.go:117] "RemoveContainer" containerID="1acfc64a3af8b4b7178b4a39f5f635ccb388da026cf05ca0cc0d3c968c9a31a8"
Jul 29 18:22:29.766965 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:22:29.766948    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1acfc64a3af8b4b7178b4a39f5f635ccb388da026cf05ca0cc0d3c968c9a31a8\": container with ID starting with 1acfc64a3af8b4b7178b4a39f5f635ccb388da026cf05ca0cc0d3c968c9a31a8 not found: ID does not exist" containerID="1acfc64a3af8b4b7178b4a39f5f635ccb388da026cf05ca0cc0d3c968c9a31a8"
Jul 29 18:22:29.767029 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.766983    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1acfc64a3af8b4b7178b4a39f5f635ccb388da026cf05ca0cc0d3c968c9a31a8"} err="failed to get container status \"1acfc64a3af8b4b7178b4a39f5f635ccb388da026cf05ca0cc0d3c968c9a31a8\": rpc error: code = NotFound desc = could not find container \"1acfc64a3af8b4b7178b4a39f5f635ccb388da026cf05ca0cc0d3c968c9a31a8\": container with ID starting with 1acfc64a3af8b4b7178b4a39f5f635ccb388da026cf05ca0cc0d3c968c9a31a8 not found: ID does not exist"
Jul 29 18:22:29.767029 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.767024    2567 scope.go:117] "RemoveContainer" containerID="c7e76c60ef55890d8e99a4e0c2216801b66f3933f31040a13f0a588a879b78f3"
Jul 29 18:22:29.767286 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:22:29.767265    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7e76c60ef55890d8e99a4e0c2216801b66f3933f31040a13f0a588a879b78f3\": container with ID starting with c7e76c60ef55890d8e99a4e0c2216801b66f3933f31040a13f0a588a879b78f3 not found: ID does not exist" containerID="c7e76c60ef55890d8e99a4e0c2216801b66f3933f31040a13f0a588a879b78f3"
Jul 29 18:22:29.767344 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.767291    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e76c60ef55890d8e99a4e0c2216801b66f3933f31040a13f0a588a879b78f3"} err="failed to get container status \"c7e76c60ef55890d8e99a4e0c2216801b66f3933f31040a13f0a588a879b78f3\": rpc error: code = NotFound desc = could not find container \"c7e76c60ef55890d8e99a4e0c2216801b66f3933f31040a13f0a588a879b78f3\": container with ID starting with c7e76c60ef55890d8e99a4e0c2216801b66f3933f31040a13f0a588a879b78f3 not found: ID does not exist"
Jul 29 18:22:29.772043 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.772012    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"]
Jul 29 18:22:29.775574 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:29.775551    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a1d6b581-openshift-default-898f479fb-6ngv9"]
Jul 29 18:22:30.079787 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:30.079697    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" path="/var/lib/kubelet/pods/8e9756d8-bc8d-45d4-abc2-85e123f1c2c4/volumes"
Jul 29 18:22:40.418076 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:22:40.418038    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:23:05.514661 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:05.514624    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:23:16.724293 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:16.724256    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:23:48.838926 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.838892    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"]
Jul 29 18:23:48.839434 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.839277    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerName="istio-proxy"
Jul 29 18:23:48.839434 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.839291    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerName="istio-proxy"
Jul 29 18:23:48.839434 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.839302    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerName="istio-proxy"
Jul 29 18:23:48.839434 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.839308    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerName="istio-proxy"
Jul 29 18:23:48.839434 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.839363    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerName="istio-proxy"
Jul 29 18:23:48.841554 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.841537    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:48.844111 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.844091    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0eed4609-openshift-default-dockercfg-sk8pb\""
Jul 29 18:23:48.854291 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.854266    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"]
Jul 29 18:23:48.899776 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.899737    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-workload-certs\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:48.899776 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.899778    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-token\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:48.900067 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.899799    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-data\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:48.900067 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.899816    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5757add2-5691-4f0b-b35c-73afc4edd5d7-istiod-ca-cert\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:48.900067 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.899884    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-podinfo\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:48.900067 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.899943    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-credential-socket\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:48.900067 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.899970    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-envoy\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:48.900067 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.900029    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-workload-socket\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:48.900284 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:48.900074    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqhgj\" (UniqueName: \"kubernetes.io/projected/5757add2-5691-4f0b-b35c-73afc4edd5d7-kube-api-access-dqhgj\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.000586 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.000547    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqhgj\" (UniqueName: \"kubernetes.io/projected/5757add2-5691-4f0b-b35c-73afc4edd5d7-kube-api-access-dqhgj\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.000817 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.000670    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-workload-certs\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.000817 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.000693    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-token\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.000817 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.000715    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-data\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.000817 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.000738    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5757add2-5691-4f0b-b35c-73afc4edd5d7-istiod-ca-cert\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.000817 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.000768    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-podinfo\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.000817 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.000797    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-credential-socket\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.001373 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.000821    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-envoy\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.001373 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.000849    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-workload-socket\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.001373 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.001278    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-credential-socket\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.001373 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.001310    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-workload-socket\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.001373 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.001366    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-data\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.001595 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.001570    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5757add2-5691-4f0b-b35c-73afc4edd5d7-istiod-ca-cert\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.001694 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.001673    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-workload-certs\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.003216 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.003194    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-envoy\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.003535 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.003511    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-podinfo\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.008913 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.008886    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-token\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.009176 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.009154    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqhgj\" (UniqueName: \"kubernetes.io/projected/5757add2-5691-4f0b-b35c-73afc4edd5d7-kube-api-access-dqhgj\") pod \"e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") " pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.154576 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.154492    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:49.294357 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.294320    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"]
Jul 29 18:23:49.295177 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:23:49.295142    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5757add2_5691_4f0b_b35c_73afc4edd5d7.slice/crio-4c97d6289ab8091359b987d0f0a310abd0755d69c472a3956342e7fdb001d363 WatchSource:0}: Error finding container 4c97d6289ab8091359b987d0f0a310abd0755d69c472a3956342e7fdb001d363: Status 404 returned error can't find the container with id 4c97d6289ab8091359b987d0f0a310abd0755d69c472a3956342e7fdb001d363
Jul 29 18:23:49.298490 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.298439    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:23:49.298610 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.298528    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:23:49.298610 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:49.298572    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:23:50.169115 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:50.169072    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj" event={"ID":"5757add2-5691-4f0b-b35c-73afc4edd5d7","Type":"ContainerStarted","Data":"8c9077ba33cd5f11a50f959b9153a994f0e4fd78eeff60904b90bc198e0e0168"}
Jul 29 18:23:50.169645 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:50.169141    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj" event={"ID":"5757add2-5691-4f0b-b35c-73afc4edd5d7","Type":"ContainerStarted","Data":"4c97d6289ab8091359b987d0f0a310abd0755d69c472a3956342e7fdb001d363"}
Jul 29 18:23:50.193090 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:50.193029    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj" podStartSLOduration=2.193013121 podStartE2EDuration="2.193013121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:23:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:23:50.189755777 +0000 UTC m=+1858.537983871" watchObservedRunningTime="2026-07-29 18:23:50.193013121 +0000 UTC m=+1858.541241291"
Jul 29 18:23:51.123289 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:51.123242    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:23:51.155520 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:51.155480    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:51.161240 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:51.161208    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:51.173921 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:51.173896    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:23:51.174687 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:23:51.174668    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:24:01.917446 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:01.917404    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:24:06.176079 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:06.176038    2567 patch_prober.go:28] interesting pod/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 29 18:24:06.176527 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:06.176127    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj" podUID="5757add2-5691-4f0b-b35c-73afc4edd5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 29 18:24:06.256794 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:06.256759    2567 generic.go:356] "Generic (PLEG): container finished" podID="5757add2-5691-4f0b-b35c-73afc4edd5d7" containerID="8c9077ba33cd5f11a50f959b9153a994f0e4fd78eeff60904b90bc198e0e0168" exitCode=0
Jul 29 18:24:06.256984 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:06.256835    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj" event={"ID":"5757add2-5691-4f0b-b35c-73afc4edd5d7","Type":"ContainerDied","Data":"8c9077ba33cd5f11a50f959b9153a994f0e4fd78eeff60904b90bc198e0e0168"}
Jul 29 18:24:06.257282 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:06.257265    2567 scope.go:117] "RemoveContainer" containerID="8c9077ba33cd5f11a50f959b9153a994f0e4fd78eeff60904b90bc198e0e0168"
Jul 29 18:24:06.258300 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:06.258273    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:24:06.258388 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:06.258339    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:24:06.258388 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:06.258373    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:24:07.267599 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:07.267560    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj" event={"ID":"5757add2-5691-4f0b-b35c-73afc4edd5d7","Type":"ContainerStarted","Data":"b50cd837b6fbb8a560b4770d912d6b069704cfa30283d70a184637c803f18c88"}
Jul 29 18:24:08.155516 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:08.155469    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:24:08.155819 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:08.155786    2567 patch_prober.go:28] interesting pod/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 29 18:24:08.156053 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:08.156025    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj" podUID="5757add2-5691-4f0b-b35c-73afc4edd5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 29 18:24:09.154952 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:09.154899    2567 patch_prober.go:28] interesting pod/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 29 18:24:09.155531 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:09.154977    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj" podUID="5757add2-5691-4f0b-b35c-73afc4edd5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 29 18:24:10.155940 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:10.155892    2567 patch_prober.go:28] interesting pod/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 29 18:24:10.156624 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:10.156581    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj" podUID="5757add2-5691-4f0b-b35c-73afc4edd5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 29 18:24:11.155671 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:11.155629    2567 patch_prober.go:28] interesting pod/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 29 18:24:11.156022 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:11.155963    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj" podUID="5757add2-5691-4f0b-b35c-73afc4edd5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 29 18:24:12.158698 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:12.158665    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:24:12.159180 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:12.159082    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:24:12.159689 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:12.159672    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:24:23.506645 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:23.506559    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"]
Jul 29 18:24:23.507250 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:23.506782    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj" podUID="5757add2-5691-4f0b-b35c-73afc4edd5d7" containerName="istio-proxy" containerID="cri-o://b50cd837b6fbb8a560b4770d912d6b069704cfa30283d70a184637c803f18c88" gracePeriod=30
Jul 29 18:24:25.416840 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:25.416800    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:24:27.162007 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:27.161950    2567 patch_prober.go:28] interesting pod/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 29 18:24:27.162485 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:27.162058    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj" podUID="5757add2-5691-4f0b-b35c-73afc4edd5d7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 18:24:28.766648 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.766621    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:24:28.872016 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.871898    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-envoy\") pod \"5757add2-5691-4f0b-b35c-73afc4edd5d7\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") "
Jul 29 18:24:28.872016 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.871948    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqhgj\" (UniqueName: \"kubernetes.io/projected/5757add2-5691-4f0b-b35c-73afc4edd5d7-kube-api-access-dqhgj\") pod \"5757add2-5691-4f0b-b35c-73afc4edd5d7\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") "
Jul 29 18:24:28.872016 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.871969    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-credential-socket\") pod \"5757add2-5691-4f0b-b35c-73afc4edd5d7\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") "
Jul 29 18:24:28.872016 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.872019    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-token\") pod \"5757add2-5691-4f0b-b35c-73afc4edd5d7\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") "
Jul 29 18:24:28.872378 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.872142    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-data\") pod \"5757add2-5691-4f0b-b35c-73afc4edd5d7\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") "
Jul 29 18:24:28.872378 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.872194    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5757add2-5691-4f0b-b35c-73afc4edd5d7-istiod-ca-cert\") pod \"5757add2-5691-4f0b-b35c-73afc4edd5d7\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") "
Jul 29 18:24:28.872378 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.872217    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-workload-socket\") pod \"5757add2-5691-4f0b-b35c-73afc4edd5d7\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") "
Jul 29 18:24:28.872378 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.872277    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-workload-certs\") pod \"5757add2-5691-4f0b-b35c-73afc4edd5d7\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") "
Jul 29 18:24:28.872378 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.872312    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-podinfo\") pod \"5757add2-5691-4f0b-b35c-73afc4edd5d7\" (UID: \"5757add2-5691-4f0b-b35c-73afc4edd5d7\") "
Jul 29 18:24:28.872614 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.872478    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5757add2-5691-4f0b-b35c-73afc4edd5d7" (UID: "5757add2-5691-4f0b-b35c-73afc4edd5d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:24:28.872614 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.872575    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5757add2-5691-4f0b-b35c-73afc4edd5d7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5757add2-5691-4f0b-b35c-73afc4edd5d7" (UID: "5757add2-5691-4f0b-b35c-73afc4edd5d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:24:28.872730 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.872691    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5757add2-5691-4f0b-b35c-73afc4edd5d7" (UID: "5757add2-5691-4f0b-b35c-73afc4edd5d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:24:28.872826 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.872787    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-credential-socket\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:24:28.872890 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.872832    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5757add2-5691-4f0b-b35c-73afc4edd5d7-istiod-ca-cert\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:24:28.872890 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.872848    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-workload-socket\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:24:28.872965 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.872904    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5757add2-5691-4f0b-b35c-73afc4edd5d7" (UID: "5757add2-5691-4f0b-b35c-73afc4edd5d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:24:28.873037 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.872968    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-data" (OuterVolumeSpecName: "istio-data") pod "5757add2-5691-4f0b-b35c-73afc4edd5d7" (UID: "5757add2-5691-4f0b-b35c-73afc4edd5d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:24:28.874350 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.874326    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5757add2-5691-4f0b-b35c-73afc4edd5d7" (UID: "5757add2-5691-4f0b-b35c-73afc4edd5d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:24:28.874450 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.874323    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5757add2-5691-4f0b-b35c-73afc4edd5d7-kube-api-access-dqhgj" (OuterVolumeSpecName: "kube-api-access-dqhgj") pod "5757add2-5691-4f0b-b35c-73afc4edd5d7" (UID: "5757add2-5691-4f0b-b35c-73afc4edd5d7"). InnerVolumeSpecName "kube-api-access-dqhgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:24:28.874544 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.874521    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-token" (OuterVolumeSpecName: "istio-token") pod "5757add2-5691-4f0b-b35c-73afc4edd5d7" (UID: "5757add2-5691-4f0b-b35c-73afc4edd5d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:24:28.874748 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.874728    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5757add2-5691-4f0b-b35c-73afc4edd5d7" (UID: "5757add2-5691-4f0b-b35c-73afc4edd5d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 18:24:28.973535 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.973490    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-token\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:24:28.973535 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.973527    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-data\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:24:28.973535 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.973535    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-workload-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:24:28.973535 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.973546    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-podinfo\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:24:28.973801 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.973555    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5757add2-5691-4f0b-b35c-73afc4edd5d7-istio-envoy\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:24:28.973801 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:28.973563    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqhgj\" (UniqueName: \"kubernetes.io/projected/5757add2-5691-4f0b-b35c-73afc4edd5d7-kube-api-access-dqhgj\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:24:29.387135 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:29.387101    2567 generic.go:356] "Generic (PLEG): container finished" podID="5757add2-5691-4f0b-b35c-73afc4edd5d7" containerID="b50cd837b6fbb8a560b4770d912d6b069704cfa30283d70a184637c803f18c88" exitCode=0
Jul 29 18:24:29.387319 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:29.387147    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"
Jul 29 18:24:29.387319 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:29.387180    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj" event={"ID":"5757add2-5691-4f0b-b35c-73afc4edd5d7","Type":"ContainerDied","Data":"b50cd837b6fbb8a560b4770d912d6b069704cfa30283d70a184637c803f18c88"}
Jul 29 18:24:29.387319 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:29.387235    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj" event={"ID":"5757add2-5691-4f0b-b35c-73afc4edd5d7","Type":"ContainerDied","Data":"4c97d6289ab8091359b987d0f0a310abd0755d69c472a3956342e7fdb001d363"}
Jul 29 18:24:29.387319 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:29.387258    2567 scope.go:117] "RemoveContainer" containerID="b50cd837b6fbb8a560b4770d912d6b069704cfa30283d70a184637c803f18c88"
Jul 29 18:24:29.396733 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:29.396717    2567 scope.go:117] "RemoveContainer" containerID="8c9077ba33cd5f11a50f959b9153a994f0e4fd78eeff60904b90bc198e0e0168"
Jul 29 18:24:29.404897 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:29.404878    2567 scope.go:117] "RemoveContainer" containerID="b50cd837b6fbb8a560b4770d912d6b069704cfa30283d70a184637c803f18c88"
Jul 29 18:24:29.405172 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:24:29.405152    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b50cd837b6fbb8a560b4770d912d6b069704cfa30283d70a184637c803f18c88\": container with ID starting with b50cd837b6fbb8a560b4770d912d6b069704cfa30283d70a184637c803f18c88 not found: ID does not exist" containerID="b50cd837b6fbb8a560b4770d912d6b069704cfa30283d70a184637c803f18c88"
Jul 29 18:24:29.405264 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:29.405190    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b50cd837b6fbb8a560b4770d912d6b069704cfa30283d70a184637c803f18c88"} err="failed to get container status \"b50cd837b6fbb8a560b4770d912d6b069704cfa30283d70a184637c803f18c88\": rpc error: code = NotFound desc = could not find container \"b50cd837b6fbb8a560b4770d912d6b069704cfa30283d70a184637c803f18c88\": container with ID starting with b50cd837b6fbb8a560b4770d912d6b069704cfa30283d70a184637c803f18c88 not found: ID does not exist"
Jul 29 18:24:29.405264 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:29.405217    2567 scope.go:117] "RemoveContainer" containerID="8c9077ba33cd5f11a50f959b9153a994f0e4fd78eeff60904b90bc198e0e0168"
Jul 29 18:24:29.405481 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:24:29.405463    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c9077ba33cd5f11a50f959b9153a994f0e4fd78eeff60904b90bc198e0e0168\": container with ID starting with 8c9077ba33cd5f11a50f959b9153a994f0e4fd78eeff60904b90bc198e0e0168 not found: ID does not exist" containerID="8c9077ba33cd5f11a50f959b9153a994f0e4fd78eeff60904b90bc198e0e0168"
Jul 29 18:24:29.405521 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:29.405488    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c9077ba33cd5f11a50f959b9153a994f0e4fd78eeff60904b90bc198e0e0168"} err="failed to get container status \"8c9077ba33cd5f11a50f959b9153a994f0e4fd78eeff60904b90bc198e0e0168\": rpc error: code = NotFound desc = could not find container \"8c9077ba33cd5f11a50f959b9153a994f0e4fd78eeff60904b90bc198e0e0168\": container with ID starting with 8c9077ba33cd5f11a50f959b9153a994f0e4fd78eeff60904b90bc198e0e0168 not found: ID does not exist"
Jul 29 18:24:29.409855 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:29.409831    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"]
Jul 29 18:24:29.414527 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:29.414505    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0eed4609-openshift-default-5ccd54b456-z7zbj"]
Jul 29 18:24:30.075214 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:24:30.075181    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5757add2-5691-4f0b-b35c-73afc4edd5d7" path="/var/lib/kubelet/pods/5757add2-5691-4f0b-b35c-73afc4edd5d7/volumes"
Jul 29 18:25:50.621075 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:25:50.620973    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:25:59.056666 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:25:59.056625    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:26:11.835384 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:26:11.835348    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:26:21.420070 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:26:21.420029    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:26:56.417280 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:26:56.417247    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:27:29.816008 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:29.815958    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:27:57.819518 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.819485    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"]
Jul 29 18:27:57.819921 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.819812    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5757add2-5691-4f0b-b35c-73afc4edd5d7" containerName="istio-proxy"
Jul 29 18:27:57.819921 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.819822    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5757add2-5691-4f0b-b35c-73afc4edd5d7" containerName="istio-proxy"
Jul 29 18:27:57.819921 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.819881    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e9756d8-bc8d-45d4-abc2-85e123f1c2c4" containerName="istio-proxy"
Jul 29 18:27:57.819921 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.819890    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5757add2-5691-4f0b-b35c-73afc4edd5d7" containerName="istio-proxy"
Jul 29 18:27:57.819921 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.819898    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5757add2-5691-4f0b-b35c-73afc4edd5d7" containerName="istio-proxy"
Jul 29 18:27:57.822823 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.822804    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:57.825758 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.825733    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9245df36\"/\"default-dockercfg-qrzr2\""
Jul 29 18:27:57.827171 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.827152    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9245df36\"/\"e2e-lifecycle-model-9245df36-kserve-self-signed-certs\""
Jul 29 18:27:57.827282 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.827189    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9245df36\"/\"kube-root-ca.crt\""
Jul 29 18:27:57.827282 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.827243    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9245df36\"/\"openshift-service-ca.crt\""
Jul 29 18:27:57.831931 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.831908    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"]
Jul 29 18:27:57.915967 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.915929    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-model-cache\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:57.916162 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.915983    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-tmp-dir\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:57.916162 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.916033    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zdcs\" (UniqueName: \"kubernetes.io/projected/7a44b61b-3b9e-4c15-801b-6b0333c3e254-kube-api-access-5zdcs\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:57.916162 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.916064    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-home\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:57.916162 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.916080    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-dshm\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:57.916307 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:57.916183    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a44b61b-3b9e-4c15-801b-6b0333c3e254-tls-certs\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:58.017369 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.017328    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-model-cache\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:58.017583 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.017381    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-tmp-dir\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:58.017583 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.017398    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zdcs\" (UniqueName: \"kubernetes.io/projected/7a44b61b-3b9e-4c15-801b-6b0333c3e254-kube-api-access-5zdcs\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:58.017583 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.017418    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-home\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:58.017583 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.017432    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-dshm\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:58.017583 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.017471    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a44b61b-3b9e-4c15-801b-6b0333c3e254-tls-certs\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:58.017825 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.017768    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-tmp-dir\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:58.017863 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.017836    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-home\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:58.017901 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.017858    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-model-cache\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:58.019773 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.019756    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-dshm\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:58.019875 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.019858    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a44b61b-3b9e-4c15-801b-6b0333c3e254-tls-certs\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:58.025145 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.025124    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zdcs\" (UniqueName: \"kubernetes.io/projected/7a44b61b-3b9e-4c15-801b-6b0333c3e254-kube-api-access-5zdcs\") pod \"e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") " pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:58.133586 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.133477    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:27:58.269256 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.269229    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"]
Jul 29 18:27:58.270215 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:27:58.270181    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a44b61b_3b9e_4c15_801b_6b0333c3e254.slice/crio-9f098dd9ba3585f8ca3cf362e14b79016c4e3e3b70dc5c2fa39669cdb89ecc1a WatchSource:0}: Error finding container 9f098dd9ba3585f8ca3cf362e14b79016c4e3e3b70dc5c2fa39669cdb89ecc1a: Status 404 returned error can't find the container with id 9f098dd9ba3585f8ca3cf362e14b79016c4e3e3b70dc5c2fa39669cdb89ecc1a
Jul 29 18:27:58.451505 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.451400    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f" event={"ID":"7a44b61b-3b9e-4c15-801b-6b0333c3e254","Type":"ContainerStarted","Data":"ce670766675de48e0dd9922343ad415ef68ff6279ab3756bb011950767b60f09"}
Jul 29 18:27:58.451505 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.451444    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f" event={"ID":"7a44b61b-3b9e-4c15-801b-6b0333c3e254","Type":"ContainerStarted","Data":"9f098dd9ba3585f8ca3cf362e14b79016c4e3e3b70dc5c2fa39669cdb89ecc1a"}
Jul 29 18:27:58.468232 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:27:58.468175    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f" podStartSLOduration=1.46815665 podStartE2EDuration="1.46815665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:27:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:27:58.46789824 +0000 UTC m=+2106.816126335" watchObservedRunningTime="2026-07-29 18:27:58.46815665 +0000 UTC m=+2106.816384745"
Jul 29 18:28:01.057039 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:28:01.057004    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:28:08.134003 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:28:08.133968    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:28:08.134458 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:28:08.134050    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:28:08.146221 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:28:08.146199    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:28:08.515347 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:28:08.515314    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:28:20.417768 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:28:20.417735    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:28:41.513370 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:28:41.513334    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:28:51.316819 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:28:51.316738    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"]
Jul 29 18:28:52.225487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:28:52.225449    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:29:06.335676 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.335624    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f" podUID="7a44b61b-3b9e-4c15-801b-6b0333c3e254" containerName="main" containerID="cri-o://ce670766675de48e0dd9922343ad415ef68ff6279ab3756bb011950767b60f09" gracePeriod=45
Jul 29 18:29:06.586179 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.586116    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:29:06.748126 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.748085    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a44b61b-3b9e-4c15-801b-6b0333c3e254-tls-certs\") pod \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") "
Jul 29 18:29:06.748321 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.748165    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-home\") pod \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") "
Jul 29 18:29:06.748321 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.748198    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-tmp-dir\") pod \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") "
Jul 29 18:29:06.748321 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.748224    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zdcs\" (UniqueName: \"kubernetes.io/projected/7a44b61b-3b9e-4c15-801b-6b0333c3e254-kube-api-access-5zdcs\") pod \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") "
Jul 29 18:29:06.748321 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.748240    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-dshm\") pod \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") "
Jul 29 18:29:06.748321 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.748263    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-model-cache\") pod \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\" (UID: \"7a44b61b-3b9e-4c15-801b-6b0333c3e254\") "
Jul 29 18:29:06.748603 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.748487    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-home" (OuterVolumeSpecName: "home") pod "7a44b61b-3b9e-4c15-801b-6b0333c3e254" (UID: "7a44b61b-3b9e-4c15-801b-6b0333c3e254"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:29:06.748603 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.748491    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7a44b61b-3b9e-4c15-801b-6b0333c3e254" (UID: "7a44b61b-3b9e-4c15-801b-6b0333c3e254"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:29:06.748685 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.748616    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-model-cache" (OuterVolumeSpecName: "model-cache") pod "7a44b61b-3b9e-4c15-801b-6b0333c3e254" (UID: "7a44b61b-3b9e-4c15-801b-6b0333c3e254"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:29:06.750521 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.750491    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-dshm" (OuterVolumeSpecName: "dshm") pod "7a44b61b-3b9e-4c15-801b-6b0333c3e254" (UID: "7a44b61b-3b9e-4c15-801b-6b0333c3e254"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:29:06.750521 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.750495    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a44b61b-3b9e-4c15-801b-6b0333c3e254-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7a44b61b-3b9e-4c15-801b-6b0333c3e254" (UID: "7a44b61b-3b9e-4c15-801b-6b0333c3e254"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 18:29:06.750675 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.750567    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a44b61b-3b9e-4c15-801b-6b0333c3e254-kube-api-access-5zdcs" (OuterVolumeSpecName: "kube-api-access-5zdcs") pod "7a44b61b-3b9e-4c15-801b-6b0333c3e254" (UID: "7a44b61b-3b9e-4c15-801b-6b0333c3e254"). InnerVolumeSpecName "kube-api-access-5zdcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:29:06.801945 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.801901    2567 generic.go:356] "Generic (PLEG): container finished" podID="7a44b61b-3b9e-4c15-801b-6b0333c3e254" containerID="ce670766675de48e0dd9922343ad415ef68ff6279ab3756bb011950767b60f09" exitCode=0
Jul 29 18:29:06.802175 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.801957    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"
Jul 29 18:29:06.802175 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.802022    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f" event={"ID":"7a44b61b-3b9e-4c15-801b-6b0333c3e254","Type":"ContainerDied","Data":"ce670766675de48e0dd9922343ad415ef68ff6279ab3756bb011950767b60f09"}
Jul 29 18:29:06.802175 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.802061    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f" event={"ID":"7a44b61b-3b9e-4c15-801b-6b0333c3e254","Type":"ContainerDied","Data":"9f098dd9ba3585f8ca3cf362e14b79016c4e3e3b70dc5c2fa39669cdb89ecc1a"}
Jul 29 18:29:06.802175 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.802078    2567 scope.go:117] "RemoveContainer" containerID="ce670766675de48e0dd9922343ad415ef68ff6279ab3756bb011950767b60f09"
Jul 29 18:29:06.811365 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.811346    2567 scope.go:117] "RemoveContainer" containerID="ce670766675de48e0dd9922343ad415ef68ff6279ab3756bb011950767b60f09"
Jul 29 18:29:06.811630 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:29:06.811609    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce670766675de48e0dd9922343ad415ef68ff6279ab3756bb011950767b60f09\": container with ID starting with ce670766675de48e0dd9922343ad415ef68ff6279ab3756bb011950767b60f09 not found: ID does not exist" containerID="ce670766675de48e0dd9922343ad415ef68ff6279ab3756bb011950767b60f09"
Jul 29 18:29:06.811692 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.811639    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce670766675de48e0dd9922343ad415ef68ff6279ab3756bb011950767b60f09"} err="failed to get container status \"ce670766675de48e0dd9922343ad415ef68ff6279ab3756bb011950767b60f09\": rpc error: code = NotFound desc = could not find container \"ce670766675de48e0dd9922343ad415ef68ff6279ab3756bb011950767b60f09\": container with ID starting with ce670766675de48e0dd9922343ad415ef68ff6279ab3756bb011950767b60f09 not found: ID does not exist"
Jul 29 18:29:06.825132 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.825104    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"]
Jul 29 18:29:06.828893 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.828868    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-9245df36/e2e-lifecycle-model-9245df36-kserve-5687d9fbb7-ztz9f"]
Jul 29 18:29:06.849822 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.849749    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-home\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:29:06.849822 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.849776    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-tmp-dir\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:29:06.849822 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.849786    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zdcs\" (UniqueName: \"kubernetes.io/projected/7a44b61b-3b9e-4c15-801b-6b0333c3e254-kube-api-access-5zdcs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:29:06.849822 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.849795    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-dshm\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:29:06.849822 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.849805    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a44b61b-3b9e-4c15-801b-6b0333c3e254-model-cache\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:29:06.849822 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:06.849814    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a44b61b-3b9e-4c15-801b-6b0333c3e254-tls-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:29:08.073153 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:08.073120    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a44b61b-3b9e-4c15-801b-6b0333c3e254" path="/var/lib/kubelet/pods/7a44b61b-3b9e-4c15-801b-6b0333c3e254/volumes"
Jul 29 18:29:31.929366 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:31.929333    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:29:44.540194 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:29:44.540153    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:30:33.726186 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:30:33.726145    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:31:02.418523 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:02.418481    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:31:38.425824 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.425790    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"]
Jul 29 18:31:38.426401 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.426210    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5757add2-5691-4f0b-b35c-73afc4edd5d7" containerName="istio-proxy"
Jul 29 18:31:38.426401 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.426231    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5757add2-5691-4f0b-b35c-73afc4edd5d7" containerName="istio-proxy"
Jul 29 18:31:38.426401 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.426263    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a44b61b-3b9e-4c15-801b-6b0333c3e254" containerName="main"
Jul 29 18:31:38.426401 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.426272    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a44b61b-3b9e-4c15-801b-6b0333c3e254" containerName="main"
Jul 29 18:31:38.426401 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.426361    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a44b61b-3b9e-4c15-801b-6b0333c3e254" containerName="main"
Jul 29 18:31:38.429511 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.429487    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.433318 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.433289    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8cd341\"/\"kube-root-ca.crt\""
Jul 29 18:31:38.433724 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.433323    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8cd341\"/\"default-dockercfg-qmg9s\""
Jul 29 18:31:38.433724 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.433332    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-8cd341\"/\"openshift-service-ca.crt\""
Jul 29 18:31:38.433724 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.433390    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-8cd341\"/\"test-model-8cd341-kserve-self-signed-certs\""
Jul 29 18:31:38.439576 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.439555    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"]
Jul 29 18:31:38.569299 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.569266    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-dshm\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.569486 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.569314    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-model-cache\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.569486 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.569401    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-home\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.569486 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.569434    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3024332-90df-41b5-a69b-1ebd1f472773-tls-certs\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.569486 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.569457    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n552p\" (UniqueName: \"kubernetes.io/projected/a3024332-90df-41b5-a69b-1ebd1f472773-kube-api-access-n552p\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.569649 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.569536    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-tmp-dir\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.670798 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.670757    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-home\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.670798 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.670801    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3024332-90df-41b5-a69b-1ebd1f472773-tls-certs\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.671164 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.670823    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n552p\" (UniqueName: \"kubernetes.io/projected/a3024332-90df-41b5-a69b-1ebd1f472773-kube-api-access-n552p\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.671164 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.670909    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-tmp-dir\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.671164 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.670959    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-dshm\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.671164 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.671001    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-model-cache\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.672275 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.671902    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-model-cache\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.672275 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.672182    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-home\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.672275 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.672196    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-tmp-dir\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.674476 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.674454    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3024332-90df-41b5-a69b-1ebd1f472773-tls-certs\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.674586 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.674454    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-dshm\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.680504 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.680443    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n552p\" (UniqueName: \"kubernetes.io/projected/a3024332-90df-41b5-a69b-1ebd1f472773-kube-api-access-n552p\") pod \"test-model-8cd341-kserve-76cc965567-6j4fs\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") " pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.741362 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.741326    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:38.878054 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:38.878027    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"]
Jul 29 18:31:38.879557 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:31:38.879525    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3024332_90df_41b5_a69b_1ebd1f472773.slice/crio-b7e672f8f4e49e47faf6db69e8b865ca564660fe9d3e3cbc98ede9fd50a5e98c WatchSource:0}: Error finding container b7e672f8f4e49e47faf6db69e8b865ca564660fe9d3e3cbc98ede9fd50a5e98c: Status 404 returned error can't find the container with id b7e672f8f4e49e47faf6db69e8b865ca564660fe9d3e3cbc98ede9fd50a5e98c
Jul 29 18:31:39.581609 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:39.581573    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs" event={"ID":"a3024332-90df-41b5-a69b-1ebd1f472773","Type":"ContainerStarted","Data":"4b9894e492f9c79ceaaf6808f33576dfef140c1a7251f06e90781629aee9352e"}
Jul 29 18:31:39.582041 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:39.581618    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs" event={"ID":"a3024332-90df-41b5-a69b-1ebd1f472773","Type":"ContainerStarted","Data":"b7e672f8f4e49e47faf6db69e8b865ca564660fe9d3e3cbc98ede9fd50a5e98c"}
Jul 29 18:31:39.599363 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:39.599312    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs" podStartSLOduration=1.599295311 podStartE2EDuration="1.599295311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:31:39.598854886 +0000 UTC m=+2327.947082981" watchObservedRunningTime="2026-07-29 18:31:39.599295311 +0000 UTC m=+2327.947523463"
Jul 29 18:31:42.953296 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:42.953250    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:31:48.742463 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:48.742360    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:48.742463 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:48.742417    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:48.755280 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:48.755248    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:31:49.646494 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:31:49.646455    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:32:11.832516 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:11.832484    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"]
Jul 29 18:32:11.835919 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:11.835901    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:11.838957 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:11.838932    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e6623d\"/\"openshift-service-ca.crt\""
Jul 29 18:32:11.840095 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:11.840076    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e6623d\"/\"default-dockercfg-qm2m8\""
Jul 29 18:32:11.840179 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:11.840122    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-e6623d\"/\"test-model-e6623d-kserve-self-signed-certs\""
Jul 29 18:32:11.840179 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:11.840138    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-e6623d\"/\"kube-root-ca.crt\""
Jul 29 18:32:11.846046 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:11.846023    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"]
Jul 29 18:32:11.955614 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:11.955579    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59qtb\" (UniqueName: \"kubernetes.io/projected/2d65a393-035d-4fef-afb6-85f05e73c8f3-kube-api-access-59qtb\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:11.955809 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:11.955633    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-tmp-dir\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:11.955809 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:11.955669    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-dshm\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:11.955809 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:11.955727    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-model-cache\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:11.955809 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:11.955759    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d65a393-035d-4fef-afb6-85f05e73c8f3-tls-certs\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:11.955809 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:11.955774    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-home\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:12.056544 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.056502    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-model-cache\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:12.056724 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.056588    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d65a393-035d-4fef-afb6-85f05e73c8f3-tls-certs\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:12.056724 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.056620    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-home\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:12.056724 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.056657    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59qtb\" (UniqueName: \"kubernetes.io/projected/2d65a393-035d-4fef-afb6-85f05e73c8f3-kube-api-access-59qtb\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:12.056724 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.056700    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-tmp-dir\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:12.057062 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.056753    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-dshm\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:12.057062 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.056963    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-model-cache\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:12.057062 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.057041    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-home\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:12.057195 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.057175    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-tmp-dir\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:12.059139 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.059111    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-dshm\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:12.059261 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.059229    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d65a393-035d-4fef-afb6-85f05e73c8f3-tls-certs\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:12.065298 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.065274    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59qtb\" (UniqueName: \"kubernetes.io/projected/2d65a393-035d-4fef-afb6-85f05e73c8f3-kube-api-access-59qtb\") pod \"test-model-e6623d-kserve-67697d5485-wg7gr\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") " pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:12.146455 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.146361    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:12.281385 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.281352    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"]
Jul 29 18:32:12.282828 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:32:12.282802    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d65a393_035d_4fef_afb6_85f05e73c8f3.slice/crio-d830f95a3d48215dd7ce764238d298343af6939ed7fa637094129e59c5795c9b WatchSource:0}: Error finding container d830f95a3d48215dd7ce764238d298343af6939ed7fa637094129e59c5795c9b: Status 404 returned error can't find the container with id d830f95a3d48215dd7ce764238d298343af6939ed7fa637094129e59c5795c9b
Jul 29 18:32:12.758903 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.758867    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr" event={"ID":"2d65a393-035d-4fef-afb6-85f05e73c8f3","Type":"ContainerStarted","Data":"702795f4ccf68d309396db9e776de849ae46f31522a0a69a6af66d8034721ba0"}
Jul 29 18:32:12.759129 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.758921    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr" event={"ID":"2d65a393-035d-4fef-afb6-85f05e73c8f3","Type":"ContainerStarted","Data":"d830f95a3d48215dd7ce764238d298343af6939ed7fa637094129e59c5795c9b"}
Jul 29 18:32:12.776227 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:12.776175    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr" podStartSLOduration=1.776159644 podStartE2EDuration="1.776159644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:32:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:32:12.775542784 +0000 UTC m=+2361.123770878" watchObservedRunningTime="2026-07-29 18:32:12.776159644 +0000 UTC m=+2361.124387738"
Jul 29 18:32:16.522667 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:16.522628    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:32:22.147427 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:22.147383    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:22.148086 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:22.147472    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:22.160128 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:22.160098    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:22.820310 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:22.820280    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:32:31.630097 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:31.630058    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:32:54.249725 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:54.249683    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"]
Jul 29 18:32:55.232669 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:32:55.232636    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"]
Jul 29 18:33:01.828673 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:01.828636    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:33:09.268607 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.268558    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs" podUID="a3024332-90df-41b5-a69b-1ebd1f472773" containerName="main" containerID="cri-o://4b9894e492f9c79ceaaf6808f33576dfef140c1a7251f06e90781629aee9352e" gracePeriod=45
Jul 29 18:33:09.521783 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.521719    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:33:09.581850 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.581822    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3024332-90df-41b5-a69b-1ebd1f472773-tls-certs\") pod \"a3024332-90df-41b5-a69b-1ebd1f472773\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") "
Jul 29 18:33:09.582029 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.581857    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n552p\" (UniqueName: \"kubernetes.io/projected/a3024332-90df-41b5-a69b-1ebd1f472773-kube-api-access-n552p\") pod \"a3024332-90df-41b5-a69b-1ebd1f472773\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") "
Jul 29 18:33:09.582029 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.581886    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-model-cache\") pod \"a3024332-90df-41b5-a69b-1ebd1f472773\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") "
Jul 29 18:33:09.582029 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.581918    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-tmp-dir\") pod \"a3024332-90df-41b5-a69b-1ebd1f472773\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") "
Jul 29 18:33:09.582029 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.581943    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-home\") pod \"a3024332-90df-41b5-a69b-1ebd1f472773\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") "
Jul 29 18:33:09.582029 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.581966    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-dshm\") pod \"a3024332-90df-41b5-a69b-1ebd1f472773\" (UID: \"a3024332-90df-41b5-a69b-1ebd1f472773\") "
Jul 29 18:33:09.582309 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.582219    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a3024332-90df-41b5-a69b-1ebd1f472773" (UID: "a3024332-90df-41b5-a69b-1ebd1f472773"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:33:09.582309 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.582255    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-model-cache" (OuterVolumeSpecName: "model-cache") pod "a3024332-90df-41b5-a69b-1ebd1f472773" (UID: "a3024332-90df-41b5-a69b-1ebd1f472773"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:33:09.582399 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.582297    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-home" (OuterVolumeSpecName: "home") pod "a3024332-90df-41b5-a69b-1ebd1f472773" (UID: "a3024332-90df-41b5-a69b-1ebd1f472773"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:33:09.584136 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.584103    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-dshm" (OuterVolumeSpecName: "dshm") pod "a3024332-90df-41b5-a69b-1ebd1f472773" (UID: "a3024332-90df-41b5-a69b-1ebd1f472773"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:33:09.584136 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.584123    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3024332-90df-41b5-a69b-1ebd1f472773-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a3024332-90df-41b5-a69b-1ebd1f472773" (UID: "a3024332-90df-41b5-a69b-1ebd1f472773"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 18:33:09.584280 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.584174    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3024332-90df-41b5-a69b-1ebd1f472773-kube-api-access-n552p" (OuterVolumeSpecName: "kube-api-access-n552p") pod "a3024332-90df-41b5-a69b-1ebd1f472773" (UID: "a3024332-90df-41b5-a69b-1ebd1f472773"). InnerVolumeSpecName "kube-api-access-n552p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:33:09.682633 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.682594    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-tmp-dir\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:33:09.682633 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.682629    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-home\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:33:09.682633 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.682638    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-dshm\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:33:09.682633 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.682646    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3024332-90df-41b5-a69b-1ebd1f472773-tls-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:33:09.682982 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.682655    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n552p\" (UniqueName: \"kubernetes.io/projected/a3024332-90df-41b5-a69b-1ebd1f472773-kube-api-access-n552p\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:33:09.682982 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:09.682665    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a3024332-90df-41b5-a69b-1ebd1f472773-model-cache\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:33:10.046636 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.046597    2567 generic.go:356] "Generic (PLEG): container finished" podID="a3024332-90df-41b5-a69b-1ebd1f472773" containerID="4b9894e492f9c79ceaaf6808f33576dfef140c1a7251f06e90781629aee9352e" exitCode=0
Jul 29 18:33:10.046836 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.046659    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"
Jul 29 18:33:10.046836 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.046659    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs" event={"ID":"a3024332-90df-41b5-a69b-1ebd1f472773","Type":"ContainerDied","Data":"4b9894e492f9c79ceaaf6808f33576dfef140c1a7251f06e90781629aee9352e"}
Jul 29 18:33:10.046836 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.046766    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs" event={"ID":"a3024332-90df-41b5-a69b-1ebd1f472773","Type":"ContainerDied","Data":"b7e672f8f4e49e47faf6db69e8b865ca564660fe9d3e3cbc98ede9fd50a5e98c"}
Jul 29 18:33:10.046836 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.046796    2567 scope.go:117] "RemoveContainer" containerID="4b9894e492f9c79ceaaf6808f33576dfef140c1a7251f06e90781629aee9352e"
Jul 29 18:33:10.056581 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.056555    2567 scope.go:117] "RemoveContainer" containerID="4b9894e492f9c79ceaaf6808f33576dfef140c1a7251f06e90781629aee9352e"
Jul 29 18:33:10.056837 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:33:10.056817    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b9894e492f9c79ceaaf6808f33576dfef140c1a7251f06e90781629aee9352e\": container with ID starting with 4b9894e492f9c79ceaaf6808f33576dfef140c1a7251f06e90781629aee9352e not found: ID does not exist" containerID="4b9894e492f9c79ceaaf6808f33576dfef140c1a7251f06e90781629aee9352e"
Jul 29 18:33:10.056903 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.056847    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b9894e492f9c79ceaaf6808f33576dfef140c1a7251f06e90781629aee9352e"} err="failed to get container status \"4b9894e492f9c79ceaaf6808f33576dfef140c1a7251f06e90781629aee9352e\": rpc error: code = NotFound desc = could not find container \"4b9894e492f9c79ceaaf6808f33576dfef140c1a7251f06e90781629aee9352e\": container with ID starting with 4b9894e492f9c79ceaaf6808f33576dfef140c1a7251f06e90781629aee9352e not found: ID does not exist"
Jul 29 18:33:10.074812 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.074768    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"]
Jul 29 18:33:10.075422 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.075401    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-8cd341/test-model-8cd341-kserve-76cc965567-6j4fs"]
Jul 29 18:33:10.251703 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.251655    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr" podUID="2d65a393-035d-4fef-afb6-85f05e73c8f3" containerName="main" containerID="cri-o://702795f4ccf68d309396db9e776de849ae46f31522a0a69a6af66d8034721ba0" gracePeriod=45
Jul 29 18:33:10.496188 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.496165    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:33:10.591265 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.591178    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-tmp-dir\") pod \"2d65a393-035d-4fef-afb6-85f05e73c8f3\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") "
Jul 29 18:33:10.591265 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.591226    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-home\") pod \"2d65a393-035d-4fef-afb6-85f05e73c8f3\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") "
Jul 29 18:33:10.591469 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.591277    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-model-cache\") pod \"2d65a393-035d-4fef-afb6-85f05e73c8f3\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") "
Jul 29 18:33:10.591469 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.591300    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d65a393-035d-4fef-afb6-85f05e73c8f3-tls-certs\") pod \"2d65a393-035d-4fef-afb6-85f05e73c8f3\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") "
Jul 29 18:33:10.591469 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.591339    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-dshm\") pod \"2d65a393-035d-4fef-afb6-85f05e73c8f3\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") "
Jul 29 18:33:10.591469 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.591364    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59qtb\" (UniqueName: \"kubernetes.io/projected/2d65a393-035d-4fef-afb6-85f05e73c8f3-kube-api-access-59qtb\") pod \"2d65a393-035d-4fef-afb6-85f05e73c8f3\" (UID: \"2d65a393-035d-4fef-afb6-85f05e73c8f3\") "
Jul 29 18:33:10.591675 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.591486    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2d65a393-035d-4fef-afb6-85f05e73c8f3" (UID: "2d65a393-035d-4fef-afb6-85f05e73c8f3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:33:10.591675 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.591534    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-model-cache" (OuterVolumeSpecName: "model-cache") pod "2d65a393-035d-4fef-afb6-85f05e73c8f3" (UID: "2d65a393-035d-4fef-afb6-85f05e73c8f3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:33:10.591675 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.591547    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-home" (OuterVolumeSpecName: "home") pod "2d65a393-035d-4fef-afb6-85f05e73c8f3" (UID: "2d65a393-035d-4fef-afb6-85f05e73c8f3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:33:10.591675 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.591655    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-tmp-dir\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:33:10.591675 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.591672    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-home\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:33:10.591851 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.591681    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-model-cache\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:33:10.593471 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.593445    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-dshm" (OuterVolumeSpecName: "dshm") pod "2d65a393-035d-4fef-afb6-85f05e73c8f3" (UID: "2d65a393-035d-4fef-afb6-85f05e73c8f3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:33:10.593633 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.593507    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d65a393-035d-4fef-afb6-85f05e73c8f3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2d65a393-035d-4fef-afb6-85f05e73c8f3" (UID: "2d65a393-035d-4fef-afb6-85f05e73c8f3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 18:33:10.593700 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.593625    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d65a393-035d-4fef-afb6-85f05e73c8f3-kube-api-access-59qtb" (OuterVolumeSpecName: "kube-api-access-59qtb") pod "2d65a393-035d-4fef-afb6-85f05e73c8f3" (UID: "2d65a393-035d-4fef-afb6-85f05e73c8f3"). InnerVolumeSpecName "kube-api-access-59qtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:33:10.692763 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.692723    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d65a393-035d-4fef-afb6-85f05e73c8f3-tls-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:33:10.692763 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.692754    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d65a393-035d-4fef-afb6-85f05e73c8f3-dshm\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:33:10.692763 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:10.692765    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59qtb\" (UniqueName: \"kubernetes.io/projected/2d65a393-035d-4fef-afb6-85f05e73c8f3-kube-api-access-59qtb\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:33:11.054608 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:11.054570    2567 generic.go:356] "Generic (PLEG): container finished" podID="2d65a393-035d-4fef-afb6-85f05e73c8f3" containerID="702795f4ccf68d309396db9e776de849ae46f31522a0a69a6af66d8034721ba0" exitCode=0
Jul 29 18:33:11.054805 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:11.054613    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"
Jul 29 18:33:11.054805 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:11.054656    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr" event={"ID":"2d65a393-035d-4fef-afb6-85f05e73c8f3","Type":"ContainerDied","Data":"702795f4ccf68d309396db9e776de849ae46f31522a0a69a6af66d8034721ba0"}
Jul 29 18:33:11.054805 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:11.054698    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr" event={"ID":"2d65a393-035d-4fef-afb6-85f05e73c8f3","Type":"ContainerDied","Data":"d830f95a3d48215dd7ce764238d298343af6939ed7fa637094129e59c5795c9b"}
Jul 29 18:33:11.054805 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:11.054715    2567 scope.go:117] "RemoveContainer" containerID="702795f4ccf68d309396db9e776de849ae46f31522a0a69a6af66d8034721ba0"
Jul 29 18:33:11.063523 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:11.063503    2567 scope.go:117] "RemoveContainer" containerID="702795f4ccf68d309396db9e776de849ae46f31522a0a69a6af66d8034721ba0"
Jul 29 18:33:11.063768 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:33:11.063751    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"702795f4ccf68d309396db9e776de849ae46f31522a0a69a6af66d8034721ba0\": container with ID starting with 702795f4ccf68d309396db9e776de849ae46f31522a0a69a6af66d8034721ba0 not found: ID does not exist" containerID="702795f4ccf68d309396db9e776de849ae46f31522a0a69a6af66d8034721ba0"
Jul 29 18:33:11.063824 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:11.063778    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702795f4ccf68d309396db9e776de849ae46f31522a0a69a6af66d8034721ba0"} err="failed to get container status \"702795f4ccf68d309396db9e776de849ae46f31522a0a69a6af66d8034721ba0\": rpc error: code = NotFound desc = could not find container \"702795f4ccf68d309396db9e776de849ae46f31522a0a69a6af66d8034721ba0\": container with ID starting with 702795f4ccf68d309396db9e776de849ae46f31522a0a69a6af66d8034721ba0 not found: ID does not exist"
Jul 29 18:33:11.076605 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:11.076506    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"]
Jul 29 18:33:11.079051 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:11.079026    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-e6623d/test-model-e6623d-kserve-67697d5485-wg7gr"]
Jul 29 18:33:11.419347 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:11.419259    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:33:12.073665 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:12.073622    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d65a393-035d-4fef-afb6-85f05e73c8f3" path="/var/lib/kubelet/pods/2d65a393-035d-4fef-afb6-85f05e73c8f3/volumes"
Jul 29 18:33:12.074089 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:12.074074    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3024332-90df-41b5-a69b-1ebd1f472773" path="/var/lib/kubelet/pods/a3024332-90df-41b5-a69b-1ebd1f472773/volumes"
Jul 29 18:33:26.824263 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:26.824223    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:33:31.337671 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.337631    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"]
Jul 29 18:33:31.338132 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.338116    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3024332-90df-41b5-a69b-1ebd1f472773" containerName="main"
Jul 29 18:33:31.338182 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.338135    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3024332-90df-41b5-a69b-1ebd1f472773" containerName="main"
Jul 29 18:33:31.338182 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.338164    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d65a393-035d-4fef-afb6-85f05e73c8f3" containerName="main"
Jul 29 18:33:31.338182 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.338172    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d65a393-035d-4fef-afb6-85f05e73c8f3" containerName="main"
Jul 29 18:33:31.338277 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.338258    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3024332-90df-41b5-a69b-1ebd1f472773" containerName="main"
Jul 29 18:33:31.338277 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.338274    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d65a393-035d-4fef-afb6-85f05e73c8f3" containerName="main"
Jul 29 18:33:31.341437 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.341419    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.344712 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.344694    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-45bfe9-openshift-default-dockercfg-4f75g\""
Jul 29 18:33:31.363046 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.363021    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"]
Jul 29 18:33:31.479817 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.479780    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-podinfo\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.479817 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.479819    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-token\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.480133 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.479851    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-workload-certs\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.480133 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.479973    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6mn4\" (UniqueName: \"kubernetes.io/projected/d2254faa-0bc0-4c92-887d-c7a607e9976b-kube-api-access-z6mn4\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.480133 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.480030    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-credential-socket\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.480133 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.480071    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-data\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.480279 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.480163    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-envoy\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.480279 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.480218    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-workload-socket\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.480279 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.480244    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2254faa-0bc0-4c92-887d-c7a607e9976b-istiod-ca-cert\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.581356 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.581313    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-data\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.581560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.581385    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-envoy\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.581560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.581423    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-workload-socket\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.581560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.581445    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2254faa-0bc0-4c92-887d-c7a607e9976b-istiod-ca-cert\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.581560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.581499    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-podinfo\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.581560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.581522    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-token\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.581560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.581559    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-workload-certs\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.581898 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.581613    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6mn4\" (UniqueName: \"kubernetes.io/projected/d2254faa-0bc0-4c92-887d-c7a607e9976b-kube-api-access-z6mn4\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.581898 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.581641    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-credential-socket\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.581898 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.581824    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-data\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.581898 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.581882    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-workload-socket\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.582078 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.581912    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-credential-socket\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.582078 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.581987    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-workload-certs\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.582517 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.582497    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2254faa-0bc0-4c92-887d-c7a607e9976b-istiod-ca-cert\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.583803 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.583786    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-envoy\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.584123 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.584103    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-podinfo\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.590343 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.590288    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6mn4\" (UniqueName: \"kubernetes.io/projected/d2254faa-0bc0-4c92-887d-c7a607e9976b-kube-api-access-z6mn4\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.590482 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.590465    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-token\") pod \"e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") " pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.652055 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.652018    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:31.787796 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.787771    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"]
Jul 29 18:33:31.790184 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:33:31.790147    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2254faa_0bc0_4c92_887d_c7a607e9976b.slice/crio-3d68a60841f9c28643b00b9cdb3012e9b49868ee610933d9d903e9c14cec8ef0 WatchSource:0}: Error finding container 3d68a60841f9c28643b00b9cdb3012e9b49868ee610933d9d903e9c14cec8ef0: Status 404 returned error can't find the container with id 3d68a60841f9c28643b00b9cdb3012e9b49868ee610933d9d903e9c14cec8ef0
Jul 29 18:33:31.792575 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.792543    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:33:31.792684 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.792620    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:33:31.792684 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:31.792661    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:33:32.168386 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:32.168296    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt" event={"ID":"d2254faa-0bc0-4c92-887d-c7a607e9976b","Type":"ContainerStarted","Data":"fce961875d3c8dfcc26363aff1d74ecf8dc71d97d273e361812fd87374229bfb"}
Jul 29 18:33:32.168386 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:32.168354    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt" event={"ID":"d2254faa-0bc0-4c92-887d-c7a607e9976b","Type":"ContainerStarted","Data":"3d68a60841f9c28643b00b9cdb3012e9b49868ee610933d9d903e9c14cec8ef0"}
Jul 29 18:33:32.195692 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:32.195640    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt" podStartSLOduration=1.195624533 podStartE2EDuration="1.195624533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:33:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:33:32.194607573 +0000 UTC m=+2440.542835665" watchObservedRunningTime="2026-07-29 18:33:32.195624533 +0000 UTC m=+2440.543852623"
Jul 29 18:33:32.652689 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:32.652650    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:32.658080 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:32.658052    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:33.174148 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:33.174114    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:33.175055 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:33.175033    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:41.519663 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:41.519625    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:33:49.216195 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:49.216150    2567 patch_prober.go:28] interesting pod/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 18:33:49.216734 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:49.216229    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt" podUID="d2254faa-0bc0-4c92-887d-c7a607e9976b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 18:33:50.267739 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:50.267701    2567 generic.go:356] "Generic (PLEG): container finished" podID="d2254faa-0bc0-4c92-887d-c7a607e9976b" containerID="fce961875d3c8dfcc26363aff1d74ecf8dc71d97d273e361812fd87374229bfb" exitCode=0
Jul 29 18:33:50.268224 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:50.267775    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt" event={"ID":"d2254faa-0bc0-4c92-887d-c7a607e9976b","Type":"ContainerDied","Data":"fce961875d3c8dfcc26363aff1d74ecf8dc71d97d273e361812fd87374229bfb"}
Jul 29 18:33:50.268224 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:50.268201    2567 scope.go:117] "RemoveContainer" containerID="fce961875d3c8dfcc26363aff1d74ecf8dc71d97d273e361812fd87374229bfb"
Jul 29 18:33:50.269194 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:50.269167    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:33:50.269258 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:50.269246    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:33:50.269296 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:50.269277    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:33:51.275934 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:51.275898    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt" event={"ID":"d2254faa-0bc0-4c92-887d-c7a607e9976b","Type":"ContainerStarted","Data":"abee78a90bf77bff20ef0a2ce3ea3c252eb09b661934f08bc9d0fcfc7274ce59"}
Jul 29 18:33:51.653575 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:51.653452    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:51.653773 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:51.653613    2567 patch_prober.go:28] interesting pod/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 29 18:33:51.653773 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:51.653660    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt" podUID="d2254faa-0bc0-4c92-887d-c7a607e9976b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 29 18:33:52.653438 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:52.653320    2567 patch_prober.go:28] interesting pod/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 29 18:33:52.653438 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:52.653399    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt" podUID="d2254faa-0bc0-4c92-887d-c7a607e9976b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 29 18:33:53.653137 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:53.653071    2567 patch_prober.go:28] interesting pod/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 29 18:33:53.653362 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:53.653159    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt" podUID="d2254faa-0bc0-4c92-887d-c7a607e9976b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 29 18:33:54.652589 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:54.652541    2567 patch_prober.go:28] interesting pod/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 29 18:33:54.653114 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:54.652616    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt" podUID="d2254faa-0bc0-4c92-887d-c7a607e9976b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 29 18:33:55.655774 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:55.655742    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:55.656181 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:55.656025    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:33:55.656792 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:33:55.656777    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:34:12.716534 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:34:12.716493    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:34:54.426835 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:34:54.426739    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:34:58.448760 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:34:58.448724    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"]
Jul 29 18:34:58.449195 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:34:58.449003    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt" podUID="d2254faa-0bc0-4c92-887d-c7a607e9976b" containerName="istio-proxy" containerID="cri-o://abee78a90bf77bff20ef0a2ce3ea3c252eb09b661934f08bc9d0fcfc7274ce59" gracePeriod=30
Jul 29 18:35:03.653422 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.653388    2567 generic.go:356] "Generic (PLEG): container finished" podID="d2254faa-0bc0-4c92-887d-c7a607e9976b" containerID="abee78a90bf77bff20ef0a2ce3ea3c252eb09b661934f08bc9d0fcfc7274ce59" exitCode=0
Jul 29 18:35:03.653816 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.653457    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt" event={"ID":"d2254faa-0bc0-4c92-887d-c7a607e9976b","Type":"ContainerDied","Data":"abee78a90bf77bff20ef0a2ce3ea3c252eb09b661934f08bc9d0fcfc7274ce59"}
Jul 29 18:35:03.653816 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.653524    2567 scope.go:117] "RemoveContainer" containerID="fce961875d3c8dfcc26363aff1d74ecf8dc71d97d273e361812fd87374229bfb"
Jul 29 18:35:03.708817 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.708794    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:35:03.799925 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.799886    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-podinfo\") pod \"d2254faa-0bc0-4c92-887d-c7a607e9976b\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") "
Jul 29 18:35:03.800124 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.799956    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-workload-certs\") pod \"d2254faa-0bc0-4c92-887d-c7a607e9976b\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") "
Jul 29 18:35:03.800124 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.800016    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-workload-socket\") pod \"d2254faa-0bc0-4c92-887d-c7a607e9976b\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") "
Jul 29 18:35:03.800124 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.800045    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6mn4\" (UniqueName: \"kubernetes.io/projected/d2254faa-0bc0-4c92-887d-c7a607e9976b-kube-api-access-z6mn4\") pod \"d2254faa-0bc0-4c92-887d-c7a607e9976b\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") "
Jul 29 18:35:03.800124 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.800088    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-envoy\") pod \"d2254faa-0bc0-4c92-887d-c7a607e9976b\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") "
Jul 29 18:35:03.800355 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.800138    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-token\") pod \"d2254faa-0bc0-4c92-887d-c7a607e9976b\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") "
Jul 29 18:35:03.800355 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.800172    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2254faa-0bc0-4c92-887d-c7a607e9976b-istiod-ca-cert\") pod \"d2254faa-0bc0-4c92-887d-c7a607e9976b\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") "
Jul 29 18:35:03.800355 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.800217    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-credential-socket\") pod \"d2254faa-0bc0-4c92-887d-c7a607e9976b\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") "
Jul 29 18:35:03.800355 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.800253    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-data\") pod \"d2254faa-0bc0-4c92-887d-c7a607e9976b\" (UID: \"d2254faa-0bc0-4c92-887d-c7a607e9976b\") "
Jul 29 18:35:03.800355 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.800308    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d2254faa-0bc0-4c92-887d-c7a607e9976b" (UID: "d2254faa-0bc0-4c92-887d-c7a607e9976b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:35:03.800612 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.800553    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-workload-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:35:03.800612 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.800566    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d2254faa-0bc0-4c92-887d-c7a607e9976b" (UID: "d2254faa-0bc0-4c92-887d-c7a607e9976b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:35:03.800727 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.800602    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2254faa-0bc0-4c92-887d-c7a607e9976b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d2254faa-0bc0-4c92-887d-c7a607e9976b" (UID: "d2254faa-0bc0-4c92-887d-c7a607e9976b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:35:03.800727 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.800614    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d2254faa-0bc0-4c92-887d-c7a607e9976b" (UID: "d2254faa-0bc0-4c92-887d-c7a607e9976b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:35:03.801184 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.801164    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-data" (OuterVolumeSpecName: "istio-data") pod "d2254faa-0bc0-4c92-887d-c7a607e9976b" (UID: "d2254faa-0bc0-4c92-887d-c7a607e9976b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:35:03.802270 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.802249    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d2254faa-0bc0-4c92-887d-c7a607e9976b" (UID: "d2254faa-0bc0-4c92-887d-c7a607e9976b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 18:35:03.802378 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.802301    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-token" (OuterVolumeSpecName: "istio-token") pod "d2254faa-0bc0-4c92-887d-c7a607e9976b" (UID: "d2254faa-0bc0-4c92-887d-c7a607e9976b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:35:03.802738 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.802709    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2254faa-0bc0-4c92-887d-c7a607e9976b-kube-api-access-z6mn4" (OuterVolumeSpecName: "kube-api-access-z6mn4") pod "d2254faa-0bc0-4c92-887d-c7a607e9976b" (UID: "d2254faa-0bc0-4c92-887d-c7a607e9976b"). InnerVolumeSpecName "kube-api-access-z6mn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:35:03.802738 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.802723    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d2254faa-0bc0-4c92-887d-c7a607e9976b" (UID: "d2254faa-0bc0-4c92-887d-c7a607e9976b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:35:03.901744 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.901707    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-workload-socket\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:35:03.901744 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.901738    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6mn4\" (UniqueName: \"kubernetes.io/projected/d2254faa-0bc0-4c92-887d-c7a607e9976b-kube-api-access-z6mn4\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:35:03.901744 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.901749    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-envoy\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:35:03.901984 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.901757    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-token\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:35:03.901984 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.901765    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2254faa-0bc0-4c92-887d-c7a607e9976b-istiod-ca-cert\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:35:03.901984 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.901774    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-credential-socket\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:35:03.901984 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.901785    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-data\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:35:03.901984 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:03.901796    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2254faa-0bc0-4c92-887d-c7a607e9976b-istio-podinfo\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:35:04.660268 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:04.660229    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt" event={"ID":"d2254faa-0bc0-4c92-887d-c7a607e9976b","Type":"ContainerDied","Data":"3d68a60841f9c28643b00b9cdb3012e9b49868ee610933d9d903e9c14cec8ef0"}
Jul 29 18:35:04.660268 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:04.660255    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"
Jul 29 18:35:04.660780 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:04.660304    2567 scope.go:117] "RemoveContainer" containerID="abee78a90bf77bff20ef0a2ce3ea3c252eb09b661934f08bc9d0fcfc7274ce59"
Jul 29 18:35:04.679375 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:04.679347    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"]
Jul 29 18:35:04.683693 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:04.683662    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-45bfe9-openshift-default-77b85f749d-8s2jt"]
Jul 29 18:35:06.073530 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:06.073483    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2254faa-0bc0-4c92-887d-c7a607e9976b" path="/var/lib/kubelet/pods/d2254faa-0bc0-4c92-887d-c7a607e9976b/volumes"
Jul 29 18:35:12.114444 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:12.114400    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:35:25.821311 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:25.821275    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:35:44.171313 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.171275    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"]
Jul 29 18:35:44.171790 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.171627    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2254faa-0bc0-4c92-887d-c7a607e9976b" containerName="istio-proxy"
Jul 29 18:35:44.171790 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.171639    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2254faa-0bc0-4c92-887d-c7a607e9976b" containerName="istio-proxy"
Jul 29 18:35:44.171790 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.171653    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2254faa-0bc0-4c92-887d-c7a607e9976b" containerName="istio-proxy"
Jul 29 18:35:44.171790 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.171659    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2254faa-0bc0-4c92-887d-c7a607e9976b" containerName="istio-proxy"
Jul 29 18:35:44.171790 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.171715    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2254faa-0bc0-4c92-887d-c7a607e9976b" containerName="istio-proxy"
Jul 29 18:35:44.171790 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.171726    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2254faa-0bc0-4c92-887d-c7a607e9976b" containerName="istio-proxy"
Jul 29 18:35:44.174736 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.174717    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.177732 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.177714    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-f9520e-openshift-default-dockercfg-x2r2m\""
Jul 29 18:35:44.187127 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.187103    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"]
Jul 29 18:35:44.253343 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.253298    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-podinfo\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.253538 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.253355    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2tht\" (UniqueName: \"kubernetes.io/projected/028db522-2d5e-42e1-873e-adb125b9a4ea-kube-api-access-l2tht\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.253538 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.253439    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-envoy\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.253538 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.253493    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/028db522-2d5e-42e1-873e-adb125b9a4ea-istiod-ca-cert\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.253538 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.253527    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-data\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.253766 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.253556    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-credential-socket\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.253766 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.253591    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-token\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.253766 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.253649    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-workload-socket\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.253766 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.253684    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-workload-certs\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.355136 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.355096    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-podinfo\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.355343 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.355148    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2tht\" (UniqueName: \"kubernetes.io/projected/028db522-2d5e-42e1-873e-adb125b9a4ea-kube-api-access-l2tht\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.355343 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.355186    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-envoy\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.355343 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.355238    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/028db522-2d5e-42e1-873e-adb125b9a4ea-istiod-ca-cert\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.355343 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.355275    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-data\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.355343 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.355299    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-credential-socket\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.355343 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.355322    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-token\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.355684 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.355351    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-workload-socket\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.355684 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.355383    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-workload-certs\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.355791 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.355743    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-data\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.355791 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.355757    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-credential-socket\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.355897 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.355849    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-workload-certs\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.356124 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.356101    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-workload-socket\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.356217 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.356151    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/028db522-2d5e-42e1-873e-adb125b9a4ea-istiod-ca-cert\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.357649 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.357618    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-envoy\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.357880 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.357856    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-podinfo\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.365787 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.365755    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2tht\" (UniqueName: \"kubernetes.io/projected/028db522-2d5e-42e1-873e-adb125b9a4ea-kube-api-access-l2tht\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.367882 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.367862    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-token\") pod \"e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") " pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.485927 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.485895    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:44.628844 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.628817    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"]
Jul 29 18:35:44.630450 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:35:44.630423    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod028db522_2d5e_42e1_873e_adb125b9a4ea.slice/crio-335f448451959b45d45ba7bdf569ca3facf0b6b8fcd504a0eab625ee5c1af111 WatchSource:0}: Error finding container 335f448451959b45d45ba7bdf569ca3facf0b6b8fcd504a0eab625ee5c1af111: Status 404 returned error can't find the container with id 335f448451959b45d45ba7bdf569ca3facf0b6b8fcd504a0eab625ee5c1af111
Jul 29 18:35:44.632504 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.632471    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:35:44.632602 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.632535    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:35:44.632602 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.632565    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:35:44.876131 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.876029    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc" event={"ID":"028db522-2d5e-42e1-873e-adb125b9a4ea","Type":"ContainerStarted","Data":"b28d012ee5a6b98c273147b33dded7fe1242b9d3cc9fdd561353c179db35801e"}
Jul 29 18:35:44.876131 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.876096    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc" event={"ID":"028db522-2d5e-42e1-873e-adb125b9a4ea","Type":"ContainerStarted","Data":"335f448451959b45d45ba7bdf569ca3facf0b6b8fcd504a0eab625ee5c1af111"}
Jul 29 18:35:44.902672 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:44.902611    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc" podStartSLOduration=0.902590023 podStartE2EDuration="902.590023ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:44.898333596 +0000 UTC m=+2573.246561680" watchObservedRunningTime="2026-07-29 18:35:44.902590023 +0000 UTC m=+2573.250818115"
Jul 29 18:35:45.486205 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:45.486162    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:45.491487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:45.491456    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:45.881427 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:45.881343    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:45.882475 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:45.882456    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:35:54.422971 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:35:54.422932    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:36:01.922209 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:01.922155    2567 patch_prober.go:28] interesting pod/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 18:36:01.922727 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:01.922245    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc" podUID="028db522-2d5e-42e1-873e-adb125b9a4ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 18:36:02.981071 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:02.980952    2567 generic.go:356] "Generic (PLEG): container finished" podID="028db522-2d5e-42e1-873e-adb125b9a4ea" containerID="b28d012ee5a6b98c273147b33dded7fe1242b9d3cc9fdd561353c179db35801e" exitCode=0
Jul 29 18:36:02.981071 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:02.981031    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc" event={"ID":"028db522-2d5e-42e1-873e-adb125b9a4ea","Type":"ContainerDied","Data":"b28d012ee5a6b98c273147b33dded7fe1242b9d3cc9fdd561353c179db35801e"}
Jul 29 18:36:02.981543 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:02.981409    2567 scope.go:117] "RemoveContainer" containerID="b28d012ee5a6b98c273147b33dded7fe1242b9d3cc9fdd561353c179db35801e"
Jul 29 18:36:02.982451 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:02.982422    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:36:02.982561 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:02.982505    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:36:02.982561 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:02.982549    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:36:03.987735 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:03.987699    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc" event={"ID":"028db522-2d5e-42e1-873e-adb125b9a4ea","Type":"ContainerStarted","Data":"15acd420f0dfd369a87a8e60f8a5515b05cd8b3dabd57a3c763bd0afa51e90d4"}
Jul 29 18:36:04.486604 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:04.486564    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:36:04.486890 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:04.486863    2567 patch_prober.go:28] interesting pod/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 29 18:36:04.486955 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:04.486934    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc" podUID="028db522-2d5e-42e1-873e-adb125b9a4ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 29 18:36:05.486374 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:05.486334    2567 patch_prober.go:28] interesting pod/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 29 18:36:05.486812 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:05.486406    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc" podUID="028db522-2d5e-42e1-873e-adb125b9a4ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 29 18:36:06.486760 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:06.486718    2567 patch_prober.go:28] interesting pod/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 29 18:36:06.487202 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:06.486790    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc" podUID="028db522-2d5e-42e1-873e-adb125b9a4ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 29 18:36:07.487052 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:07.486982    2567 patch_prober.go:28] interesting pod/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 29 18:36:07.487464 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:07.487070    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc" podUID="028db522-2d5e-42e1-873e-adb125b9a4ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 29 18:36:08.490568 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:08.490536    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:36:08.491020 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:08.490921    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:36:08.491652 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:08.491632    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:36:24.731327 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.731293    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"]
Jul 29 18:36:24.733783 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.733764    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.737789 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.737768    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-297c4d\"/\"openshift-service-ca.crt\""
Jul 29 18:36:24.737905 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.737796    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-297c4d\"/\"auth-test-model-297c4d-kserve-self-signed-certs\""
Jul 29 18:36:24.737971 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.737948    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-297c4d\"/\"kube-root-ca.crt\""
Jul 29 18:36:24.738114 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.738094    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-297c4d\"/\"default-dockercfg-ll6n5\""
Jul 29 18:36:24.746576 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.746551    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"]
Jul 29 18:36:24.839938 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.839899    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-model-cache\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.840188 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.839949    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-home\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.840188 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.840086    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-dshm\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.840188 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.840124    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbqfn\" (UniqueName: \"kubernetes.io/projected/129916bb-01c2-45c0-9aaf-c4b06182c9ec-kube-api-access-mbqfn\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.840188 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.840168    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-tmp-dir\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.840376 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.840215    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/129916bb-01c2-45c0-9aaf-c4b06182c9ec-tls-certs\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.941271 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.941221    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-home\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.941484 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.941293    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-dshm\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.941484 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.941319    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbqfn\" (UniqueName: \"kubernetes.io/projected/129916bb-01c2-45c0-9aaf-c4b06182c9ec-kube-api-access-mbqfn\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.941484 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.941347    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-tmp-dir\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.941484 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.941378    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/129916bb-01c2-45c0-9aaf-c4b06182c9ec-tls-certs\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.941484 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.941452    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-model-cache\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.941748 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.941691    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-home\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.941748 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.941735    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-tmp-dir\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.941898 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.941877    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-model-cache\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.943670 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.943651    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-dshm\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.943948 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.943928    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/129916bb-01c2-45c0-9aaf-c4b06182c9ec-tls-certs\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:24.950117 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:24.950093    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbqfn\" (UniqueName: \"kubernetes.io/projected/129916bb-01c2-45c0-9aaf-c4b06182c9ec-kube-api-access-mbqfn\") pod \"auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") " pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:25.042778 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:25.042738    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:25.183420 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:25.183392    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"]
Jul 29 18:36:25.184809 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:36:25.184772    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod129916bb_01c2_45c0_9aaf_c4b06182c9ec.slice/crio-cbab899dd78abbf4aecbda3629d3153e7095be49b29cdb241243b7c8437c29e0 WatchSource:0}: Error finding container cbab899dd78abbf4aecbda3629d3153e7095be49b29cdb241243b7c8437c29e0: Status 404 returned error can't find the container with id cbab899dd78abbf4aecbda3629d3153e7095be49b29cdb241243b7c8437c29e0
Jul 29 18:36:26.103260 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:26.103224    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7" event={"ID":"129916bb-01c2-45c0-9aaf-c4b06182c9ec","Type":"ContainerStarted","Data":"8a3dd36f3a857298276d1db00b52dca1547960436754300fa30831a16ff9e7be"}
Jul 29 18:36:26.103666 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:26.103274    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7" event={"ID":"129916bb-01c2-45c0-9aaf-c4b06182c9ec","Type":"ContainerStarted","Data":"cbab899dd78abbf4aecbda3629d3153e7095be49b29cdb241243b7c8437c29e0"}
Jul 29 18:36:26.126213 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:26.126158    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7" podStartSLOduration=2.126142131 podStartE2EDuration="2.126142131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:36:26.123589871 +0000 UTC m=+2614.471817965" watchObservedRunningTime="2026-07-29 18:36:26.126142131 +0000 UTC m=+2614.474370224"
Jul 29 18:36:28.624195 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:28.624155    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:36:35.043761 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:35.043714    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:35.044362 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:35.043908    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:35.056600 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:35.056573    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:35.160330 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:35.160302    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:36:43.223331 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.223295    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"]
Jul 29 18:36:43.226676 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.226655    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.230642 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.230618    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f9520e\"/\"kube-root-ca.crt\""
Jul 29 18:36:43.230773 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.230649    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f9520e\"/\"default-dockercfg-sglh9\""
Jul 29 18:36:43.230773 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.230658    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f9520e\"/\"openshift-service-ca.crt\""
Jul 29 18:36:43.230773 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.230720    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f9520e\"/\"auth-test-model-f9520e-kserve-self-signed-certs\""
Jul 29 18:36:43.239873 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.239848    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"]
Jul 29 18:36:43.309098 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.309063    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-tls-certs\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.309287 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.309136    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-home\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.309287 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.309169    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-model-cache\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.309287 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.309188    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqrfw\" (UniqueName: \"kubernetes.io/projected/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-kube-api-access-zqrfw\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.309287 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.309208    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-tmp-dir\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.309287 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.309233    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-dshm\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.409872 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.409832    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-home\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.410113 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.409886    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-model-cache\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.410113 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.409919    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqrfw\" (UniqueName: \"kubernetes.io/projected/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-kube-api-access-zqrfw\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.410113 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.409946    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-tmp-dir\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.410113 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.409985    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-dshm\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.410113 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.410060    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-tls-certs\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.410408 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.410262    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-model-cache\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.410408 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.410324    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-tmp-dir\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.410408 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.410383    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-home\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.412297 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.412278    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-dshm\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.412599 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.412579    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-tls-certs\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.418867 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.418837    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqrfw\" (UniqueName: \"kubernetes.io/projected/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-kube-api-access-zqrfw\") pod \"auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") " pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.536516 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.536474    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:43.672850 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:43.672824    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"]
Jul 29 18:36:43.674460 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:36:43.674430    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod925a9b0d_d4bd_4cb7_ab22_68a8a4f5d300.slice/crio-cb4c488f18de4288ff83310586d70ce6ae7398b837b1176ed4e52bb5fec9ad31 WatchSource:0}: Error finding container cb4c488f18de4288ff83310586d70ce6ae7398b837b1176ed4e52bb5fec9ad31: Status 404 returned error can't find the container with id cb4c488f18de4288ff83310586d70ce6ae7398b837b1176ed4e52bb5fec9ad31
Jul 29 18:36:44.196396 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:44.196359    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t" event={"ID":"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300","Type":"ContainerStarted","Data":"c93daa3afcd3c3f007c144895084f236be7c3c2c3607091fd5f189bbccd87687"}
Jul 29 18:36:44.196396 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:44.196405    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t" event={"ID":"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300","Type":"ContainerStarted","Data":"cb4c488f18de4288ff83310586d70ce6ae7398b837b1176ed4e52bb5fec9ad31"}
Jul 29 18:36:44.214955 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:44.214897    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t" podStartSLOduration=1.214881218 podStartE2EDuration="1.214881218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:36:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:36:44.212951375 +0000 UTC m=+2632.561179468" watchObservedRunningTime="2026-07-29 18:36:44.214881218 +0000 UTC m=+2632.563109311"
Jul 29 18:36:47.324319 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:47.324282    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:36:53.536774 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:53.536732    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:53.537216 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:53.536798    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:53.549630 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:53.549599    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:36:54.258694 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:36:54.258657    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:37:13.223364 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:37:13.223320    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:37:39.320038 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:37:39.319957    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:37:58.026259 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:37:58.026166    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:38:25.121595 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:38:25.121553    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:38:43.628008 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:38:43.627955    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:39:03.825474 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:39:03.825438    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:39:23.220649 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:39:23.220558    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:39:49.216850 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:39:49.216804    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:40:06.217791 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:40:06.217753    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:40:33.521755 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:40:33.521712    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:40:52.817267 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:40:52.817180    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:41:18.712395 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:18.712357    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:41:21.632355 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:21.632318    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"]
Jul 29 18:41:22.693564 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:22.693532    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"]
Jul 29 18:41:31.027463 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.027428    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"]
Jul 29 18:41:31.030932 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.030915    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.033693 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.033666    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-297c4d\"/\"sub-test-model-297c4d-kserve-self-signed-certs\""
Jul 29 18:41:31.039734 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.039699    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"]
Jul 29 18:41:31.130691 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.130633    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-model-cache\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.130691 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.130693    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-tls-certs\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.130925 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.130720    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-home\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.130925 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.130764    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-dshm\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.130925 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.130812    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pblwc\" (UniqueName: \"kubernetes.io/projected/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-kube-api-access-pblwc\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.130925 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.130879    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-tmp-dir\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.232217 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.232088    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-tmp-dir\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.232685 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.232660    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-tmp-dir\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.232685 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.232643    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-model-cache\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.232867 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.232734    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-tls-certs\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.232867 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.232800    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-home\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.232867 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.232848    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-dshm\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.233061 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.232877    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pblwc\" (UniqueName: \"kubernetes.io/projected/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-kube-api-access-pblwc\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.233061 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.232951    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-model-cache\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.233141 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.233125    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-home\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.235256 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.235238    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-dshm\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.235361 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.235345    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-tls-certs\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.241701 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.241682    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pblwc\" (UniqueName: \"kubernetes.io/projected/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-kube-api-access-pblwc\") pod \"sub-test-model-297c4d-kserve-b987cdbbf-mfntf\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") " pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.340804 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.340706    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:31.479130 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.479103    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"]
Jul 29 18:41:31.480817 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:41:31.480790    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8b1f8d1_9e1b_4783_9e18_4390d24b827b.slice/crio-0a5e8228a623a7bb3c1fd72edaee92587a84a611cbf2662e67752c184332cd4e WatchSource:0}: Error finding container 0a5e8228a623a7bb3c1fd72edaee92587a84a611cbf2662e67752c184332cd4e: Status 404 returned error can't find the container with id 0a5e8228a623a7bb3c1fd72edaee92587a84a611cbf2662e67752c184332cd4e
Jul 29 18:41:31.733906 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.733868    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf" event={"ID":"a8b1f8d1-9e1b-4783-9e18-4390d24b827b","Type":"ContainerStarted","Data":"cdd4629d6c8469a831cd177dac2a5ac4344ea6625d3c2d58c7a077b8e7caa28e"}
Jul 29 18:41:31.733906 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.733910    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf" event={"ID":"a8b1f8d1-9e1b-4783-9e18-4390d24b827b","Type":"ContainerStarted","Data":"0a5e8228a623a7bb3c1fd72edaee92587a84a611cbf2662e67752c184332cd4e"}
Jul 29 18:41:31.752298 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:31.752245    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf" podStartSLOduration=0.75222929 podStartE2EDuration="752.22929ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:41:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:41:31.751175343 +0000 UTC m=+2920.099403437" watchObservedRunningTime="2026-07-29 18:41:31.75222929 +0000 UTC m=+2920.100457382"
Jul 29 18:41:35.818969 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:35.818929    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:41:36.651819 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:36.651779    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7" podUID="129916bb-01c2-45c0-9aaf-c4b06182c9ec" containerName="main" containerID="cri-o://8a3dd36f3a857298276d1db00b52dca1547960436754300fa30831a16ff9e7be" gracePeriod=45
Jul 29 18:41:36.906789 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:36.906727    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:41:37.086779 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.086740    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/129916bb-01c2-45c0-9aaf-c4b06182c9ec-tls-certs\") pod \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") "
Jul 29 18:41:37.086964 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.086811    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-model-cache\") pod \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") "
Jul 29 18:41:37.086964 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.086866    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-home\") pod \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") "
Jul 29 18:41:37.086964 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.086917    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbqfn\" (UniqueName: \"kubernetes.io/projected/129916bb-01c2-45c0-9aaf-c4b06182c9ec-kube-api-access-mbqfn\") pod \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") "
Jul 29 18:41:37.086964 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.086950    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-dshm\") pod \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") "
Jul 29 18:41:37.087229 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.087022    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-tmp-dir\") pod \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\" (UID: \"129916bb-01c2-45c0-9aaf-c4b06182c9ec\") "
Jul 29 18:41:37.087229 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.087090    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-model-cache" (OuterVolumeSpecName: "model-cache") pod "129916bb-01c2-45c0-9aaf-c4b06182c9ec" (UID: "129916bb-01c2-45c0-9aaf-c4b06182c9ec"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:41:37.087229 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.087191    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-home" (OuterVolumeSpecName: "home") pod "129916bb-01c2-45c0-9aaf-c4b06182c9ec" (UID: "129916bb-01c2-45c0-9aaf-c4b06182c9ec"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:41:37.087389 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.087340    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "129916bb-01c2-45c0-9aaf-c4b06182c9ec" (UID: "129916bb-01c2-45c0-9aaf-c4b06182c9ec"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:41:37.087389 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.087384    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-home\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:41:37.087487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.087401    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-model-cache\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:41:37.089115 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.089094    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/129916bb-01c2-45c0-9aaf-c4b06182c9ec-kube-api-access-mbqfn" (OuterVolumeSpecName: "kube-api-access-mbqfn") pod "129916bb-01c2-45c0-9aaf-c4b06182c9ec" (UID: "129916bb-01c2-45c0-9aaf-c4b06182c9ec"). InnerVolumeSpecName "kube-api-access-mbqfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:41:37.089223 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.089122    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/129916bb-01c2-45c0-9aaf-c4b06182c9ec-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "129916bb-01c2-45c0-9aaf-c4b06182c9ec" (UID: "129916bb-01c2-45c0-9aaf-c4b06182c9ec"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 18:41:37.089223 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.089121    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-dshm" (OuterVolumeSpecName: "dshm") pod "129916bb-01c2-45c0-9aaf-c4b06182c9ec" (UID: "129916bb-01c2-45c0-9aaf-c4b06182c9ec"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:41:37.188328 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.188235    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbqfn\" (UniqueName: \"kubernetes.io/projected/129916bb-01c2-45c0-9aaf-c4b06182c9ec-kube-api-access-mbqfn\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:41:37.188328 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.188269    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-dshm\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:41:37.188328 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.188283    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129916bb-01c2-45c0-9aaf-c4b06182c9ec-tmp-dir\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:41:37.188328 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.188297    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/129916bb-01c2-45c0-9aaf-c4b06182c9ec-tls-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:41:37.712704 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.712656    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t" podUID="925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300" containerName="main" containerID="cri-o://c93daa3afcd3c3f007c144895084f236be7c3c2c3607091fd5f189bbccd87687" gracePeriod=45
Jul 29 18:41:37.768329 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.768295    2567 generic.go:356] "Generic (PLEG): container finished" podID="129916bb-01c2-45c0-9aaf-c4b06182c9ec" containerID="8a3dd36f3a857298276d1db00b52dca1547960436754300fa30831a16ff9e7be" exitCode=0
Jul 29 18:41:37.768502 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.768333    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"
Jul 29 18:41:37.768502 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.768346    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7" event={"ID":"129916bb-01c2-45c0-9aaf-c4b06182c9ec","Type":"ContainerDied","Data":"8a3dd36f3a857298276d1db00b52dca1547960436754300fa30831a16ff9e7be"}
Jul 29 18:41:37.768502 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.768383    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7" event={"ID":"129916bb-01c2-45c0-9aaf-c4b06182c9ec","Type":"ContainerDied","Data":"cbab899dd78abbf4aecbda3629d3153e7095be49b29cdb241243b7c8437c29e0"}
Jul 29 18:41:37.768502 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.768400    2567 scope.go:117] "RemoveContainer" containerID="8a3dd36f3a857298276d1db00b52dca1547960436754300fa30831a16ff9e7be"
Jul 29 18:41:37.794516 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.794483    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"]
Jul 29 18:41:37.798502 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.798471    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/auth-test-model-297c4d-kserve-7fb7964f9f-j4nn7"]
Jul 29 18:41:37.823305 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.823283    2567 scope.go:117] "RemoveContainer" containerID="8a3dd36f3a857298276d1db00b52dca1547960436754300fa30831a16ff9e7be"
Jul 29 18:41:37.823688 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:41:37.823666    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a3dd36f3a857298276d1db00b52dca1547960436754300fa30831a16ff9e7be\": container with ID starting with 8a3dd36f3a857298276d1db00b52dca1547960436754300fa30831a16ff9e7be not found: ID does not exist" containerID="8a3dd36f3a857298276d1db00b52dca1547960436754300fa30831a16ff9e7be"
Jul 29 18:41:37.823767 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.823702    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a3dd36f3a857298276d1db00b52dca1547960436754300fa30831a16ff9e7be"} err="failed to get container status \"8a3dd36f3a857298276d1db00b52dca1547960436754300fa30831a16ff9e7be\": rpc error: code = NotFound desc = could not find container \"8a3dd36f3a857298276d1db00b52dca1547960436754300fa30831a16ff9e7be\": container with ID starting with 8a3dd36f3a857298276d1db00b52dca1547960436754300fa30831a16ff9e7be not found: ID does not exist"
Jul 29 18:41:37.968910 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:37.968851    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:41:38.073921 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.073885    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="129916bb-01c2-45c0-9aaf-c4b06182c9ec" path="/var/lib/kubelet/pods/129916bb-01c2-45c0-9aaf-c4b06182c9ec/volumes"
Jul 29 18:41:38.096052 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.096016    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-model-cache\") pod \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") "
Jul 29 18:41:38.096233 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.096100    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-home\") pod \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") "
Jul 29 18:41:38.096233 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.096160    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqrfw\" (UniqueName: \"kubernetes.io/projected/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-kube-api-access-zqrfw\") pod \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") "
Jul 29 18:41:38.096233 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.096190    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-tls-certs\") pod \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") "
Jul 29 18:41:38.096233 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.096212    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-dshm\") pod \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") "
Jul 29 18:41:38.096447 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.096249    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-model-cache" (OuterVolumeSpecName: "model-cache") pod "925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300" (UID: "925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:41:38.096447 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.096265    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-tmp-dir\") pod \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\" (UID: \"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300\") "
Jul 29 18:41:38.096447 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.096398    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-home" (OuterVolumeSpecName: "home") pod "925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300" (UID: "925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:41:38.096595 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.096569    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300" (UID: "925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:41:38.096661 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.096582    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-home\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:41:38.096661 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.096618    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-model-cache\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:41:38.098450 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.098428    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300" (UID: "925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 18:41:38.098450 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.098443    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-dshm" (OuterVolumeSpecName: "dshm") pod "925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300" (UID: "925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:41:38.098572 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.098509    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-kube-api-access-zqrfw" (OuterVolumeSpecName: "kube-api-access-zqrfw") pod "925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300" (UID: "925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300"). InnerVolumeSpecName "kube-api-access-zqrfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:41:38.197261 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.197218    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-tmp-dir\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:41:38.197261 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.197254    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqrfw\" (UniqueName: \"kubernetes.io/projected/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-kube-api-access-zqrfw\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:41:38.197261 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.197264    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-tls-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:41:38.197261 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.197273    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300-dshm\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:41:38.775848 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.775812    2567 generic.go:356] "Generic (PLEG): container finished" podID="925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300" containerID="c93daa3afcd3c3f007c144895084f236be7c3c2c3607091fd5f189bbccd87687" exitCode=0
Jul 29 18:41:38.776058 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.775855    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"
Jul 29 18:41:38.776058 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.775868    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t" event={"ID":"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300","Type":"ContainerDied","Data":"c93daa3afcd3c3f007c144895084f236be7c3c2c3607091fd5f189bbccd87687"}
Jul 29 18:41:38.776058 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.775899    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t" event={"ID":"925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300","Type":"ContainerDied","Data":"cb4c488f18de4288ff83310586d70ce6ae7398b837b1176ed4e52bb5fec9ad31"}
Jul 29 18:41:38.776058 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.775916    2567 scope.go:117] "RemoveContainer" containerID="c93daa3afcd3c3f007c144895084f236be7c3c2c3607091fd5f189bbccd87687"
Jul 29 18:41:38.785810 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.785792    2567 scope.go:117] "RemoveContainer" containerID="c93daa3afcd3c3f007c144895084f236be7c3c2c3607091fd5f189bbccd87687"
Jul 29 18:41:38.786076 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:41:38.786055    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c93daa3afcd3c3f007c144895084f236be7c3c2c3607091fd5f189bbccd87687\": container with ID starting with c93daa3afcd3c3f007c144895084f236be7c3c2c3607091fd5f189bbccd87687 not found: ID does not exist" containerID="c93daa3afcd3c3f007c144895084f236be7c3c2c3607091fd5f189bbccd87687"
Jul 29 18:41:38.786139 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.786084    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c93daa3afcd3c3f007c144895084f236be7c3c2c3607091fd5f189bbccd87687"} err="failed to get container status \"c93daa3afcd3c3f007c144895084f236be7c3c2c3607091fd5f189bbccd87687\": rpc error: code = NotFound desc = could not find container \"c93daa3afcd3c3f007c144895084f236be7c3c2c3607091fd5f189bbccd87687\": container with ID starting with c93daa3afcd3c3f007c144895084f236be7c3c2c3607091fd5f189bbccd87687 not found: ID does not exist"
Jul 29 18:41:38.796918 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.796896    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"]
Jul 29 18:41:38.800037 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:38.800015    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/auth-test-model-f9520e-kserve-7cf4bbc8f9-lfm8t"]
Jul 29 18:41:40.073491 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:40.073455    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300" path="/var/lib/kubelet/pods/925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300/volumes"
Jul 29 18:41:41.341637 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:41.341588    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:41.341637 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:41.341653    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:41.354267 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:41.354241    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:41:41.803071 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:41:41.803040    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:42:06.422600 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.422563    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"]
Jul 29 18:42:06.423204 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.423045    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="129916bb-01c2-45c0-9aaf-c4b06182c9ec" containerName="main"
Jul 29 18:42:06.423204 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.423063    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="129916bb-01c2-45c0-9aaf-c4b06182c9ec" containerName="main"
Jul 29 18:42:06.423204 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.423081    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300" containerName="main"
Jul 29 18:42:06.423204 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.423089    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300" containerName="main"
Jul 29 18:42:06.423204 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.423195    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="129916bb-01c2-45c0-9aaf-c4b06182c9ec" containerName="main"
Jul 29 18:42:06.423204 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.423208    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="925a9b0d-d4bd-4cb7-ab22-68a8a4f5d300" containerName="main"
Jul 29 18:42:06.426047 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.426027    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.428685 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.428660    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f9520e\"/\"openshift-service-ca.crt\""
Jul 29 18:42:06.430303 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.430275    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f9520e\"/\"sub-test-model-f9520e-kserve-self-signed-certs\""
Jul 29 18:42:06.430426 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.430344    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f9520e\"/\"kube-root-ca.crt\""
Jul 29 18:42:06.430490 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.430429    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f9520e\"/\"default-dockercfg-sglh9\""
Jul 29 18:42:06.440425 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.440398    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"]
Jul 29 18:42:06.525878 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.525837    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-tmp-dir\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.525878 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.525881    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-home\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.526146 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.525902    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tndlz\" (UniqueName: \"kubernetes.io/projected/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-kube-api-access-tndlz\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.526146 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.525998    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-model-cache\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.526146 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.526034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-dshm\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.526146 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.526068    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-tls-certs\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.627053 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.626983    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-tls-certs\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.627253 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.627122    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-tmp-dir\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.627253 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.627150    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-home\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.627253 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.627169    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tndlz\" (UniqueName: \"kubernetes.io/projected/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-kube-api-access-tndlz\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.627253 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.627196    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-model-cache\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.627253 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.627217    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-dshm\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.627680 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.627646    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-home\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.627797 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.627656    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-tmp-dir\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.627797 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.627704    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-model-cache\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.629477 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.629448    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-dshm\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.629739 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.629723    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-tls-certs\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.635021 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.634976    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tndlz\" (UniqueName: \"kubernetes.io/projected/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-kube-api-access-tndlz\") pod \"sub-test-model-f9520e-kserve-84cdb547c7-t8776\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") " pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.743565 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.743530    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:06.886271 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.886239    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"]
Jul 29 18:42:06.887753 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:42:06.887722    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a10f16c_a5f8_4ad6_bd29_68c987530ff9.slice/crio-9b335e2519af70e5520cf6799878a9a708ee1facf8f3ec5dc2c7df5695e38294 WatchSource:0}: Error finding container 9b335e2519af70e5520cf6799878a9a708ee1facf8f3ec5dc2c7df5695e38294: Status 404 returned error can't find the container with id 9b335e2519af70e5520cf6799878a9a708ee1facf8f3ec5dc2c7df5695e38294
Jul 29 18:42:06.923604 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:06.923566    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776" event={"ID":"4a10f16c-a5f8-4ad6-bd29-68c987530ff9","Type":"ContainerStarted","Data":"9b335e2519af70e5520cf6799878a9a708ee1facf8f3ec5dc2c7df5695e38294"}
Jul 29 18:42:07.930410 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:07.930374    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776" event={"ID":"4a10f16c-a5f8-4ad6-bd29-68c987530ff9","Type":"ContainerStarted","Data":"281bf8bf97aff4206ae4be6c0affe67522784e7cc3c841cfa5ba8956cf9bf3e0"}
Jul 29 18:42:07.946394 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:07.946338    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776" podStartSLOduration=1.9463202960000001 podStartE2EDuration="1.946320296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:42:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:42:07.945732426 +0000 UTC m=+2956.293960520" watchObservedRunningTime="2026-07-29 18:42:07.946320296 +0000 UTC m=+2956.294548389"
Jul 29 18:42:10.012929 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:10.012888    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:42:16.744542 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:16.744446    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:16.744542 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:16.744513    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:16.757057 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:16.757030    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:16.989369 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:16.989341    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:42:57.115904 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:42:57.115864    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:43:16.046361 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:16.046318    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:43:37.311189 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:37.311146    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:43:42.393159 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:42.393122    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"]
Jul 29 18:43:43.420951 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:43.420913    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"]
Jul 29 18:43:56.110267 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:56.110227    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:43:57.412408 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.412365    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf" podUID="a8b1f8d1-9e1b-4783-9e18-4390d24b827b" containerName="main" containerID="cri-o://cdd4629d6c8469a831cd177dac2a5ac4344ea6625d3c2d58c7a077b8e7caa28e" gracePeriod=45
Jul 29 18:43:57.663445 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.663373    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:43:57.764512 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.764467    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-tls-certs\") pod \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") "
Jul 29 18:43:57.764718 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.764522    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-dshm\") pod \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") "
Jul 29 18:43:57.764718 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.764562    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-model-cache\") pod \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") "
Jul 29 18:43:57.764718 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.764647    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pblwc\" (UniqueName: \"kubernetes.io/projected/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-kube-api-access-pblwc\") pod \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") "
Jul 29 18:43:57.764904 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.764764    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-tmp-dir\") pod \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") "
Jul 29 18:43:57.764904 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.764804    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-home\") pod \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\" (UID: \"a8b1f8d1-9e1b-4783-9e18-4390d24b827b\") "
Jul 29 18:43:57.764904 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.764821    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8b1f8d1-9e1b-4783-9e18-4390d24b827b" (UID: "a8b1f8d1-9e1b-4783-9e18-4390d24b827b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:43:57.765112 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.765084    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8b1f8d1-9e1b-4783-9e18-4390d24b827b" (UID: "a8b1f8d1-9e1b-4783-9e18-4390d24b827b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:43:57.765112 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.765096    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-home" (OuterVolumeSpecName: "home") pod "a8b1f8d1-9e1b-4783-9e18-4390d24b827b" (UID: "a8b1f8d1-9e1b-4783-9e18-4390d24b827b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:43:57.765228 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.765113    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-model-cache\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:43:57.766765 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.766739    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-dshm" (OuterVolumeSpecName: "dshm") pod "a8b1f8d1-9e1b-4783-9e18-4390d24b827b" (UID: "a8b1f8d1-9e1b-4783-9e18-4390d24b827b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:43:57.767205 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.767185    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-kube-api-access-pblwc" (OuterVolumeSpecName: "kube-api-access-pblwc") pod "a8b1f8d1-9e1b-4783-9e18-4390d24b827b" (UID: "a8b1f8d1-9e1b-4783-9e18-4390d24b827b"). InnerVolumeSpecName "kube-api-access-pblwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:43:57.767272 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.767197    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8b1f8d1-9e1b-4783-9e18-4390d24b827b" (UID: "a8b1f8d1-9e1b-4783-9e18-4390d24b827b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 18:43:57.866558 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.866517    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-home\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:43:57.866558 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.866551    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-tls-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:43:57.866558 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.866560    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-dshm\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:43:57.866558 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.866570    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pblwc\" (UniqueName: \"kubernetes.io/projected/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-kube-api-access-pblwc\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:43:57.866845 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:57.866581    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8b1f8d1-9e1b-4783-9e18-4390d24b827b-tmp-dir\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:43:58.441521 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.441398    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776" podUID="4a10f16c-a5f8-4ad6-bd29-68c987530ff9" containerName="main" containerID="cri-o://281bf8bf97aff4206ae4be6c0affe67522784e7cc3c841cfa5ba8956cf9bf3e0" gracePeriod=45
Jul 29 18:43:58.513782 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.513748    2567 generic.go:356] "Generic (PLEG): container finished" podID="a8b1f8d1-9e1b-4783-9e18-4390d24b827b" containerID="cdd4629d6c8469a831cd177dac2a5ac4344ea6625d3c2d58c7a077b8e7caa28e" exitCode=0
Jul 29 18:43:58.513956 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.513788    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"
Jul 29 18:43:58.513956 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.513833    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf" event={"ID":"a8b1f8d1-9e1b-4783-9e18-4390d24b827b","Type":"ContainerDied","Data":"cdd4629d6c8469a831cd177dac2a5ac4344ea6625d3c2d58c7a077b8e7caa28e"}
Jul 29 18:43:58.513956 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.513879    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf" event={"ID":"a8b1f8d1-9e1b-4783-9e18-4390d24b827b","Type":"ContainerDied","Data":"0a5e8228a623a7bb3c1fd72edaee92587a84a611cbf2662e67752c184332cd4e"}
Jul 29 18:43:58.513956 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.513901    2567 scope.go:117] "RemoveContainer" containerID="cdd4629d6c8469a831cd177dac2a5ac4344ea6625d3c2d58c7a077b8e7caa28e"
Jul 29 18:43:58.530414 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.530377    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"]
Jul 29 18:43:58.534106 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.534076    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/sub-test-model-297c4d-kserve-b987cdbbf-mfntf"]
Jul 29 18:43:58.552142 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.552118    2567 scope.go:117] "RemoveContainer" containerID="cdd4629d6c8469a831cd177dac2a5ac4344ea6625d3c2d58c7a077b8e7caa28e"
Jul 29 18:43:58.552536 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:43:58.552512    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdd4629d6c8469a831cd177dac2a5ac4344ea6625d3c2d58c7a077b8e7caa28e\": container with ID starting with cdd4629d6c8469a831cd177dac2a5ac4344ea6625d3c2d58c7a077b8e7caa28e not found: ID does not exist" containerID="cdd4629d6c8469a831cd177dac2a5ac4344ea6625d3c2d58c7a077b8e7caa28e"
Jul 29 18:43:58.552634 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.552546    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdd4629d6c8469a831cd177dac2a5ac4344ea6625d3c2d58c7a077b8e7caa28e"} err="failed to get container status \"cdd4629d6c8469a831cd177dac2a5ac4344ea6625d3c2d58c7a077b8e7caa28e\": rpc error: code = NotFound desc = could not find container \"cdd4629d6c8469a831cd177dac2a5ac4344ea6625d3c2d58c7a077b8e7caa28e\": container with ID starting with cdd4629d6c8469a831cd177dac2a5ac4344ea6625d3c2d58c7a077b8e7caa28e not found: ID does not exist"
Jul 29 18:43:58.682325 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.682296    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:43:58.775697 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.775666    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-tmp-dir\") pod \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") "
Jul 29 18:43:58.775871 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.775704    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-model-cache\") pod \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") "
Jul 29 18:43:58.775871 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.775744    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-dshm\") pod \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") "
Jul 29 18:43:58.775871 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.775791    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-home\") pod \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") "
Jul 29 18:43:58.775871 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.775848    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tndlz\" (UniqueName: \"kubernetes.io/projected/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-kube-api-access-tndlz\") pod \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") "
Jul 29 18:43:58.776088 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.775903    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-tls-certs\") pod \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\" (UID: \"4a10f16c-a5f8-4ad6-bd29-68c987530ff9\") "
Jul 29 18:43:58.776088 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.775974    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4a10f16c-a5f8-4ad6-bd29-68c987530ff9" (UID: "4a10f16c-a5f8-4ad6-bd29-68c987530ff9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:43:58.776201 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.776109    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-model-cache" (OuterVolumeSpecName: "model-cache") pod "4a10f16c-a5f8-4ad6-bd29-68c987530ff9" (UID: "4a10f16c-a5f8-4ad6-bd29-68c987530ff9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:43:58.776201 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.776139    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-home" (OuterVolumeSpecName: "home") pod "4a10f16c-a5f8-4ad6-bd29-68c987530ff9" (UID: "4a10f16c-a5f8-4ad6-bd29-68c987530ff9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:43:58.776312 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.776268    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-tmp-dir\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:43:58.776312 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.776286    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-model-cache\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:43:58.776312 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.776300    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-home\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:43:58.777949 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.777924    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-kube-api-access-tndlz" (OuterVolumeSpecName: "kube-api-access-tndlz") pod "4a10f16c-a5f8-4ad6-bd29-68c987530ff9" (UID: "4a10f16c-a5f8-4ad6-bd29-68c987530ff9"). InnerVolumeSpecName "kube-api-access-tndlz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:43:58.778050 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.777970    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4a10f16c-a5f8-4ad6-bd29-68c987530ff9" (UID: "4a10f16c-a5f8-4ad6-bd29-68c987530ff9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 18:43:58.778050 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.777973    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-dshm" (OuterVolumeSpecName: "dshm") pod "4a10f16c-a5f8-4ad6-bd29-68c987530ff9" (UID: "4a10f16c-a5f8-4ad6-bd29-68c987530ff9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:43:58.877377 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.877333    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-tls-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:43:58.877377 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.877367    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-dshm\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:43:58.877377 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:58.877376    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tndlz\" (UniqueName: \"kubernetes.io/projected/4a10f16c-a5f8-4ad6-bd29-68c987530ff9-kube-api-access-tndlz\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:43:59.521106 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:59.521070    2567 generic.go:356] "Generic (PLEG): container finished" podID="4a10f16c-a5f8-4ad6-bd29-68c987530ff9" containerID="281bf8bf97aff4206ae4be6c0affe67522784e7cc3c841cfa5ba8956cf9bf3e0" exitCode=0
Jul 29 18:43:59.521539 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:59.521122    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"
Jul 29 18:43:59.521539 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:59.521171    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776" event={"ID":"4a10f16c-a5f8-4ad6-bd29-68c987530ff9","Type":"ContainerDied","Data":"281bf8bf97aff4206ae4be6c0affe67522784e7cc3c841cfa5ba8956cf9bf3e0"}
Jul 29 18:43:59.521539 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:59.521214    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776" event={"ID":"4a10f16c-a5f8-4ad6-bd29-68c987530ff9","Type":"ContainerDied","Data":"9b335e2519af70e5520cf6799878a9a708ee1facf8f3ec5dc2c7df5695e38294"}
Jul 29 18:43:59.521539 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:59.521233    2567 scope.go:117] "RemoveContainer" containerID="281bf8bf97aff4206ae4be6c0affe67522784e7cc3c841cfa5ba8956cf9bf3e0"
Jul 29 18:43:59.532714 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:59.532692    2567 scope.go:117] "RemoveContainer" containerID="281bf8bf97aff4206ae4be6c0affe67522784e7cc3c841cfa5ba8956cf9bf3e0"
Jul 29 18:43:59.533171 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:43:59.533148    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"281bf8bf97aff4206ae4be6c0affe67522784e7cc3c841cfa5ba8956cf9bf3e0\": container with ID starting with 281bf8bf97aff4206ae4be6c0affe67522784e7cc3c841cfa5ba8956cf9bf3e0 not found: ID does not exist" containerID="281bf8bf97aff4206ae4be6c0affe67522784e7cc3c841cfa5ba8956cf9bf3e0"
Jul 29 18:43:59.533269 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:59.533178    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"281bf8bf97aff4206ae4be6c0affe67522784e7cc3c841cfa5ba8956cf9bf3e0"} err="failed to get container status \"281bf8bf97aff4206ae4be6c0affe67522784e7cc3c841cfa5ba8956cf9bf3e0\": rpc error: code = NotFound desc = could not find container \"281bf8bf97aff4206ae4be6c0affe67522784e7cc3c841cfa5ba8956cf9bf3e0\": container with ID starting with 281bf8bf97aff4206ae4be6c0affe67522784e7cc3c841cfa5ba8956cf9bf3e0 not found: ID does not exist"
Jul 29 18:43:59.543586 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:59.543556    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"]
Jul 29 18:43:59.546844 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:43:59.546821    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/sub-test-model-f9520e-kserve-84cdb547c7-t8776"]
Jul 29 18:44:00.074004 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.073953    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a10f16c-a5f8-4ad6-bd29-68c987530ff9" path="/var/lib/kubelet/pods/4a10f16c-a5f8-4ad6-bd29-68c987530ff9/volumes"
Jul 29 18:44:00.074422 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.074406    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8b1f8d1-9e1b-4783-9e18-4390d24b827b" path="/var/lib/kubelet/pods/a8b1f8d1-9e1b-4783-9e18-4390d24b827b/volumes"
Jul 29 18:44:00.821861 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.821827    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"]
Jul 29 18:44:00.822307 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.822183    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8b1f8d1-9e1b-4783-9e18-4390d24b827b" containerName="main"
Jul 29 18:44:00.822307 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.822194    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8b1f8d1-9e1b-4783-9e18-4390d24b827b" containerName="main"
Jul 29 18:44:00.822307 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.822202    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a10f16c-a5f8-4ad6-bd29-68c987530ff9" containerName="main"
Jul 29 18:44:00.822307 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.822208    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a10f16c-a5f8-4ad6-bd29-68c987530ff9" containerName="main"
Jul 29 18:44:00.822307 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.822274    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8b1f8d1-9e1b-4783-9e18-4390d24b827b" containerName="main"
Jul 29 18:44:00.822307 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.822285    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a10f16c-a5f8-4ad6-bd29-68c987530ff9" containerName="main"
Jul 29 18:44:00.826825 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.826806    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:00.830550 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.830525    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-297c4d\"/\"rate-test-model-297c4d-kserve-self-signed-certs\""
Jul 29 18:44:00.830550 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.830547    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-297c4d\"/\"openshift-service-ca.crt\""
Jul 29 18:44:00.830887 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.830857    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-297c4d\"/\"default-dockercfg-ll6n5\""
Jul 29 18:44:00.831555 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.830913    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-297c4d\"/\"kube-root-ca.crt\""
Jul 29 18:44:00.833689 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.833663    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"]
Jul 29 18:44:00.899132 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.899092    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20a82297-7eaf-44f9-a476-1041841a77ab-tls-certs\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:00.899304 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.899155    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ctdd\" (UniqueName: \"kubernetes.io/projected/20a82297-7eaf-44f9-a476-1041841a77ab-kube-api-access-6ctdd\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:00.899304 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.899229    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-home\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:00.899304 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.899275    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-model-cache\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:00.899304 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.899298    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-tmp-dir\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:00.899448 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:00.899332    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-dshm\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:01.000775 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.000729    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ctdd\" (UniqueName: \"kubernetes.io/projected/20a82297-7eaf-44f9-a476-1041841a77ab-kube-api-access-6ctdd\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:01.000967 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.000840    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-home\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:01.000967 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.000905    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-model-cache\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:01.000967 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.000932    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-tmp-dir\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:01.000967 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.000958    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-dshm\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:01.001168 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.000984    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20a82297-7eaf-44f9-a476-1041841a77ab-tls-certs\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:01.001368 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.001345    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-home\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:01.001368 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.001359    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-model-cache\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:01.001442 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.001411    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-tmp-dir\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:01.003346 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.003323    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-dshm\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:01.003539 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.003521    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20a82297-7eaf-44f9-a476-1041841a77ab-tls-certs\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:01.017202 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.017170    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ctdd\" (UniqueName: \"kubernetes.io/projected/20a82297-7eaf-44f9-a476-1041841a77ab-kube-api-access-6ctdd\") pod \"rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") " pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:01.137387 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.137287    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:01.271212 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.271181    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"]
Jul 29 18:44:01.272604 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:44:01.272581    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20a82297_7eaf_44f9_a476_1041841a77ab.slice/crio-fafb2a477609097802f00a14f71f960b9d78a1df04f70761a3c63f0eb9d53438 WatchSource:0}: Error finding container fafb2a477609097802f00a14f71f960b9d78a1df04f70761a3c63f0eb9d53438: Status 404 returned error can't find the container with id fafb2a477609097802f00a14f71f960b9d78a1df04f70761a3c63f0eb9d53438
Jul 29 18:44:01.533736 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.533699    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk" event={"ID":"20a82297-7eaf-44f9-a476-1041841a77ab","Type":"ContainerStarted","Data":"733ac7dd63fd869e9d146abc7cb8dea3231ca7485c3bdb9c477116dca2acf6ba"}
Jul 29 18:44:01.533930 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.533748    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk" event={"ID":"20a82297-7eaf-44f9-a476-1041841a77ab","Type":"ContainerStarted","Data":"fafb2a477609097802f00a14f71f960b9d78a1df04f70761a3c63f0eb9d53438"}
Jul 29 18:44:01.551220 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:01.551165    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk" podStartSLOduration=1.551150025 podStartE2EDuration="1.551150025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:44:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:44:01.548681255 +0000 UTC m=+3069.896909347" watchObservedRunningTime="2026-07-29 18:44:01.551150025 +0000 UTC m=+3069.899378158"
Jul 29 18:44:06.419233 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:06.419195    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:44:11.138248 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:11.138201    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:11.138690 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:11.138263    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:11.150932 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:11.150902    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:11.595090 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:11.595055    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:44:38.230377 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.230334    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"]
Jul 29 18:44:38.233770 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.233748    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.236625 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.236601    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f9520e\"/\"openshift-service-ca.crt\""
Jul 29 18:44:38.237589 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.237555    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f9520e\"/\"kube-root-ca.crt\""
Jul 29 18:44:38.237670 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.237597    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f9520e\"/\"rate-test-model-f9520e-kserve-self-signed-certs\""
Jul 29 18:44:38.237824 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.237806    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f9520e\"/\"default-dockercfg-sglh9\""
Jul 29 18:44:38.244339 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.244316    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"]
Jul 29 18:44:38.342468 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.342430    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-home\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.342468 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.342465    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-dshm\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.342724 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.342488    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-model-cache\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.342724 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.342507    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzdh2\" (UniqueName: \"kubernetes.io/projected/4382133a-f540-40ce-9835-247d27632bb5-kube-api-access-pzdh2\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.342724 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.342557    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4382133a-f540-40ce-9835-247d27632bb5-tls-certs\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.342724 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.342573    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-tmp-dir\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.444005 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.443952    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-home\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.444199 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.444015    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-dshm\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.444199 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.444046    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-model-cache\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.444199 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.444066    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzdh2\" (UniqueName: \"kubernetes.io/projected/4382133a-f540-40ce-9835-247d27632bb5-kube-api-access-pzdh2\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.444199 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.444105    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4382133a-f540-40ce-9835-247d27632bb5-tls-certs\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.444199 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.444134    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-tmp-dir\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.444484 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.444400    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-home\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.444538 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.444491    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-model-cache\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.444538 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.444523    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-tmp-dir\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.446247 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.446225    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-dshm\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.446529 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.446512    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4382133a-f540-40ce-9835-247d27632bb5-tls-certs\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.453117 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.453091    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzdh2\" (UniqueName: \"kubernetes.io/projected/4382133a-f540-40ce-9835-247d27632bb5-kube-api-access-pzdh2\") pod \"rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") " pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.544353 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.544320    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:38.675417 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.675392    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"]
Jul 29 18:44:38.677563 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:44:38.677515    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4382133a_f540_40ce_9835_247d27632bb5.slice/crio-4627a5015990f3edd6bc51c921ff98bc3bf5fd6663079d2a532ac892af51a732 WatchSource:0}: Error finding container 4627a5015990f3edd6bc51c921ff98bc3bf5fd6663079d2a532ac892af51a732: Status 404 returned error can't find the container with id 4627a5015990f3edd6bc51c921ff98bc3bf5fd6663079d2a532ac892af51a732
Jul 29 18:44:38.725308 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:38.725281    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9" event={"ID":"4382133a-f540-40ce-9835-247d27632bb5","Type":"ContainerStarted","Data":"4627a5015990f3edd6bc51c921ff98bc3bf5fd6663079d2a532ac892af51a732"}
Jul 29 18:44:39.731863 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:39.731824    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9" event={"ID":"4382133a-f540-40ce-9835-247d27632bb5","Type":"ContainerStarted","Data":"103780c5503890a9ec9b253abf119202cb17ef7ea12619c8299bbd42944b246c"}
Jul 29 18:44:39.749773 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:39.749713    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9" podStartSLOduration=1.7496958280000001 podStartE2EDuration="1.749695828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:44:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:44:39.748163378 +0000 UTC m=+3108.096391472" watchObservedRunningTime="2026-07-29 18:44:39.749695828 +0000 UTC m=+3108.097923920"
Jul 29 18:44:42.915284 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:42.915243    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:44:48.544763 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:48.544703    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:48.544763 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:48.544773    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:48.557722 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:48.557691    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:44:48.795290 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:44:48.795209    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:45:16.414738 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:45:16.414651    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:45:31.314852 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:45:31.314814    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:45:48.715196 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:45:48.715154    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:45:53.144154 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:45:53.144123    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"]
Jul 29 18:45:54.123167 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:45:54.123133    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"]
Jul 29 18:46:04.314534 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:04.314497    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:46:08.163612 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.163571    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk" podUID="20a82297-7eaf-44f9-a476-1041841a77ab" containerName="main" containerID="cri-o://733ac7dd63fd869e9d146abc7cb8dea3231ca7485c3bdb9c477116dca2acf6ba" gracePeriod=45
Jul 29 18:46:08.418745 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.418684    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:46:08.567868 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.567831    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-dshm\") pod \"20a82297-7eaf-44f9-a476-1041841a77ab\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") "
Jul 29 18:46:08.568086 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.567882    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-tmp-dir\") pod \"20a82297-7eaf-44f9-a476-1041841a77ab\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") "
Jul 29 18:46:08.568086 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.567945    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ctdd\" (UniqueName: \"kubernetes.io/projected/20a82297-7eaf-44f9-a476-1041841a77ab-kube-api-access-6ctdd\") pod \"20a82297-7eaf-44f9-a476-1041841a77ab\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") "
Jul 29 18:46:08.568086 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.567969    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-model-cache\") pod \"20a82297-7eaf-44f9-a476-1041841a77ab\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") "
Jul 29 18:46:08.568086 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.568019    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-home\") pod \"20a82297-7eaf-44f9-a476-1041841a77ab\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") "
Jul 29 18:46:08.568086 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.568047    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20a82297-7eaf-44f9-a476-1041841a77ab-tls-certs\") pod \"20a82297-7eaf-44f9-a476-1041841a77ab\" (UID: \"20a82297-7eaf-44f9-a476-1041841a77ab\") "
Jul 29 18:46:08.568374 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.568212    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "20a82297-7eaf-44f9-a476-1041841a77ab" (UID: "20a82297-7eaf-44f9-a476-1041841a77ab"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:46:08.568374 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.568291    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-model-cache" (OuterVolumeSpecName: "model-cache") pod "20a82297-7eaf-44f9-a476-1041841a77ab" (UID: "20a82297-7eaf-44f9-a476-1041841a77ab"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:46:08.568374 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.568308    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-home" (OuterVolumeSpecName: "home") pod "20a82297-7eaf-44f9-a476-1041841a77ab" (UID: "20a82297-7eaf-44f9-a476-1041841a77ab"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:46:08.570081 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.570048    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-dshm" (OuterVolumeSpecName: "dshm") pod "20a82297-7eaf-44f9-a476-1041841a77ab" (UID: "20a82297-7eaf-44f9-a476-1041841a77ab"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:46:08.570160 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.570148    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20a82297-7eaf-44f9-a476-1041841a77ab-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "20a82297-7eaf-44f9-a476-1041841a77ab" (UID: "20a82297-7eaf-44f9-a476-1041841a77ab"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 18:46:08.570201 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.570153    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20a82297-7eaf-44f9-a476-1041841a77ab-kube-api-access-6ctdd" (OuterVolumeSpecName: "kube-api-access-6ctdd") pod "20a82297-7eaf-44f9-a476-1041841a77ab" (UID: "20a82297-7eaf-44f9-a476-1041841a77ab"). InnerVolumeSpecName "kube-api-access-6ctdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:46:08.669326 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.669236    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-dshm\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:46:08.669326 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.669267    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-tmp-dir\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:46:08.669326 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.669276    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ctdd\" (UniqueName: \"kubernetes.io/projected/20a82297-7eaf-44f9-a476-1041841a77ab-kube-api-access-6ctdd\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:46:08.669326 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.669288    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-model-cache\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:46:08.669326 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.669297    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20a82297-7eaf-44f9-a476-1041841a77ab-home\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:46:08.669326 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:08.669305    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20a82297-7eaf-44f9-a476-1041841a77ab-tls-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:46:09.142402 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.142356    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9" podUID="4382133a-f540-40ce-9835-247d27632bb5" containerName="main" containerID="cri-o://103780c5503890a9ec9b253abf119202cb17ef7ea12619c8299bbd42944b246c" gracePeriod=45
Jul 29 18:46:09.215242 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.215206    2567 generic.go:356] "Generic (PLEG): container finished" podID="20a82297-7eaf-44f9-a476-1041841a77ab" containerID="733ac7dd63fd869e9d146abc7cb8dea3231ca7485c3bdb9c477116dca2acf6ba" exitCode=0
Jul 29 18:46:09.215657 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.215248    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"
Jul 29 18:46:09.215657 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.215297    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk" event={"ID":"20a82297-7eaf-44f9-a476-1041841a77ab","Type":"ContainerDied","Data":"733ac7dd63fd869e9d146abc7cb8dea3231ca7485c3bdb9c477116dca2acf6ba"}
Jul 29 18:46:09.215657 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.215332    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk" event={"ID":"20a82297-7eaf-44f9-a476-1041841a77ab","Type":"ContainerDied","Data":"fafb2a477609097802f00a14f71f960b9d78a1df04f70761a3c63f0eb9d53438"}
Jul 29 18:46:09.215657 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.215348    2567 scope.go:117] "RemoveContainer" containerID="733ac7dd63fd869e9d146abc7cb8dea3231ca7485c3bdb9c477116dca2acf6ba"
Jul 29 18:46:09.244236 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.244202    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"]
Jul 29 18:46:09.246306 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.246280    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-297c4d/rate-test-model-297c4d-kserve-6c49f59b5f-z4vvk"]
Jul 29 18:46:09.254047 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.253980    2567 scope.go:117] "RemoveContainer" containerID="733ac7dd63fd869e9d146abc7cb8dea3231ca7485c3bdb9c477116dca2acf6ba"
Jul 29 18:46:09.254422 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:46:09.254393    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"733ac7dd63fd869e9d146abc7cb8dea3231ca7485c3bdb9c477116dca2acf6ba\": container with ID starting with 733ac7dd63fd869e9d146abc7cb8dea3231ca7485c3bdb9c477116dca2acf6ba not found: ID does not exist" containerID="733ac7dd63fd869e9d146abc7cb8dea3231ca7485c3bdb9c477116dca2acf6ba"
Jul 29 18:46:09.254508 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.254431    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733ac7dd63fd869e9d146abc7cb8dea3231ca7485c3bdb9c477116dca2acf6ba"} err="failed to get container status \"733ac7dd63fd869e9d146abc7cb8dea3231ca7485c3bdb9c477116dca2acf6ba\": rpc error: code = NotFound desc = could not find container \"733ac7dd63fd869e9d146abc7cb8dea3231ca7485c3bdb9c477116dca2acf6ba\": container with ID starting with 733ac7dd63fd869e9d146abc7cb8dea3231ca7485c3bdb9c477116dca2acf6ba not found: ID does not exist"
Jul 29 18:46:09.398209 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.398143    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:46:09.576463 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.576425    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-model-cache\") pod \"4382133a-f540-40ce-9835-247d27632bb5\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") "
Jul 29 18:46:09.576463 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.576465    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-dshm\") pod \"4382133a-f540-40ce-9835-247d27632bb5\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") "
Jul 29 18:46:09.576678 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.576493    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-tmp-dir\") pod \"4382133a-f540-40ce-9835-247d27632bb5\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") "
Jul 29 18:46:09.576678 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.576537    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4382133a-f540-40ce-9835-247d27632bb5-tls-certs\") pod \"4382133a-f540-40ce-9835-247d27632bb5\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") "
Jul 29 18:46:09.576678 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.576570    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzdh2\" (UniqueName: \"kubernetes.io/projected/4382133a-f540-40ce-9835-247d27632bb5-kube-api-access-pzdh2\") pod \"4382133a-f540-40ce-9835-247d27632bb5\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") "
Jul 29 18:46:09.576678 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.576669    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-home\") pod \"4382133a-f540-40ce-9835-247d27632bb5\" (UID: \"4382133a-f540-40ce-9835-247d27632bb5\") "
Jul 29 18:46:09.576960 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.576757    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-model-cache" (OuterVolumeSpecName: "model-cache") pod "4382133a-f540-40ce-9835-247d27632bb5" (UID: "4382133a-f540-40ce-9835-247d27632bb5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:46:09.576960 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.576772    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4382133a-f540-40ce-9835-247d27632bb5" (UID: "4382133a-f540-40ce-9835-247d27632bb5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:46:09.577091 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.576986    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-home" (OuterVolumeSpecName: "home") pod "4382133a-f540-40ce-9835-247d27632bb5" (UID: "4382133a-f540-40ce-9835-247d27632bb5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:46:09.577091 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.577037    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-model-cache\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:46:09.577091 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.577084    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-tmp-dir\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:46:09.578698 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.578665    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4382133a-f540-40ce-9835-247d27632bb5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4382133a-f540-40ce-9835-247d27632bb5" (UID: "4382133a-f540-40ce-9835-247d27632bb5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 18:46:09.578794 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.578716    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4382133a-f540-40ce-9835-247d27632bb5-kube-api-access-pzdh2" (OuterVolumeSpecName: "kube-api-access-pzdh2") pod "4382133a-f540-40ce-9835-247d27632bb5" (UID: "4382133a-f540-40ce-9835-247d27632bb5"). InnerVolumeSpecName "kube-api-access-pzdh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:46:09.578794 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.578733    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-dshm" (OuterVolumeSpecName: "dshm") pod "4382133a-f540-40ce-9835-247d27632bb5" (UID: "4382133a-f540-40ce-9835-247d27632bb5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:46:09.677634 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.677537    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4382133a-f540-40ce-9835-247d27632bb5-tls-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:46:09.677634 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.677567    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzdh2\" (UniqueName: \"kubernetes.io/projected/4382133a-f540-40ce-9835-247d27632bb5-kube-api-access-pzdh2\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:46:09.677634 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.677579    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-home\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:46:09.677634 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:09.677588    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4382133a-f540-40ce-9835-247d27632bb5-dshm\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:46:10.074387 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.074341    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20a82297-7eaf-44f9-a476-1041841a77ab" path="/var/lib/kubelet/pods/20a82297-7eaf-44f9-a476-1041841a77ab/volumes"
Jul 29 18:46:10.226404 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.226369    2567 generic.go:356] "Generic (PLEG): container finished" podID="4382133a-f540-40ce-9835-247d27632bb5" containerID="103780c5503890a9ec9b253abf119202cb17ef7ea12619c8299bbd42944b246c" exitCode=0
Jul 29 18:46:10.226815 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.226433    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"
Jul 29 18:46:10.226815 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.226457    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9" event={"ID":"4382133a-f540-40ce-9835-247d27632bb5","Type":"ContainerDied","Data":"103780c5503890a9ec9b253abf119202cb17ef7ea12619c8299bbd42944b246c"}
Jul 29 18:46:10.226815 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.226499    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9" event={"ID":"4382133a-f540-40ce-9835-247d27632bb5","Type":"ContainerDied","Data":"4627a5015990f3edd6bc51c921ff98bc3bf5fd6663079d2a532ac892af51a732"}
Jul 29 18:46:10.226815 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.226516    2567 scope.go:117] "RemoveContainer" containerID="103780c5503890a9ec9b253abf119202cb17ef7ea12619c8299bbd42944b246c"
Jul 29 18:46:10.235366 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.235342    2567 scope.go:117] "RemoveContainer" containerID="103780c5503890a9ec9b253abf119202cb17ef7ea12619c8299bbd42944b246c"
Jul 29 18:46:10.235638 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:46:10.235622    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"103780c5503890a9ec9b253abf119202cb17ef7ea12619c8299bbd42944b246c\": container with ID starting with 103780c5503890a9ec9b253abf119202cb17ef7ea12619c8299bbd42944b246c not found: ID does not exist" containerID="103780c5503890a9ec9b253abf119202cb17ef7ea12619c8299bbd42944b246c"
Jul 29 18:46:10.235685 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.235647    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"103780c5503890a9ec9b253abf119202cb17ef7ea12619c8299bbd42944b246c"} err="failed to get container status \"103780c5503890a9ec9b253abf119202cb17ef7ea12619c8299bbd42944b246c\": rpc error: code = NotFound desc = could not find container \"103780c5503890a9ec9b253abf119202cb17ef7ea12619c8299bbd42944b246c\": container with ID starting with 103780c5503890a9ec9b253abf119202cb17ef7ea12619c8299bbd42944b246c not found: ID does not exist"
Jul 29 18:46:10.243302 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.243277    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"]
Jul 29 18:46:10.246881 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.246857    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f9520e/rate-test-model-f9520e-kserve-55b6cbf9ff-x5rd9"]
Jul 29 18:46:10.340689 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.340615    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7720-139837267673568"]
Jul 29 18:46:10.341001 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.340977    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20a82297-7eaf-44f9-a476-1041841a77ab" containerName="main"
Jul 29 18:46:10.341050 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.341006    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="20a82297-7eaf-44f9-a476-1041841a77ab" containerName="main"
Jul 29 18:46:10.341050 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.341035    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4382133a-f540-40ce-9835-247d27632bb5" containerName="main"
Jul 29 18:46:10.341050 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.341044    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4382133a-f540-40ce-9835-247d27632bb5" containerName="main"
Jul 29 18:46:10.341150 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.341119    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4382133a-f540-40ce-9835-247d27632bb5" containerName="main"
Jul 29 18:46:10.341150 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.341130    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="20a82297-7eaf-44f9-a476-1041841a77ab" containerName="main"
Jul 29 18:46:10.345481 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.345451    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7720-139837267673568"
Jul 29 18:46:10.347516 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.347488    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7720-139837267673568"]
Jul 29 18:46:10.348098 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.348082    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lxnjd\""
Jul 29 18:46:10.485501 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.485455    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns6dk\" (UniqueName: \"kubernetes.io/projected/94c9b0e9-2292-4d37-82d8-12d0ae9550cb-kube-api-access-ns6dk\") pod \"test-curl-7720-139837267673568\" (UID: \"94c9b0e9-2292-4d37-82d8-12d0ae9550cb\") " pod="opendatahub/test-curl-7720-139837267673568"
Jul 29 18:46:10.586148 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.586106    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns6dk\" (UniqueName: \"kubernetes.io/projected/94c9b0e9-2292-4d37-82d8-12d0ae9550cb-kube-api-access-ns6dk\") pod \"test-curl-7720-139837267673568\" (UID: \"94c9b0e9-2292-4d37-82d8-12d0ae9550cb\") " pod="opendatahub/test-curl-7720-139837267673568"
Jul 29 18:46:10.594252 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.594196    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns6dk\" (UniqueName: \"kubernetes.io/projected/94c9b0e9-2292-4d37-82d8-12d0ae9550cb-kube-api-access-ns6dk\") pod \"test-curl-7720-139837267673568\" (UID: \"94c9b0e9-2292-4d37-82d8-12d0ae9550cb\") " pod="opendatahub/test-curl-7720-139837267673568"
Jul 29 18:46:10.657254 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.657213    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7720-139837267673568"
Jul 29 18:46:10.991580 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.991556    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7720-139837267673568"]
Jul 29 18:46:10.993307 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:46:10.993263    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94c9b0e9_2292_4d37_82d8_12d0ae9550cb.slice/crio-6346f3f89d297fa9dd3faea07a38ca4e5941fefb66095fbfcc6d549afa7a2319 WatchSource:0}: Error finding container 6346f3f89d297fa9dd3faea07a38ca4e5941fefb66095fbfcc6d549afa7a2319: Status 404 returned error can't find the container with id 6346f3f89d297fa9dd3faea07a38ca4e5941fefb66095fbfcc6d549afa7a2319
Jul 29 18:46:10.994810 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:10.994790    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 18:46:11.234609 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:11.234572    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7720-139837267673568" event={"ID":"94c9b0e9-2292-4d37-82d8-12d0ae9550cb","Type":"ContainerStarted","Data":"6346f3f89d297fa9dd3faea07a38ca4e5941fefb66095fbfcc6d549afa7a2319"}
Jul 29 18:46:12.075569 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:12.075528    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4382133a-f540-40ce-9835-247d27632bb5" path="/var/lib/kubelet/pods/4382133a-f540-40ce-9835-247d27632bb5/volumes"
Jul 29 18:46:12.241177 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:12.241140    2567 generic.go:356] "Generic (PLEG): container finished" podID="94c9b0e9-2292-4d37-82d8-12d0ae9550cb" containerID="d66e7b8ffa082a3df62a8723d43d34fd5787fc2ad2b0a7b7f523a8fe287e30cf" exitCode=0
Jul 29 18:46:12.241600 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:12.241233    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7720-139837267673568" event={"ID":"94c9b0e9-2292-4d37-82d8-12d0ae9550cb","Type":"ContainerDied","Data":"d66e7b8ffa082a3df62a8723d43d34fd5787fc2ad2b0a7b7f523a8fe287e30cf"}
Jul 29 18:46:13.373867 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:13.373839    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7720-139837267673568"
Jul 29 18:46:13.405374 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:13.405340    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7720-139837267673568_94c9b0e9-2292-4d37-82d8-12d0ae9550cb/test-curl-7720-139837267673568/0.log"
Jul 29 18:46:13.426911 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:13.426878    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7720-139837267673568"]
Jul 29 18:46:13.430479 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:13.430456    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7720-139837267673568"]
Jul 29 18:46:13.511789 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:13.511675    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns6dk\" (UniqueName: \"kubernetes.io/projected/94c9b0e9-2292-4d37-82d8-12d0ae9550cb-kube-api-access-ns6dk\") pod \"94c9b0e9-2292-4d37-82d8-12d0ae9550cb\" (UID: \"94c9b0e9-2292-4d37-82d8-12d0ae9550cb\") "
Jul 29 18:46:13.513978 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:13.513952    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94c9b0e9-2292-4d37-82d8-12d0ae9550cb-kube-api-access-ns6dk" (OuterVolumeSpecName: "kube-api-access-ns6dk") pod "94c9b0e9-2292-4d37-82d8-12d0ae9550cb" (UID: "94c9b0e9-2292-4d37-82d8-12d0ae9550cb"). InnerVolumeSpecName "kube-api-access-ns6dk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:46:13.613258 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:13.613210    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns6dk\" (UniqueName: \"kubernetes.io/projected/94c9b0e9-2292-4d37-82d8-12d0ae9550cb-kube-api-access-ns6dk\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:46:14.073465 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:14.073429    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94c9b0e9-2292-4d37-82d8-12d0ae9550cb" path="/var/lib/kubelet/pods/94c9b0e9-2292-4d37-82d8-12d0ae9550cb/volumes"
Jul 29 18:46:14.253255 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:14.253229    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7720-139837267673568"
Jul 29 18:46:14.253453 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:14.253279    2567 scope.go:117] "RemoveContainer" containerID="d66e7b8ffa082a3df62a8723d43d34fd5787fc2ad2b0a7b7f523a8fe287e30cf"
Jul 29 18:46:26.918774 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:26.918735    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:46:42.868779 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.868736    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"]
Jul 29 18:46:42.869268 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.869203    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94c9b0e9-2292-4d37-82d8-12d0ae9550cb" containerName="test-curl-7720-139837267673568"
Jul 29 18:46:42.869268 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.869218    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="94c9b0e9-2292-4d37-82d8-12d0ae9550cb" containerName="test-curl-7720-139837267673568"
Jul 29 18:46:42.869345 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.869284    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="94c9b0e9-2292-4d37-82d8-12d0ae9550cb" containerName="test-curl-7720-139837267673568"
Jul 29 18:46:42.872651 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.872632    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:42.875308 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.875284    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-b0fdf2-openshift-default-dockercfg-2lw6s\""
Jul 29 18:46:42.884041 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.884011    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"]
Jul 29 18:46:42.975833 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.975797    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26509f78-c30c-46bb-9478-db1a08bd7435-istio-podinfo\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:42.976128 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.976098    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tl6j\" (UniqueName: \"kubernetes.io/projected/26509f78-c30c-46bb-9478-db1a08bd7435-kube-api-access-4tl6j\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:42.976280 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.976159    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-workload-certs\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:42.976280 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.976194    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-workload-socket\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:42.976280 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.976223    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26509f78-c30c-46bb-9478-db1a08bd7435-istiod-ca-cert\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:42.976280 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.976271    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-istio-data\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:42.976487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.976298    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26509f78-c30c-46bb-9478-db1a08bd7435-istio-token\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:42.976487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.976334    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-credential-socket\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:42.976487 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:42.976422    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-istio-envoy\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.077794 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.077758    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-istio-data\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.077794 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.077798    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26509f78-c30c-46bb-9478-db1a08bd7435-istio-token\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.078130 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.077820    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-credential-socket\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.078130 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.077867    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-istio-envoy\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.078130 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.077902    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26509f78-c30c-46bb-9478-db1a08bd7435-istio-podinfo\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.078130 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.077919    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tl6j\" (UniqueName: \"kubernetes.io/projected/26509f78-c30c-46bb-9478-db1a08bd7435-kube-api-access-4tl6j\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.078130 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.077940    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-workload-certs\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.078130 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.077964    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-workload-socket\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.078130 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.078015    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26509f78-c30c-46bb-9478-db1a08bd7435-istiod-ca-cert\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.078537 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.078289    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-istio-data\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.078537 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.078329    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-credential-socket\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.078537 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.078489    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-workload-socket\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.078705 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.078533    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-workload-certs\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.078761 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.078746    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26509f78-c30c-46bb-9478-db1a08bd7435-istiod-ca-cert\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.080289 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.080264    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-istio-envoy\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.080488 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.080470    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26509f78-c30c-46bb-9478-db1a08bd7435-istio-podinfo\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.087121 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.087093    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26509f78-c30c-46bb-9478-db1a08bd7435-istio-token\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.087243 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.087227    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tl6j\" (UniqueName: \"kubernetes.io/projected/26509f78-c30c-46bb-9478-db1a08bd7435-kube-api-access-4tl6j\") pod \"e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") " pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.184326 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.184232    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:43.328184 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.328157    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"]
Jul 29 18:46:43.329470 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:46:43.329436    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26509f78_c30c_46bb_9478_db1a08bd7435.slice/crio-8b60c88dadf13395b3df487463894bf71aa79575c030577cfcef3bd1e3682876 WatchSource:0}: Error finding container 8b60c88dadf13395b3df487463894bf71aa79575c030577cfcef3bd1e3682876: Status 404 returned error can't find the container with id 8b60c88dadf13395b3df487463894bf71aa79575c030577cfcef3bd1e3682876
Jul 29 18:46:43.331744 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.331708    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:46:43.331882 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.331776    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:46:43.331882 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.331809    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:46:43.410884 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.410848    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd" event={"ID":"26509f78-c30c-46bb-9478-db1a08bd7435","Type":"ContainerStarted","Data":"40d5ab431152c8bcbf042989da2b0b8f78e893f1b2a8f9de11f3b3ba1c7251a1"}
Jul 29 18:46:43.411273 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.410916    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd" event={"ID":"26509f78-c30c-46bb-9478-db1a08bd7435","Type":"ContainerStarted","Data":"8b60c88dadf13395b3df487463894bf71aa79575c030577cfcef3bd1e3682876"}
Jul 29 18:46:43.431341 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:43.431269    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd" podStartSLOduration=1.43124785 podStartE2EDuration="1.43124785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:46:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:46:43.428594683 +0000 UTC m=+3231.776822778" watchObservedRunningTime="2026-07-29 18:46:43.43124785 +0000 UTC m=+3231.779475944"
Jul 29 18:46:44.185368 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:44.185327    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:44.190847 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:44.190819    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:44.416404 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:44.416370    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:44.417295 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:44.417274    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:46:55.415045 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:46:55.415009    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:47:03.520276 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:03.520243    2567 generic.go:356] "Generic (PLEG): container finished" podID="26509f78-c30c-46bb-9478-db1a08bd7435" containerID="40d5ab431152c8bcbf042989da2b0b8f78e893f1b2a8f9de11f3b3ba1c7251a1" exitCode=0
Jul 29 18:47:03.520704 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:03.520302    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd" event={"ID":"26509f78-c30c-46bb-9478-db1a08bd7435","Type":"ContainerDied","Data":"40d5ab431152c8bcbf042989da2b0b8f78e893f1b2a8f9de11f3b3ba1c7251a1"}
Jul 29 18:47:03.520704 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:03.520682    2567 scope.go:117] "RemoveContainer" containerID="40d5ab431152c8bcbf042989da2b0b8f78e893f1b2a8f9de11f3b3ba1c7251a1"
Jul 29 18:47:03.521835 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:03.521802    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:47:03.521906 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:03.521891    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:47:03.521949 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:03.521929    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 29 18:47:04.527201 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:04.527161    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd" event={"ID":"26509f78-c30c-46bb-9478-db1a08bd7435","Type":"ContainerStarted","Data":"0d25552aeada6ce879d7ac1888b79a089ce24ff5d332c191cdc5a26cde8f7b85"}
Jul 29 18:47:05.184925 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:05.184880    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:47:05.185193 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:05.185167    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 29 18:47:05.185250 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:05.185230    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd" podUID="26509f78-c30c-46bb-9478-db1a08bd7435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 29 18:47:06.185345 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:06.185302    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 29 18:47:06.185770 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:06.185368    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd" podUID="26509f78-c30c-46bb-9478-db1a08bd7435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 29 18:47:07.185493 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:07.185449    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 29 18:47:07.185924 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:07.185529    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd" podUID="26509f78-c30c-46bb-9478-db1a08bd7435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 29 18:47:08.185050 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:08.184976    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 29 18:47:08.185275 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:08.185074    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd" podUID="26509f78-c30c-46bb-9478-db1a08bd7435" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 29 18:47:09.188290 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:09.188260    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:47:09.188684 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:09.188594    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:47:09.189328 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:09.189311    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:47:37.709204 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.709167    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"]
Jul 29 18:47:37.713105 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.713089    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.715766 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.715742    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-479e5c\"/\"kube-root-ca.crt\""
Jul 29 18:47:37.717068 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.717044    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-479e5c\"/\"default-dockercfg-b2bj2\""
Jul 29 18:47:37.717191 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.717097    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-479e5c\"/\"ipp-route-479e5c-kserve-self-signed-certs\""
Jul 29 18:47:37.717191 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.717107    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-479e5c\"/\"openshift-service-ca.crt\""
Jul 29 18:47:37.727498 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.727473    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"]
Jul 29 18:47:37.790967 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.790930    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46794584-ef9d-454c-abd0-5d942ac2a7e0-tls-certs\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.791159 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.791012    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-dshm\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.791159 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.791133    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-model-cache\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.791250 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.791168    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-home\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.791250 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.791188    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cggb\" (UniqueName: \"kubernetes.io/projected/46794584-ef9d-454c-abd0-5d942ac2a7e0-kube-api-access-5cggb\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.791321 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.791250    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-tmp-dir\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.892140 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.892103    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46794584-ef9d-454c-abd0-5d942ac2a7e0-tls-certs\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.892351 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.892167    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-dshm\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.892351 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.892226    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-model-cache\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.892351 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.892247    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-home\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.892351 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.892272    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cggb\" (UniqueName: \"kubernetes.io/projected/46794584-ef9d-454c-abd0-5d942ac2a7e0-kube-api-access-5cggb\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.892351 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.892302    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-tmp-dir\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.892699 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.892673    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-model-cache\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.892779 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.892750    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-tmp-dir\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.892841 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.892798    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-home\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.894523 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.894503    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-dshm\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.894701 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.894684    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46794584-ef9d-454c-abd0-5d942ac2a7e0-tls-certs\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:37.905055 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:37.905027    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cggb\" (UniqueName: \"kubernetes.io/projected/46794584-ef9d-454c-abd0-5d942ac2a7e0-kube-api-access-5cggb\") pod \"ipp-route-479e5c-kserve-66d6ff87ff-npdnr\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") " pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:38.022980 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:38.022951    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:38.161560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:38.161515    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"]
Jul 29 18:47:38.162747 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:47:38.162718    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46794584_ef9d_454c_abd0_5d942ac2a7e0.slice/crio-8a2dd171ffe842f7d2264eed70e25c52cc991a3265d0ec4da03a45ddc4f7e482 WatchSource:0}: Error finding container 8a2dd171ffe842f7d2264eed70e25c52cc991a3265d0ec4da03a45ddc4f7e482: Status 404 returned error can't find the container with id 8a2dd171ffe842f7d2264eed70e25c52cc991a3265d0ec4da03a45ddc4f7e482
Jul 29 18:47:38.710867 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:38.710820    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr" event={"ID":"46794584-ef9d-454c-abd0-5d942ac2a7e0","Type":"ContainerStarted","Data":"9fb7a695ae380db4694612653b37c1d26862dda55ad522c99ae2f98cb14ad299"}
Jul 29 18:47:38.711287 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:38.710876    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr" event={"ID":"46794584-ef9d-454c-abd0-5d942ac2a7e0","Type":"ContainerStarted","Data":"8a2dd171ffe842f7d2264eed70e25c52cc991a3265d0ec4da03a45ddc4f7e482"}
Jul 29 18:47:38.736353 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:38.736295    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr" podStartSLOduration=1.736274316 podStartE2EDuration="1.736274316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:47:38.735822587 +0000 UTC m=+3287.084050681" watchObservedRunningTime="2026-07-29 18:47:38.736274316 +0000 UTC m=+3287.084502407"
Jul 29 18:47:41.330882 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:41.330845    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:47:48.023191 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:48.023144    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:48.023714 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:48.023214    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:48.035782 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:48.035754    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:47:48.773350 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:47:48.773323    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:48:08.552974 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:48:08.552936    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:48:30.626126 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:48:30.626039    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:48:50.417460 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:48:50.417421    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:49:09.621029 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:09.620979    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:49:15.726312 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:15.726276    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"]
Jul 29 18:49:21.817317 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:21.817283    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:49:30.745399 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:30.745334    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr" podUID="46794584-ef9d-454c-abd0-5d942ac2a7e0" containerName="main" containerID="cri-o://9fb7a695ae380db4694612653b37c1d26862dda55ad522c99ae2f98cb14ad299" gracePeriod=45
Jul 29 18:49:30.993758 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:30.993732    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:49:31.108129 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.108041    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-home\") pod \"46794584-ef9d-454c-abd0-5d942ac2a7e0\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") "
Jul 29 18:49:31.108129 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.108077    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cggb\" (UniqueName: \"kubernetes.io/projected/46794584-ef9d-454c-abd0-5d942ac2a7e0-kube-api-access-5cggb\") pod \"46794584-ef9d-454c-abd0-5d942ac2a7e0\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") "
Jul 29 18:49:31.108129 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.108123    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-tmp-dir\") pod \"46794584-ef9d-454c-abd0-5d942ac2a7e0\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") "
Jul 29 18:49:31.108415 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.108147    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-model-cache\") pod \"46794584-ef9d-454c-abd0-5d942ac2a7e0\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") "
Jul 29 18:49:31.108415 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.108180    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-dshm\") pod \"46794584-ef9d-454c-abd0-5d942ac2a7e0\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") "
Jul 29 18:49:31.108415 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.108280    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46794584-ef9d-454c-abd0-5d942ac2a7e0-tls-certs\") pod \"46794584-ef9d-454c-abd0-5d942ac2a7e0\" (UID: \"46794584-ef9d-454c-abd0-5d942ac2a7e0\") "
Jul 29 18:49:31.108415 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.108337    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-home" (OuterVolumeSpecName: "home") pod "46794584-ef9d-454c-abd0-5d942ac2a7e0" (UID: "46794584-ef9d-454c-abd0-5d942ac2a7e0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:49:31.108616 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.108419    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "46794584-ef9d-454c-abd0-5d942ac2a7e0" (UID: "46794584-ef9d-454c-abd0-5d942ac2a7e0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:49:31.108616 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.108436    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-model-cache" (OuterVolumeSpecName: "model-cache") pod "46794584-ef9d-454c-abd0-5d942ac2a7e0" (UID: "46794584-ef9d-454c-abd0-5d942ac2a7e0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:49:31.108709 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.108620    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-home\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:49:31.108709 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.108637    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-tmp-dir\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:49:31.108709 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.108653    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-model-cache\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:49:31.110281 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.110255    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46794584-ef9d-454c-abd0-5d942ac2a7e0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "46794584-ef9d-454c-abd0-5d942ac2a7e0" (UID: "46794584-ef9d-454c-abd0-5d942ac2a7e0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 18:49:31.110377 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.110340    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-dshm" (OuterVolumeSpecName: "dshm") pod "46794584-ef9d-454c-abd0-5d942ac2a7e0" (UID: "46794584-ef9d-454c-abd0-5d942ac2a7e0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:49:31.110377 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.110371    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46794584-ef9d-454c-abd0-5d942ac2a7e0-kube-api-access-5cggb" (OuterVolumeSpecName: "kube-api-access-5cggb") pod "46794584-ef9d-454c-abd0-5d942ac2a7e0" (UID: "46794584-ef9d-454c-abd0-5d942ac2a7e0"). InnerVolumeSpecName "kube-api-access-5cggb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:49:31.209083 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.209048    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cggb\" (UniqueName: \"kubernetes.io/projected/46794584-ef9d-454c-abd0-5d942ac2a7e0-kube-api-access-5cggb\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:49:31.209083 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.209078    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46794584-ef9d-454c-abd0-5d942ac2a7e0-dshm\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:49:31.209083 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.209090    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46794584-ef9d-454c-abd0-5d942ac2a7e0-tls-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:49:31.307905 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.307870    2567 generic.go:356] "Generic (PLEG): container finished" podID="46794584-ef9d-454c-abd0-5d942ac2a7e0" containerID="9fb7a695ae380db4694612653b37c1d26862dda55ad522c99ae2f98cb14ad299" exitCode=0
Jul 29 18:49:31.308122 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.307919    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"
Jul 29 18:49:31.308122 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.307956    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr" event={"ID":"46794584-ef9d-454c-abd0-5d942ac2a7e0","Type":"ContainerDied","Data":"9fb7a695ae380db4694612653b37c1d26862dda55ad522c99ae2f98cb14ad299"}
Jul 29 18:49:31.308122 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.308019    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr" event={"ID":"46794584-ef9d-454c-abd0-5d942ac2a7e0","Type":"ContainerDied","Data":"8a2dd171ffe842f7d2264eed70e25c52cc991a3265d0ec4da03a45ddc4f7e482"}
Jul 29 18:49:31.308122 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.308042    2567 scope.go:117] "RemoveContainer" containerID="9fb7a695ae380db4694612653b37c1d26862dda55ad522c99ae2f98cb14ad299"
Jul 29 18:49:31.318148 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.318129    2567 scope.go:117] "RemoveContainer" containerID="9fb7a695ae380db4694612653b37c1d26862dda55ad522c99ae2f98cb14ad299"
Jul 29 18:49:31.318421 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:49:31.318400    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fb7a695ae380db4694612653b37c1d26862dda55ad522c99ae2f98cb14ad299\": container with ID starting with 9fb7a695ae380db4694612653b37c1d26862dda55ad522c99ae2f98cb14ad299 not found: ID does not exist" containerID="9fb7a695ae380db4694612653b37c1d26862dda55ad522c99ae2f98cb14ad299"
Jul 29 18:49:31.318467 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.318430    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fb7a695ae380db4694612653b37c1d26862dda55ad522c99ae2f98cb14ad299"} err="failed to get container status \"9fb7a695ae380db4694612653b37c1d26862dda55ad522c99ae2f98cb14ad299\": rpc error: code = NotFound desc = could not find container \"9fb7a695ae380db4694612653b37c1d26862dda55ad522c99ae2f98cb14ad299\": container with ID starting with 9fb7a695ae380db4694612653b37c1d26862dda55ad522c99ae2f98cb14ad299 not found: ID does not exist"
Jul 29 18:49:31.330058 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.330031    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"]
Jul 29 18:49:31.334413 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:31.334389    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-479e5c/ipp-route-479e5c-kserve-66d6ff87ff-npdnr"]
Jul 29 18:49:32.073617 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:49:32.073562    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46794584-ef9d-454c-abd0-5d942ac2a7e0" path="/var/lib/kubelet/pods/46794584-ef9d-454c-abd0-5d942ac2a7e0/volumes"
Jul 29 18:50:12.017893 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:12.017855    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:50:16.170522 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:16.170482    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"]
Jul 29 18:50:16.170922 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:16.170715    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd" podUID="26509f78-c30c-46bb-9478-db1a08bd7435" containerName="istio-proxy" containerID="cri-o://0d25552aeada6ce879d7ac1888b79a089ce24ff5d332c191cdc5a26cde8f7b85" gracePeriod=30
Jul 29 18:50:21.431002 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.430961    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:50:21.553075 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553034    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26509f78-c30c-46bb-9478-db1a08bd7435-istiod-ca-cert\") pod \"26509f78-c30c-46bb-9478-db1a08bd7435\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") "
Jul 29 18:50:21.553287 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553091    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-workload-socket\") pod \"26509f78-c30c-46bb-9478-db1a08bd7435\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") "
Jul 29 18:50:21.553287 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553117    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-istio-data\") pod \"26509f78-c30c-46bb-9478-db1a08bd7435\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") "
Jul 29 18:50:21.553287 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553149    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26509f78-c30c-46bb-9478-db1a08bd7435-istio-token\") pod \"26509f78-c30c-46bb-9478-db1a08bd7435\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") "
Jul 29 18:50:21.553287 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553183    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26509f78-c30c-46bb-9478-db1a08bd7435-istio-podinfo\") pod \"26509f78-c30c-46bb-9478-db1a08bd7435\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") "
Jul 29 18:50:21.553287 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553237    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-istio-envoy\") pod \"26509f78-c30c-46bb-9478-db1a08bd7435\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") "
Jul 29 18:50:21.553560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553318    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-credential-socket\") pod \"26509f78-c30c-46bb-9478-db1a08bd7435\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") "
Jul 29 18:50:21.553560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553353    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-workload-certs\") pod \"26509f78-c30c-46bb-9478-db1a08bd7435\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") "
Jul 29 18:50:21.553560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553412    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tl6j\" (UniqueName: \"kubernetes.io/projected/26509f78-c30c-46bb-9478-db1a08bd7435-kube-api-access-4tl6j\") pod \"26509f78-c30c-46bb-9478-db1a08bd7435\" (UID: \"26509f78-c30c-46bb-9478-db1a08bd7435\") "
Jul 29 18:50:21.553560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553419    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "26509f78-c30c-46bb-9478-db1a08bd7435" (UID: "26509f78-c30c-46bb-9478-db1a08bd7435"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:50:21.553560 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553491    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26509f78-c30c-46bb-9478-db1a08bd7435-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "26509f78-c30c-46bb-9478-db1a08bd7435" (UID: "26509f78-c30c-46bb-9478-db1a08bd7435"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:50:21.553838 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553656    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "26509f78-c30c-46bb-9478-db1a08bd7435" (UID: "26509f78-c30c-46bb-9478-db1a08bd7435"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:50:21.553838 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553829    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-credential-socket\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:21.553955 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553851    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26509f78-c30c-46bb-9478-db1a08bd7435-istiod-ca-cert\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:21.553955 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553864    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-workload-socket\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:21.553955 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.553829    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "26509f78-c30c-46bb-9478-db1a08bd7435" (UID: "26509f78-c30c-46bb-9478-db1a08bd7435"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:50:21.554296 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.554269    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-istio-data" (OuterVolumeSpecName: "istio-data") pod "26509f78-c30c-46bb-9478-db1a08bd7435" (UID: "26509f78-c30c-46bb-9478-db1a08bd7435"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:50:21.555558 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.555528    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "26509f78-c30c-46bb-9478-db1a08bd7435" (UID: "26509f78-c30c-46bb-9478-db1a08bd7435"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:50:21.555673 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.555643    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26509f78-c30c-46bb-9478-db1a08bd7435-kube-api-access-4tl6j" (OuterVolumeSpecName: "kube-api-access-4tl6j") pod "26509f78-c30c-46bb-9478-db1a08bd7435" (UID: "26509f78-c30c-46bb-9478-db1a08bd7435"). InnerVolumeSpecName "kube-api-access-4tl6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:50:21.555889 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.555872    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26509f78-c30c-46bb-9478-db1a08bd7435-istio-token" (OuterVolumeSpecName: "istio-token") pod "26509f78-c30c-46bb-9478-db1a08bd7435" (UID: "26509f78-c30c-46bb-9478-db1a08bd7435"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:50:21.555951 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.555893    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26509f78-c30c-46bb-9478-db1a08bd7435-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "26509f78-c30c-46bb-9478-db1a08bd7435" (UID: "26509f78-c30c-46bb-9478-db1a08bd7435"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 18:50:21.570409 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.570379    2567 generic.go:356] "Generic (PLEG): container finished" podID="26509f78-c30c-46bb-9478-db1a08bd7435" containerID="0d25552aeada6ce879d7ac1888b79a089ce24ff5d332c191cdc5a26cde8f7b85" exitCode=0
Jul 29 18:50:21.570564 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.570437    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"
Jul 29 18:50:21.570564 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.570457    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd" event={"ID":"26509f78-c30c-46bb-9478-db1a08bd7435","Type":"ContainerDied","Data":"0d25552aeada6ce879d7ac1888b79a089ce24ff5d332c191cdc5a26cde8f7b85"}
Jul 29 18:50:21.570564 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.570539    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd" event={"ID":"26509f78-c30c-46bb-9478-db1a08bd7435","Type":"ContainerDied","Data":"8b60c88dadf13395b3df487463894bf71aa79575c030577cfcef3bd1e3682876"}
Jul 29 18:50:21.570734 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.570561    2567 scope.go:117] "RemoveContainer" containerID="0d25552aeada6ce879d7ac1888b79a089ce24ff5d332c191cdc5a26cde8f7b85"
Jul 29 18:50:21.580275 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.580258    2567 scope.go:117] "RemoveContainer" containerID="40d5ab431152c8bcbf042989da2b0b8f78e893f1b2a8f9de11f3b3ba1c7251a1"
Jul 29 18:50:21.588700 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.588682    2567 scope.go:117] "RemoveContainer" containerID="0d25552aeada6ce879d7ac1888b79a089ce24ff5d332c191cdc5a26cde8f7b85"
Jul 29 18:50:21.588949 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:50:21.588929    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d25552aeada6ce879d7ac1888b79a089ce24ff5d332c191cdc5a26cde8f7b85\": container with ID starting with 0d25552aeada6ce879d7ac1888b79a089ce24ff5d332c191cdc5a26cde8f7b85 not found: ID does not exist" containerID="0d25552aeada6ce879d7ac1888b79a089ce24ff5d332c191cdc5a26cde8f7b85"
Jul 29 18:50:21.589017 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.588960    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d25552aeada6ce879d7ac1888b79a089ce24ff5d332c191cdc5a26cde8f7b85"} err="failed to get container status \"0d25552aeada6ce879d7ac1888b79a089ce24ff5d332c191cdc5a26cde8f7b85\": rpc error: code = NotFound desc = could not find container \"0d25552aeada6ce879d7ac1888b79a089ce24ff5d332c191cdc5a26cde8f7b85\": container with ID starting with 0d25552aeada6ce879d7ac1888b79a089ce24ff5d332c191cdc5a26cde8f7b85 not found: ID does not exist"
Jul 29 18:50:21.589017 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.588978    2567 scope.go:117] "RemoveContainer" containerID="40d5ab431152c8bcbf042989da2b0b8f78e893f1b2a8f9de11f3b3ba1c7251a1"
Jul 29 18:50:21.589224 ip-10-0-138-0 kubenswrapper[2567]: E0729 18:50:21.589207    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40d5ab431152c8bcbf042989da2b0b8f78e893f1b2a8f9de11f3b3ba1c7251a1\": container with ID starting with 40d5ab431152c8bcbf042989da2b0b8f78e893f1b2a8f9de11f3b3ba1c7251a1 not found: ID does not exist" containerID="40d5ab431152c8bcbf042989da2b0b8f78e893f1b2a8f9de11f3b3ba1c7251a1"
Jul 29 18:50:21.589275 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.589230    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40d5ab431152c8bcbf042989da2b0b8f78e893f1b2a8f9de11f3b3ba1c7251a1"} err="failed to get container status \"40d5ab431152c8bcbf042989da2b0b8f78e893f1b2a8f9de11f3b3ba1c7251a1\": rpc error: code = NotFound desc = could not find container \"40d5ab431152c8bcbf042989da2b0b8f78e893f1b2a8f9de11f3b3ba1c7251a1\": container with ID starting with 40d5ab431152c8bcbf042989da2b0b8f78e893f1b2a8f9de11f3b3ba1c7251a1 not found: ID does not exist"
Jul 29 18:50:21.592844 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.592820    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"]
Jul 29 18:50:21.596804 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.596782    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-b0fdf2-openshift-default-6cb6bfcdd8-ld6gd"]
Jul 29 18:50:21.654679 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.654640    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-istio-data\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:21.654679 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.654672    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26509f78-c30c-46bb-9478-db1a08bd7435-istio-token\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:21.654679 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.654681    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26509f78-c30c-46bb-9478-db1a08bd7435-istio-podinfo\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:21.654679 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.654689    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-istio-envoy\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:21.654951 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.654697    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26509f78-c30c-46bb-9478-db1a08bd7435-workload-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:21.654951 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:21.654705    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tl6j\" (UniqueName: \"kubernetes.io/projected/26509f78-c30c-46bb-9478-db1a08bd7435-kube-api-access-4tl6j\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:22.074267 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:22.074231    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26509f78-c30c-46bb-9478-db1a08bd7435" path="/var/lib/kubelet/pods/26509f78-c30c-46bb-9478-db1a08bd7435/volumes"
Jul 29 18:50:30.315236 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:30.315199    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:50:47.621631 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:47.621591    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dxf2z"]
Jul 29 18:50:51.533575 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:51.533526    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"]
Jul 29 18:50:51.533976 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:51.533752    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc" podUID="028db522-2d5e-42e1-873e-adb125b9a4ea" containerName="istio-proxy" containerID="cri-o://15acd420f0dfd369a87a8e60f8a5515b05cd8b3dabd57a3c763bd0afa51e90d4" gracePeriod=30
Jul 29 18:50:52.184610 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:52.184576    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b48f889d4-xgbrl_90beaa21-a7fc-43da-b820-6ee556f31441/authorino/0.log"
Jul 29 18:50:53.493193 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:53.493156    2567 patch_prober.go:28] interesting pod/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 18:50:53.493584 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:53.493211    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc" podUID="028db522-2d5e-42e1-873e-adb125b9a4ea" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 18:50:56.756656 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.756622    2567 generic.go:356] "Generic (PLEG): container finished" podID="028db522-2d5e-42e1-873e-adb125b9a4ea" containerID="15acd420f0dfd369a87a8e60f8a5515b05cd8b3dabd57a3c763bd0afa51e90d4" exitCode=0
Jul 29 18:50:56.757063 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.756696    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc" event={"ID":"028db522-2d5e-42e1-873e-adb125b9a4ea","Type":"ContainerDied","Data":"15acd420f0dfd369a87a8e60f8a5515b05cd8b3dabd57a3c763bd0afa51e90d4"}
Jul 29 18:50:56.757063 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.756774    2567 scope.go:117] "RemoveContainer" containerID="b28d012ee5a6b98c273147b33dded7fe1242b9d3cc9fdd561353c179db35801e"
Jul 29 18:50:56.790628 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.790603    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:50:56.876562 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.876478    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-token\") pod \"028db522-2d5e-42e1-873e-adb125b9a4ea\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") "
Jul 29 18:50:56.876562 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.876514    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-envoy\") pod \"028db522-2d5e-42e1-873e-adb125b9a4ea\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") "
Jul 29 18:50:56.876562 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.876562    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-podinfo\") pod \"028db522-2d5e-42e1-873e-adb125b9a4ea\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") "
Jul 29 18:50:56.876852 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.876601    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/028db522-2d5e-42e1-873e-adb125b9a4ea-istiod-ca-cert\") pod \"028db522-2d5e-42e1-873e-adb125b9a4ea\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") "
Jul 29 18:50:56.876852 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.876626    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-credential-socket\") pod \"028db522-2d5e-42e1-873e-adb125b9a4ea\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") "
Jul 29 18:50:56.876852 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.876659    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-data\") pod \"028db522-2d5e-42e1-873e-adb125b9a4ea\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") "
Jul 29 18:50:56.876852 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.876731    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-workload-certs\") pod \"028db522-2d5e-42e1-873e-adb125b9a4ea\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") "
Jul 29 18:50:56.876852 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.876768    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2tht\" (UniqueName: \"kubernetes.io/projected/028db522-2d5e-42e1-873e-adb125b9a4ea-kube-api-access-l2tht\") pod \"028db522-2d5e-42e1-873e-adb125b9a4ea\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") "
Jul 29 18:50:56.876852 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.876791    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-workload-socket\") pod \"028db522-2d5e-42e1-873e-adb125b9a4ea\" (UID: \"028db522-2d5e-42e1-873e-adb125b9a4ea\") "
Jul 29 18:50:56.877192 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.876948    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "028db522-2d5e-42e1-873e-adb125b9a4ea" (UID: "028db522-2d5e-42e1-873e-adb125b9a4ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:50:56.877192 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.877054    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/028db522-2d5e-42e1-873e-adb125b9a4ea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "028db522-2d5e-42e1-873e-adb125b9a4ea" (UID: "028db522-2d5e-42e1-873e-adb125b9a4ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:50:56.877192 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.877166    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/028db522-2d5e-42e1-873e-adb125b9a4ea-istiod-ca-cert\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:56.877192 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.877184    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-credential-socket\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:56.877407 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.877192    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "028db522-2d5e-42e1-873e-adb125b9a4ea" (UID: "028db522-2d5e-42e1-873e-adb125b9a4ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:50:56.877407 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.877300    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "028db522-2d5e-42e1-873e-adb125b9a4ea" (UID: "028db522-2d5e-42e1-873e-adb125b9a4ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:50:56.877590 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.877558    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-data" (OuterVolumeSpecName: "istio-data") pod "028db522-2d5e-42e1-873e-adb125b9a4ea" (UID: "028db522-2d5e-42e1-873e-adb125b9a4ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:50:56.878862 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.878834    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "028db522-2d5e-42e1-873e-adb125b9a4ea" (UID: "028db522-2d5e-42e1-873e-adb125b9a4ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 18:50:56.878951 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.878837    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "028db522-2d5e-42e1-873e-adb125b9a4ea" (UID: "028db522-2d5e-42e1-873e-adb125b9a4ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:50:56.879039 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.878939    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "028db522-2d5e-42e1-873e-adb125b9a4ea" (UID: "028db522-2d5e-42e1-873e-adb125b9a4ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:50:56.879083 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.879045    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/028db522-2d5e-42e1-873e-adb125b9a4ea-kube-api-access-l2tht" (OuterVolumeSpecName: "kube-api-access-l2tht") pod "028db522-2d5e-42e1-873e-adb125b9a4ea" (UID: "028db522-2d5e-42e1-873e-adb125b9a4ea"). InnerVolumeSpecName "kube-api-access-l2tht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:50:56.978557 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.978521    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-token\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:56.978557 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.978551    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-envoy\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:56.978557 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.978560    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-podinfo\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:56.978557 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.978569    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-istio-data\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:56.978823 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.978579    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-workload-certs\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:56.978823 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.978588    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2tht\" (UniqueName: \"kubernetes.io/projected/028db522-2d5e-42e1-873e-adb125b9a4ea-kube-api-access-l2tht\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:56.978823 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:56.978597    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/028db522-2d5e-42e1-873e-adb125b9a4ea-workload-socket\") on node \"ip-10-0-138-0.ec2.internal\" DevicePath \"\""
Jul 29 18:50:57.763621 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:57.763587    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc" event={"ID":"028db522-2d5e-42e1-873e-adb125b9a4ea","Type":"ContainerDied","Data":"335f448451959b45d45ba7bdf569ca3facf0b6b8fcd504a0eab625ee5c1af111"}
Jul 29 18:50:57.764111 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:57.763642    2567 scope.go:117] "RemoveContainer" containerID="15acd420f0dfd369a87a8e60f8a5515b05cd8b3dabd57a3c763bd0afa51e90d4"
Jul 29 18:50:57.764111 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:57.763599    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"
Jul 29 18:50:57.787116 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:57.787087    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"]
Jul 29 18:50:57.791150 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:57.791123    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-f9520e-openshift-default-b86c45688-xbrwc"]
Jul 29 18:50:57.960522 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:57.960495    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml_04f668b2-4cdb-4c34-9519-743fd8102804/copy-manifests/0.log"
Jul 29 18:50:57.966399 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:57.966378    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml_04f668b2-4cdb-4c34-9519-743fd8102804/manager/0.log"
Jul 29 18:50:58.073803 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:58.073722    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="028db522-2d5e-42e1-873e-adb125b9a4ea" path="/var/lib/kubelet/pods/028db522-2d5e-42e1-873e-adb125b9a4ea/volumes"
Jul 29 18:50:59.634978 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:59.634947    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc_553b34ee-747c-41f8-8858-f2023e99d400/util/0.log"
Jul 29 18:50:59.640526 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:59.640502    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc_553b34ee-747c-41f8-8858-f2023e99d400/pull/0.log"
Jul 29 18:50:59.645564 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:59.645546    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc_553b34ee-747c-41f8-8858-f2023e99d400/extract/0.log"
Jul 29 18:50:59.753278 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:59.753246    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l_ff48fc0e-864b-49e9-b585-43c56255c49b/util/0.log"
Jul 29 18:50:59.758603 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:59.758583    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l_ff48fc0e-864b-49e9-b585-43c56255c49b/pull/0.log"
Jul 29 18:50:59.763691 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:59.763672    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l_ff48fc0e-864b-49e9-b585-43c56255c49b/extract/0.log"
Jul 29 18:50:59.872761 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:59.872729    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn_5baa1188-cee1-430c-a28e-1aa54be9f162/util/0.log"
Jul 29 18:50:59.878263 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:59.878233    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn_5baa1188-cee1-430c-a28e-1aa54be9f162/pull/0.log"
Jul 29 18:50:59.883280 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:59.883257    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn_5baa1188-cee1-430c-a28e-1aa54be9f162/extract/0.log"
Jul 29 18:50:59.992083 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:59.992052    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9_4c12d3af-60a3-4eec-b668-ade3c3817d29/util/0.log"
Jul 29 18:50:59.997798 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:50:59.997773    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9_4c12d3af-60a3-4eec-b668-ade3c3817d29/pull/0.log"
Jul 29 18:51:00.003239 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:00.003215    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9_4c12d3af-60a3-4eec-b668-ade3c3817d29/extract/0.log"
Jul 29 18:51:00.120659 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:00.120620    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b48f889d4-xgbrl_90beaa21-a7fc-43da-b820-6ee556f31441/authorino/0.log"
Jul 29 18:51:00.232088 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:00.232045    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nbtn6_ce866513-f321-4883-b84f-ed98c04163e4/manager/0.log"
Jul 29 18:51:00.338776 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:00.338674    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-86vqr_adf95a2e-df33-4ca8-ab3e-d8db3756876e/manager/0.log"
Jul 29 18:51:00.562642 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:00.562603    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5rq96_00692e16-0f8f-4cd7-9cb6-a907f7e279e0/registry-server/0.log"
Jul 29 18:51:00.775294 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:00.775265    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dxf2z_922d68f1-65cc-4def-857a-b2c7fe3dae7e/limitador/0.log"
Jul 29 18:51:01.226601 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:01.226485    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v_6d52d534-163f-4912-8c23-1cae4aa6f65f/istio-proxy/0.log"
Jul 29 18:51:01.674477 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:01.674440    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-7tdnw_3b6fc28e-85e4-4c46-accb-51d1b30e3d03/istio-proxy/1.log"
Jul 29 18:51:02.011586 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:02.011553    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-546cd49bb7-sv6m9_8ac97ee1-977a-4117-a1c0-2c3212ca50cf/router/0.log"
Jul 29 18:51:02.338123 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:02.338018    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-rzpqk_f1b1e45c-ee75-4e48-a462-4db3b556e5b8/main/0.log"
Jul 29 18:51:02.871975 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:02.871942    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-zlqkq_8ca3d0a2-9768-447e-91af-030a1023097c/main/0.log"
Jul 29 18:51:10.538242 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:10.538204    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d8t56_71dd6af3-71f3-4859-af35-a7174b3b3fea/global-pull-secret-syncer/0.log"
Jul 29 18:51:10.711100 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:10.711065    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t5k5f_a2902694-36ec-4862-b312-619dc1ca027e/konnectivity-agent/0.log"
Jul 29 18:51:10.760086 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:10.760031    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-0.ec2.internal_9761bdc563be04bad0254b4a24289200/haproxy/0.log"
Jul 29 18:51:15.445802 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:15.445766    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc_553b34ee-747c-41f8-8858-f2023e99d400/extract/0.log"
Jul 29 18:51:15.480059 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:15.480026    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc_553b34ee-747c-41f8-8858-f2023e99d400/util/0.log"
Jul 29 18:51:15.501452 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:15.501406    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759br5vc_553b34ee-747c-41f8-8858-f2023e99d400/pull/0.log"
Jul 29 18:51:15.525754 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:15.525721    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l_ff48fc0e-864b-49e9-b585-43c56255c49b/extract/0.log"
Jul 29 18:51:15.544590 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:15.544562    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l_ff48fc0e-864b-49e9-b585-43c56255c49b/util/0.log"
Jul 29 18:51:15.570539 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:15.570497    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bcx6l_ff48fc0e-864b-49e9-b585-43c56255c49b/pull/0.log"
Jul 29 18:51:15.596441 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:15.596408    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn_5baa1188-cee1-430c-a28e-1aa54be9f162/extract/0.log"
Jul 29 18:51:15.623100 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:15.623074    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn_5baa1188-cee1-430c-a28e-1aa54be9f162/util/0.log"
Jul 29 18:51:15.643589 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:15.643565    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ltggn_5baa1188-cee1-430c-a28e-1aa54be9f162/pull/0.log"
Jul 29 18:51:15.668639 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:15.668606    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9_4c12d3af-60a3-4eec-b668-ade3c3817d29/extract/0.log"
Jul 29 18:51:15.691966 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:15.691942    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9_4c12d3af-60a3-4eec-b668-ade3c3817d29/util/0.log"
Jul 29 18:51:15.716870 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:15.716807    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zhvn9_4c12d3af-60a3-4eec-b668-ade3c3817d29/pull/0.log"
Jul 29 18:51:16.373480 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:16.373446    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-b48f889d4-xgbrl_90beaa21-a7fc-43da-b820-6ee556f31441/authorino/0.log"
Jul 29 18:51:16.401492 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:16.401464    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-nbtn6_ce866513-f321-4883-b84f-ed98c04163e4/manager/0.log"
Jul 29 18:51:16.434308 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:16.434280    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-86vqr_adf95a2e-df33-4ca8-ab3e-d8db3756876e/manager/0.log"
Jul 29 18:51:16.535752 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:16.535714    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5rq96_00692e16-0f8f-4cd7-9cb6-a907f7e279e0/registry-server/0.log"
Jul 29 18:51:16.802296 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:16.802261    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dxf2z_922d68f1-65cc-4def-857a-b2c7fe3dae7e/limitador/0.log"
Jul 29 18:51:18.889617 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:18.889587    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gqntt_f2dc72d7-66c3-446f-8feb-9f2a437443c0/node-exporter/0.log"
Jul 29 18:51:18.908119 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:18.908093    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gqntt_f2dc72d7-66c3-446f-8feb-9f2a437443c0/kube-rbac-proxy/0.log"
Jul 29 18:51:18.926851 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:18.926823    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gqntt_f2dc72d7-66c3-446f-8feb-9f2a437443c0/init-textfile/0.log"
Jul 29 18:51:20.672061 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.672023    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"]
Jul 29 18:51:20.672483 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.672354    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26509f78-c30c-46bb-9478-db1a08bd7435" containerName="istio-proxy"
Jul 29 18:51:20.672483 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.672365    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="26509f78-c30c-46bb-9478-db1a08bd7435" containerName="istio-proxy"
Jul 29 18:51:20.672483 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.672372    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46794584-ef9d-454c-abd0-5d942ac2a7e0" containerName="main"
Jul 29 18:51:20.672483 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.672379    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="46794584-ef9d-454c-abd0-5d942ac2a7e0" containerName="main"
Jul 29 18:51:20.672483 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.672391    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="028db522-2d5e-42e1-873e-adb125b9a4ea" containerName="istio-proxy"
Jul 29 18:51:20.672483 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.672397    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="028db522-2d5e-42e1-873e-adb125b9a4ea" containerName="istio-proxy"
Jul 29 18:51:20.672483 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.672406    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="028db522-2d5e-42e1-873e-adb125b9a4ea" containerName="istio-proxy"
Jul 29 18:51:20.672483 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.672412    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="028db522-2d5e-42e1-873e-adb125b9a4ea" containerName="istio-proxy"
Jul 29 18:51:20.672483 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.672467    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="26509f78-c30c-46bb-9478-db1a08bd7435" containerName="istio-proxy"
Jul 29 18:51:20.672483 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.672480    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="028db522-2d5e-42e1-873e-adb125b9a4ea" containerName="istio-proxy"
Jul 29 18:51:20.672899 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.672490    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="028db522-2d5e-42e1-873e-adb125b9a4ea" containerName="istio-proxy"
Jul 29 18:51:20.672899 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.672501    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="46794584-ef9d-454c-abd0-5d942ac2a7e0" containerName="main"
Jul 29 18:51:20.675686 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.675667    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.678111 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.678092    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-569bx\"/\"kube-root-ca.crt\""
Jul 29 18:51:20.679066 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.679049    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-569bx\"/\"openshift-service-ca.crt\""
Jul 29 18:51:20.679161 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.679055    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-569bx\"/\"default-dockercfg-ntx9j\""
Jul 29 18:51:20.683050 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.683030    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"]
Jul 29 18:51:20.785101 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.785069    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-fk6v8_41a7adcc-e20d-4257-a0f2-cc618e8be006/networking-console-plugin/0.log"
Jul 29 18:51:20.788228 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.788207    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ec4b290-697e-48b0-b197-998b46cffc23-lib-modules\") pod \"perf-node-gather-daemonset-k29kz\" (UID: \"8ec4b290-697e-48b0-b197-998b46cffc23\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.788326 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.788238    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8ec4b290-697e-48b0-b197-998b46cffc23-podres\") pod \"perf-node-gather-daemonset-k29kz\" (UID: \"8ec4b290-697e-48b0-b197-998b46cffc23\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.788326 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.788255    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5q5b\" (UniqueName: \"kubernetes.io/projected/8ec4b290-697e-48b0-b197-998b46cffc23-kube-api-access-b5q5b\") pod \"perf-node-gather-daemonset-k29kz\" (UID: \"8ec4b290-697e-48b0-b197-998b46cffc23\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.788411 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.788391    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ec4b290-697e-48b0-b197-998b46cffc23-sys\") pod \"perf-node-gather-daemonset-k29kz\" (UID: \"8ec4b290-697e-48b0-b197-998b46cffc23\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.788451 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.788427    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8ec4b290-697e-48b0-b197-998b46cffc23-proc\") pod \"perf-node-gather-daemonset-k29kz\" (UID: \"8ec4b290-697e-48b0-b197-998b46cffc23\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.889812 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.889781    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ec4b290-697e-48b0-b197-998b46cffc23-sys\") pod \"perf-node-gather-daemonset-k29kz\" (UID: \"8ec4b290-697e-48b0-b197-998b46cffc23\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.890020 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.889822    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8ec4b290-697e-48b0-b197-998b46cffc23-proc\") pod \"perf-node-gather-daemonset-k29kz\" (UID: \"8ec4b290-697e-48b0-b197-998b46cffc23\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.890020 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.889854    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ec4b290-697e-48b0-b197-998b46cffc23-lib-modules\") pod \"perf-node-gather-daemonset-k29kz\" (UID: \"8ec4b290-697e-48b0-b197-998b46cffc23\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.890020 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.889881    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8ec4b290-697e-48b0-b197-998b46cffc23-podres\") pod \"perf-node-gather-daemonset-k29kz\" (UID: \"8ec4b290-697e-48b0-b197-998b46cffc23\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.890020 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.889905    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5q5b\" (UniqueName: \"kubernetes.io/projected/8ec4b290-697e-48b0-b197-998b46cffc23-kube-api-access-b5q5b\") pod \"perf-node-gather-daemonset-k29kz\" (UID: \"8ec4b290-697e-48b0-b197-998b46cffc23\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.890020 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.889920    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ec4b290-697e-48b0-b197-998b46cffc23-sys\") pod \"perf-node-gather-daemonset-k29kz\" (UID: \"8ec4b290-697e-48b0-b197-998b46cffc23\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.890020 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.889925    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8ec4b290-697e-48b0-b197-998b46cffc23-proc\") pod \"perf-node-gather-daemonset-k29kz\" (UID: \"8ec4b290-697e-48b0-b197-998b46cffc23\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.890241 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.890045    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8ec4b290-697e-48b0-b197-998b46cffc23-podres\") pod \"perf-node-gather-daemonset-k29kz\" (UID: \"8ec4b290-697e-48b0-b197-998b46cffc23\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.890241 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.890050    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ec4b290-697e-48b0-b197-998b46cffc23-lib-modules\") pod \"perf-node-gather-daemonset-k29kz\" (UID: \"8ec4b290-697e-48b0-b197-998b46cffc23\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.897779 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.897757    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5q5b\" (UniqueName: \"kubernetes.io/projected/8ec4b290-697e-48b0-b197-998b46cffc23-kube-api-access-b5q5b\") pod \"perf-node-gather-daemonset-k29kz\" (UID: \"8ec4b290-697e-48b0-b197-998b46cffc23\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:20.986706 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:20.986681    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:21.120161 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:21.120132    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"]
Jul 29 18:51:21.122163 ip-10-0-138-0 kubenswrapper[2567]: W0729 18:51:21.122138    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8ec4b290_697e_48b0_b197_998b46cffc23.slice/crio-9064244d8458fc5157403e908f020c061a508c9e88259580a95b9656f979af8e WatchSource:0}: Error finding container 9064244d8458fc5157403e908f020c061a508c9e88259580a95b9656f979af8e: Status 404 returned error can't find the container with id 9064244d8458fc5157403e908f020c061a508c9e88259580a95b9656f979af8e
Jul 29 18:51:21.889185 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:21.889148    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz" event={"ID":"8ec4b290-697e-48b0-b197-998b46cffc23","Type":"ContainerStarted","Data":"8665b6689d570d000aef799e9ae38892a90986e7b6217f7839b294920302618f"}
Jul 29 18:51:21.889693 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:21.889240    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz" event={"ID":"8ec4b290-697e-48b0-b197-998b46cffc23","Type":"ContainerStarted","Data":"9064244d8458fc5157403e908f020c061a508c9e88259580a95b9656f979af8e"}
Jul 29 18:51:21.889693 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:21.889294    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:21.907774 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:21.907725    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz" podStartSLOduration=1.9077098399999999 podStartE2EDuration="1.90770984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:51:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:51:21.906269869 +0000 UTC m=+3510.254497963" watchObservedRunningTime="2026-07-29 18:51:21.90770984 +0000 UTC m=+3510.255938044"
Jul 29 18:51:23.588986 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:23.588955    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7pxgj_ebdbddd1-189b-45d4-83e8-86c08bd86158/dns/0.log"
Jul 29 18:51:23.610217 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:23.610194    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7pxgj_ebdbddd1-189b-45d4-83e8-86c08bd86158/kube-rbac-proxy/0.log"
Jul 29 18:51:23.747007 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:23.746959    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-89dgp_252bf4d1-9eab-471e-bb97-cdf6a537d8c6/dns-node-resolver/0.log"
Jul 29 18:51:24.385884 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:24.385850    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vq6jk_6941e167-23bc-45b8-bf79-2c038f30311e/node-ca/0.log"
Jul 29 18:51:25.286774 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:25.286747    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v_6d52d534-163f-4912-8c23-1cae4aa6f65f/istio-proxy/0.log"
Jul 29 18:51:25.514679 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:25.514614    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-7tdnw_3b6fc28e-85e4-4c46-accb-51d1b30e3d03/istio-proxy/0.log"
Jul 29 18:51:25.567722 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:25.567611    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-7tdnw_3b6fc28e-85e4-4c46-accb-51d1b30e3d03/istio-proxy/1.log"
Jul 29 18:51:25.651040 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:25.650985    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-546cd49bb7-sv6m9_8ac97ee1-977a-4117-a1c0-2c3212ca50cf/router/0.log"
Jul 29 18:51:26.478072 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:26.478034    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-txj5d_900f8d29-a89b-43bc-937b-d47b4a13fd3e/serve-healthcheck-canary/0.log"
Jul 29 18:51:27.149738 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:27.149710    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xh4qt_db09b9f3-5469-4a8d-bb5c-3bda4626814a/kube-rbac-proxy/0.log"
Jul 29 18:51:27.168831 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:27.168801    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xh4qt_db09b9f3-5469-4a8d-bb5c-3bda4626814a/exporter/0.log"
Jul 29 18:51:27.189084 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:27.189060    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xh4qt_db09b9f3-5469-4a8d-bb5c-3bda4626814a/extractor/0.log"
Jul 29 18:51:27.904452 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:27.904423    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-569bx/perf-node-gather-daemonset-k29kz"
Jul 29 18:51:30.029248 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:30.029215    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml_04f668b2-4cdb-4c34-9519-743fd8102804/manager/0.log"
Jul 29 18:51:30.047465 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:30.047443    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8dd9bf6-s6fml_04f668b2-4cdb-4c34-9519-743fd8102804/copy-manifests/0.log"
Jul 29 18:51:31.484952 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:31.484923    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v_6d52d534-163f-4912-8c23-1cae4aa6f65f/istio-proxy/0.log"
Jul 29 18:51:31.519933 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:31.519906    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8569878f48-sr7ms_3c93dbda-785f-42b8-902a-259bb5e3eb36/manager/0.log"
Jul 29 18:51:31.549636 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:31.549606    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vtbhv_da72fe86-cfec-46b5-a1e0-8864b6c78ca1/openshift-lws-operator/0.log"
Jul 29 18:51:31.692648 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:31.692591    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-7tdnw_3b6fc28e-85e4-4c46-accb-51d1b30e3d03/istio-proxy/0.log"
Jul 29 18:51:31.745653 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:31.745565    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-7tdnw_3b6fc28e-85e4-4c46-accb-51d1b30e3d03/istio-proxy/1.log"
Jul 29 18:51:31.801897 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:31.801867    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-546cd49bb7-sv6m9_8ac97ee1-977a-4117-a1c0-2c3212ca50cf/router/0.log"
Jul 29 18:51:33.241903 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:33.241868    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-pj26v_6d52d534-163f-4912-8c23-1cae4aa6f65f/istio-proxy/0.log"
Jul 29 18:51:33.448909 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:33.448878    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-7tdnw_3b6fc28e-85e4-4c46-accb-51d1b30e3d03/istio-proxy/0.log"
Jul 29 18:51:33.503476 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:33.503383    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-7tdnw_3b6fc28e-85e4-4c46-accb-51d1b30e3d03/istio-proxy/1.log"
Jul 29 18:51:33.563572 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:33.563543    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-546cd49bb7-sv6m9_8ac97ee1-977a-4117-a1c0-2c3212ca50cf/router/0.log"
Jul 29 18:51:36.875735 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:36.875703    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm_6587876a-1047-45f4-bc60-d7b9efa4ff29/kube-storage-version-migrator-operator/1.log"
Jul 29 18:51:36.877253 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:36.877229    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-dh9cm_6587876a-1047-45f4-bc60-d7b9efa4ff29/kube-storage-version-migrator-operator/0.log"
Jul 29 18:51:37.883388 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:37.883357    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6cnvn_31a0018a-f046-4b33-a0e9-ae9cd4a7cec5/kube-multus-additional-cni-plugins/0.log"
Jul 29 18:51:37.903514 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:37.903488    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6cnvn_31a0018a-f046-4b33-a0e9-ae9cd4a7cec5/egress-router-binary-copy/0.log"
Jul 29 18:51:37.921937 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:37.921907    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6cnvn_31a0018a-f046-4b33-a0e9-ae9cd4a7cec5/cni-plugins/0.log"
Jul 29 18:51:37.941954 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:37.941929    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6cnvn_31a0018a-f046-4b33-a0e9-ae9cd4a7cec5/bond-cni-plugin/0.log"
Jul 29 18:51:37.962355 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:37.962324    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6cnvn_31a0018a-f046-4b33-a0e9-ae9cd4a7cec5/routeoverride-cni/0.log"
Jul 29 18:51:37.980635 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:37.980608    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6cnvn_31a0018a-f046-4b33-a0e9-ae9cd4a7cec5/whereabouts-cni-bincopy/0.log"
Jul 29 18:51:38.001669 ip-10-0-138-0 kubenswrapper[2567]: I0729 18:51:38.001644    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6cnvn_31a0018a-f046-4b33-a0e9-ae9cd4a7cec5/whereabouts-cni/0.log"