Jul 28 22:02:53.255018 ip-10-0-134-211 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 22:02:53.255026 ip-10-0-134-211 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 22:02:53.255033 ip-10-0-134-211 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 22:02:53.255305 ip-10-0-134-211 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 22:03:03.489188 ip-10-0-134-211 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 28 22:03:03.489208 ip-10-0-134-211 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 91bf3d9bf0a448e1abff9c8e4494c791 --
Jul 28 22:04:57.509509 ip-10-0-134-211 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 22:04:57.900623 ip-10-0-134-211 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 22:04:57.900623 ip-10-0-134-211 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 22:04:57.900623 ip-10-0-134-211 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 22:04:57.900623 ip-10-0-134-211 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 22:04:57.900623 ip-10-0-134-211 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 22:04:57.901350 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.900702    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 22:04:57.906288 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906269    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 22:04:57.906288 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906286    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 22:04:57.906288 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906291    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906295    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906298    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906301    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906304    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906307    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906309    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906312    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906315    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906318    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906320    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906323    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906325    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906328    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906333    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906336    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906339    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906342    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906346    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906349    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 22:04:57.906390 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906351    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906354    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906356    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906359    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906361    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906364    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906367    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906369    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906372    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906375    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906378    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906380    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906383    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906385    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906388    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906391    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906394    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906398    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906401    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906404    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 22:04:57.906858 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906407    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906410    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906413    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906415    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906418    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906421    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906423    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906426    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906430    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906432    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906435    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906438    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906440    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906443    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906446    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906448    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906451    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906454    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906456    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 22:04:57.907354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906459    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906462    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906465    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906468    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906471    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906473    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906477    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906479    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906483    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906488    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906491    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906493    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906496    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906499    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906501    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906504    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906507    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906509    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906512    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 22:04:57.907819 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906514    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906518    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906520    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906523    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906525    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906528    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906531    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906533    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906536    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906538    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906542    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906547    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906550    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906553    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906556    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906559    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906563    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906566    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.906569    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907300    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 22:04:57.908296 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907309    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907312    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907315    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907319    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907322    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907324    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907327    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907330    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907333    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907336    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907338    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907341    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907343    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907346    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907348    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907351    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907353    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907356    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907359    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907363    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 22:04:57.908774 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907366    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907369    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907371    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907374    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907377    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907380    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907383    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907385    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907388    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907391    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907394    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907397    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907399    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907402    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907405    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907408    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907411    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907413    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907416    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907418    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 22:04:57.909377 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907421    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907423    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907426    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907428    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907431    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907433    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907436    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907439    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907441    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907444    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907446    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907449    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907453    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907456    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907459    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907462    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907465    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907468    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907470    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 22:04:57.910024 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907473    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907476    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907479    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907481    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907484    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907487    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907489    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907492    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907494    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907497    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907499    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907501    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907504    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907506    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907509    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907511    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907513    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907516    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907518    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907521    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 22:04:57.910534 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907523    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907526    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907529    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907531    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907534    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907536    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907539    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907542    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907544    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907548    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907551    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907555    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907558    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907561    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907564    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907567    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907569    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907573    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907577    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 22:04:57.911020 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907983    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907988    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907991    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907994    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.907997    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908000    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908004    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908008    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908011    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908014    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908017    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908019    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908023    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908026    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908028    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908031    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908033    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908036    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908038    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908041    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 22:04:57.911531 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908043    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908046    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908049    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908051    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908054    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908057    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908060    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908062    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908065    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908067    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908070    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908073    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908075    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908077    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908080    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908082    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908085    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908087    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908090    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908092    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 22:04:57.912010 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908095    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908097    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908100    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908102    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908105    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908108    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908110    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908114    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908117    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908119    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908121    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908124    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908127    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908129    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908132    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908134    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908137    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908141    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908144    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 22:04:57.912522 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908147    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908150    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908153    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908156    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908159    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908162    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908164    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908167    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908169    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908171    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908174    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908176    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908179    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908183    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908187    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908189    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908192    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908195    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908197    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908200    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 22:04:57.913029 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908203    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908205    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908208    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908210    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908213    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908215    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908218    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908220    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908223    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908239    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908242    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908244    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908247    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908250    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908253    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908256    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908258    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908261    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908263    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.908266    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 22:04:57.913628 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908335    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908344    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908353    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908360    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908366    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908372    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908377    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908381    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908385    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908388    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908391    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908395    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908398    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908401    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908404    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908407    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908410    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908413    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908417    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908420    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908424    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908427    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908430    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908434    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 22:04:57.914116 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908436    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908440    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908443    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908446    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908449    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908452    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908455    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908458    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908462    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908465    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908468    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908471    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908474    2564 flags.go:64] FLAG: --enable-server="true"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908478    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908482    2564 flags.go:64] FLAG: --event-burst="100"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908485    2564 flags.go:64] FLAG: --event-qps="50"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908491    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908494    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908497    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908501    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908504    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908507    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908509    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908512    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908518    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 22:04:57.914763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908521    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908524    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908527    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908534    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908537    2564 flags.go:64] FLAG: --feature-gates=""
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908541    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908544    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908547    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908550    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908554    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908557    2564 flags.go:64] FLAG: --help="false"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908560    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-134-211.ec2.internal"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908563    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908566    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908569    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908572    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908576    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908579    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908581    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908584    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908587    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908590    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908593    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908597    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 28 22:04:57.915415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908600    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908603    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908606    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908609    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908612    2564 flags.go:64] FLAG: --lock-file=""
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908614    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908617    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908622    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908627    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908630    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908633    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908636    2564 flags.go:64] FLAG: --logging-format="text"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908639    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908643    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908645    2564 flags.go:64] FLAG: --manifest-url=""
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908648    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908653    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908656    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908659    2564 flags.go:64] FLAG: --max-pods="110"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908662    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908665    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908668    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908671    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908674    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908677    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 22:04:57.915998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908680    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908687    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908690    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908693    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908696    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908699    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908706    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908709    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908712    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908715    2564 flags.go:64] FLAG: --port="10250"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908717    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908720    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-060af6bf1d3fb8ed8"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908723    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908726    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908729    2564 flags.go:64] FLAG: --register-node="true"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908733    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908737    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908740    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908743    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908746    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908750    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908753    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908756    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908759    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908762    2564 flags.go:64] FLAG: --runonce="false"
Jul 28 22:04:57.916623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908765    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908768    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908771    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908774    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908777    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908781    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908784    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908787    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908790    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908793    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908796    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908799    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908802    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908806    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908809    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908815    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908818    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908820    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908824    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908826    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908829    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908832    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908837    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908840    2564 flags.go:64] FLAG: --v="2"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908844    2564 flags.go:64] FLAG: --version="false"
Jul 28 22:04:57.917244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908848    2564 flags.go:64] FLAG: --vmodule=""
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908852    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.908855    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910762    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910776    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910780    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910783    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910786    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910789    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910792    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910796    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910800    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910803    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910807    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910810    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910813    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910818    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910822    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910825    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 22:04:57.917890 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910828    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910831    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910834    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910837    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910840    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910842    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910849    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910852    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910855    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910857    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910860    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910863    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910866    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910869    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910871    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910874    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910877    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910883    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910886    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 22:04:57.918384 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910889    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910891    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910894    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910897    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910900    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910902    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910905    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910908    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910910    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910913    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910915    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910918    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910921    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910924    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910926    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910929    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910932    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910934    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910937    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910940    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 22:04:57.918848 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910942    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910945    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910947    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910950    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910953    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910955    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910958    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910961    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910963    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910967    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910971    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910974    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910976    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910979    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910982    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910984    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910987    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910990    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910993    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910996    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 22:04:57.919352 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.910999    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911001    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911004    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911007    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911009    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911012    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911015    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911017    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911021    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911024    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911027    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911031    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911035    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911038    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911040    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911043    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911046    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911048    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911052    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 22:04:57.919841 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911057    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 22:04:57.920399 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911060    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 22:04:57.920399 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911063    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 22:04:57.920399 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911066    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 22:04:57.920399 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.911069    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 22:04:57.920399 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.911801    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 22:04:57.920399 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.918949    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 22:04:57.920399 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.918965    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 22:04:57.920399 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.918985    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 22:04:57.920399 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.918991    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 22:04:57.920399 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919047    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 22:04:57.920399 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919051    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 22:04:57.920399 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919055    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 22:04:57.920399 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919058    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 22:04:57.920399 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919060    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 22:04:57.920399 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919063    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919066    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919069    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919071    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919074    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919077    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919080    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919082    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919085    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919087    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919090    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919092    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919095    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919098    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919100    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919103    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919106    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919108    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919111    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919113    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 22:04:57.920768 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919117    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919119    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919123    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919127    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919131    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919134    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919137    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919140    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919143    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919146    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919149    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919152    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919155    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919157    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919160    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919163    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919165    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919168    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919171    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 22:04:57.921262 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919173    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919176    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919179    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919181    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919184    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919187    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919189    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919192    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919194    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919197    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919199    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919201    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919204    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919207    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919209    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919212    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919215    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919217    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919221    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 22:04:57.921728 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919224    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919255    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919260    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919262    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919286    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919289    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919293    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919295    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919298    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919303    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919307    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919310    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919312    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919316    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919320    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919323    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919326    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919329    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919332    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 22:04:57.922195 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919335    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919338    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919341    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919343    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919346    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919349    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919351    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919354    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919357    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919360    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919362    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919366    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919369    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919372    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919375    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919378    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 22:04:57.922667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919380    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 22:04:57.923058 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.919386    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 22:04:57.923058 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919499    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 22:04:57.923058 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919503    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 22:04:57.923058 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919506    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 22:04:57.923058 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919509    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 22:04:57.923058 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919512    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 22:04:57.923058 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919515    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 22:04:57.923058 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919518    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 22:04:57.923058 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919521    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 22:04:57.923058 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919524    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 22:04:57.923058 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919526    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 22:04:57.923058 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919529    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 22:04:57.923058 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919531    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 22:04:57.923058 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919534    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 22:04:57.923058 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919537    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919539    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919542    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919544    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919547    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919549    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919552    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919554    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919557    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919560    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919562    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919565    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919567    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919570    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919572    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919576    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919578    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919581    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919583    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919586    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 22:04:57.923486 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919588    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919591    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919593    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919596    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919598    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919601    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919603    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919606    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919608    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919610    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919613    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919615    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919618    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919621    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919623    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919626    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919628    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919631    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919633    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919636    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 22:04:57.923965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919638    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919641    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919643    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919646    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919648    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919651    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919653    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919657    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919661    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919664    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919667    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919669    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919672    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919675    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919677    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919680    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919682    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919685    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919687    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919690    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 22:04:57.924463 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919692    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919695    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919698    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919700    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919702    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919706    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919710    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919713    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919716    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919719    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919722    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919724    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919727    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919729    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919732    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919734    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919737    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919739    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919741    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 22:04:57.924942 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919744    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 22:04:57.925405 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919748    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 22:04:57.925405 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919752    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 22:04:57.925405 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919754    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 22:04:57.925405 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919757    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 22:04:57.925405 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919759    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 22:04:57.925405 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:04:57.919762    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 22:04:57.925405 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.919766    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 22:04:57.925405 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.919863    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 22:04:57.925405 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.922155    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 22:04:57.925405 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.923883    2564 server.go:1019] "Starting client certificate rotation"
Jul 28 22:04:57.925405 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.923984    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 22:04:57.925405 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.924009    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 22:04:57.926390 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.926377    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 22:04:57.927710 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.927695    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 22:04:57.937260 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.937243    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 28 22:04:57.941132 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.940546    2564 log.go:25] "Validated CRI v1 image API"
Jul 28 22:04:57.941958 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.941942    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 22:04:57.944023 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.944001    2564 fs.go:135] Filesystem UUIDs: map[1710d7a8-d26a-4edd-8596-5f558236c83c:/dev/nvme0n1p4 3a666bcd-8aa2-466c-9a40-78ba95701029:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 28 22:04:57.944118 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.944022    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 22:04:57.949279 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.949156    2564 manager.go:216] Machine: {Timestamp:2026-07-28 22:04:57.947862452 +0000 UTC m=+0.324049570 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099913 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec276c56bd6b82265beca7313c9a15e8 SystemUUID:ec276c56-bd6b-8226-5bec-a7313c9a15e8 BootID:91bf3d9b-f0a4-48e1-abff-9c8e4494c791 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ac:22:a9:88:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ac:22:a9:88:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:c1:d0:97:ec:52 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 22:04:57.949279 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.949266    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 22:04:57.949438 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.949365    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 22:04:57.952415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.952393    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 22:04:57.952541 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.952418    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-211.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 22:04:57.953109 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.953100    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 22:04:57.953143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.953111    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 22:04:57.953143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.953118    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 22:04:57.953646 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.953636    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 22:04:57.953998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.953983    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 22:04:57.954354 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.954343    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 22:04:57.956162 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.956151    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 22:04:57.956293 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.956283    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 22:04:57.956324 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.956313    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 22:04:57.956356 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.956326    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 22:04:57.956356 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.956348    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 22:04:57.956411 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.956360    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 28 22:04:57.956411 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.956371    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 22:04:57.956753 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.956740    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 22:04:57.956815 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.956764    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 22:04:57.959006 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.958991    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 22:04:57.960937 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.960920    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 22:04:57.961025 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.960959    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 22:04:57.962587 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.962574    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 22:04:57.962587 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.962594    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 22:04:57.962722 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.962603    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 22:04:57.962722 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.962611    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 22:04:57.962722 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.962623    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 22:04:57.962722 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.962632    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 22:04:57.962722 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.962646    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 22:04:57.962722 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.962654    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 22:04:57.962722 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.962664    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 22:04:57.962722 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.962672    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 22:04:57.962722 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.962684    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 22:04:57.962722 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.962694    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 22:04:57.964127 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.964111    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 22:04:57.964127 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.964124    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 22:04:57.965123 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:57.965098    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 22:04:57.965192 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:57.965097    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-211.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 22:04:57.967499 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.967484    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-211.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 22:04:57.967792 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.967779    2564 server.go:1268] "Started kubelet"
Jul 28 22:04:57.967890 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.967864    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 22:04:57.968503 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.968466    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 22:04:57.968580 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.968517    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 22:04:57.968575 ip-10-0-134-211 systemd[1]: Started Kubernetes Kubelet.
Jul 28 22:04:57.970012 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.969994    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 22:04:57.971020 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.971003    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 22:04:57.973163 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:57.973146    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 22:04:57.975538 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:57.974419    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-211.ec2.internal.18c693558e4acc31  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-211.ec2.internal,UID:ip-10-0-134-211.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-211.ec2.internal,},FirstTimestamp:2026-07-28 22:04:57.967750193 +0000 UTC m=+0.343937311,LastTimestamp:2026-07-28 22:04:57.967750193 +0000 UTC m=+0.343937311,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-211.ec2.internal,}"
Jul 28 22:04:57.976926 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.976908    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 22:04:57.977008 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.976923    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 22:04:57.977170 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:57.977140    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-211.ec2.internal\" not found"
Jul 28 22:04:57.978631 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.978067    2564 factory.go:55] Registering systemd factory
Jul 28 22:04:57.978631 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.978103    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 28 22:04:57.978759 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.978743    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 22:04:57.979112 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.978762    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 22:04:57.979669 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.979370    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 22:04:57.979761 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.979724    2564 factory.go:153] Registering CRI-O factory
Jul 28 22:04:57.979761 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.979740    2564 factory.go:223] Registration of the crio container factory successfully
Jul 28 22:04:57.979859 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.979798    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 22:04:57.979859 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.979811    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 22:04:57.979859 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.979821    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 22:04:57.979859 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.979821    2564 factory.go:103] Registering Raw factory
Jul 28 22:04:57.979859 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.979852    2564 manager.go:1196] Started watching for new ooms in manager
Jul 28 22:04:57.980214 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:57.980192    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 22:04:57.980697 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:57.980588    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-211.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 22:04:57.981012 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.980983    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gltzz"
Jul 28 22:04:57.981071 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.981042    2564 manager.go:349] Starting recovery of all containers
Jul 28 22:04:57.989476 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.989381    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gltzz"
Jul 28 22:04:57.992034 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.992016    2564 manager.go:354] Recovery completed
Jul 28 22:04:57.995888 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.995876    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 22:04:57.997502 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.997488    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 22:04:57.997551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.997513    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 22:04:57.997551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.997531    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasSufficientPID"
Jul 28 22:04:57.998067 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.998054    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 22:04:57.998067 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.998065    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 22:04:57.998162 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.998081    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 22:04:57.998162 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.998058    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 22:04:57.998740 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.998727    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 22:04:57.998814 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.998755    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 22:04:57.998814 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.998769    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasSufficientPID"
Jul 28 22:04:57.999747 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.999733    2564 policy_none.go:49] "None policy: Start"
Jul 28 22:04:57.999818 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.999750    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 22:04:57.999818 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:57.999760    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 22:04:57.999926 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:57.999851    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-211.ec2.internal.18c693559010c58c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-211.ec2.internal,UID:ip-10-0-134-211.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-211.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-211.ec2.internal,},FirstTimestamp:2026-07-28 22:04:57.997501836 +0000 UTC m=+0.373688955,LastTimestamp:2026-07-28 22:04:57.997501836 +0000 UTC m=+0.373688955,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-211.ec2.internal,}"
Jul 28 22:04:58.000839 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:58.000828    2564 policy_none.go:47] "Start"
Jul 28 22:04:59.420519 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.420415    2564 manager.go:337] "Starting Device Plugin manager"
Jul 28 22:04:59.420597 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:59.420530    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 22:04:59.420597 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.420544    2564 server.go:87] "Starting device plugin registration server"
Jul 28 22:04:59.421065 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.420880    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 22:04:59.421065 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.420895    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 22:04:59.421065 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.420982    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 22:04:59.421065 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.421054    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 22:04:59.421065 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.421063    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 22:04:59.421538 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:59.421517    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 22:04:59.421627 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:59.421558    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-211.ec2.internal\" not found"
Jul 28 22:04:59.500599 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.500562    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 22:04:59.501644 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.501630    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 22:04:59.501717 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.501662    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 22:04:59.501717 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.501685    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 22:04:59.501717 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:59.501714    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 22:04:59.504113 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.504098    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 22:04:59.521014 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.520997    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 22:04:59.521744 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.521728    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 22:04:59.521810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.521757    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 22:04:59.521810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.521766    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasSufficientPID"
Jul 28 22:04:59.521810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.521786    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.529872 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.529859    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.529931 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:59.529879    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-211.ec2.internal\": node \"ip-10-0-134-211.ec2.internal\" not found"
Jul 28 22:04:59.551723 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:59.551670    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-211.ec2.internal\" not found"
Jul 28 22:04:59.601980 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.601956    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-211.ec2.internal"]
Jul 28 22:04:59.602068 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.602032    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 22:04:59.603434 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.603419    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 22:04:59.603523 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.603448    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 22:04:59.603523 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.603463    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasSufficientPID"
Jul 28 22:04:59.604692 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.604678    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 22:04:59.604803 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.604787    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.604871 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.604815    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 22:04:59.605331 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.605308    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 22:04:59.605331 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.605335    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 22:04:59.605455 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.605350    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasSufficientPID"
Jul 28 22:04:59.605455 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.605316    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 22:04:59.605455 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.605426    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 22:04:59.605455 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.605437    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasSufficientPID"
Jul 28 22:04:59.606650 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.606637    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.606694 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.606660    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 22:04:59.607268 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.607251    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 22:04:59.607340 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.607284    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 22:04:59.607340 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.607300    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeHasSufficientPID"
Jul 28 22:04:59.634447 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:59.634424    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-211.ec2.internal\" not found" node="ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.638981 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:59.638966    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-211.ec2.internal\" not found" node="ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.651797 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:59.651777    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-211.ec2.internal\" not found"
Jul 28 22:04:59.662702 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.662680    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66c77808443d2cca2649284227dd8760-config\") pod \"kube-apiserver-proxy-ip-10-0-134-211.ec2.internal\" (UID: \"66c77808443d2cca2649284227dd8760\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.662779 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.662706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/56bb828bfe5067d560cc889e080056c0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal\" (UID: \"56bb828bfe5067d560cc889e080056c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.662779 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.662722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56bb828bfe5067d560cc889e080056c0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal\" (UID: \"56bb828bfe5067d560cc889e080056c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.752733 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:59.752700    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-211.ec2.internal\" not found"
Jul 28 22:04:59.763162 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.763145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/56bb828bfe5067d560cc889e080056c0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal\" (UID: \"56bb828bfe5067d560cc889e080056c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.763222 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.763167    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56bb828bfe5067d560cc889e080056c0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal\" (UID: \"56bb828bfe5067d560cc889e080056c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.763222 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.763190    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66c77808443d2cca2649284227dd8760-config\") pod \"kube-apiserver-proxy-ip-10-0-134-211.ec2.internal\" (UID: \"66c77808443d2cca2649284227dd8760\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.763291 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.763225    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66c77808443d2cca2649284227dd8760-config\") pod \"kube-apiserver-proxy-ip-10-0-134-211.ec2.internal\" (UID: \"66c77808443d2cca2649284227dd8760\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.763291 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.763251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56bb828bfe5067d560cc889e080056c0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal\" (UID: \"56bb828bfe5067d560cc889e080056c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.763291 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.763251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/56bb828bfe5067d560cc889e080056c0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal\" (UID: \"56bb828bfe5067d560cc889e080056c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.853765 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:59.853711    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-211.ec2.internal\" not found"
Jul 28 22:04:59.937328 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.937303    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.943144 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:04:59.943131    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-211.ec2.internal"
Jul 28 22:04:59.954270 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:04:59.954251    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-211.ec2.internal\" not found"
Jul 28 22:05:00.054958 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:00.054928    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-211.ec2.internal\" not found"
Jul 28 22:05:00.155591 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:00.155524    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-211.ec2.internal\" not found"
Jul 28 22:05:00.197198 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:00.197174    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 22:05:00.255622 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:00.255597    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-211.ec2.internal\" not found"
Jul 28 22:05:00.262178 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:00.262164    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 22:05:00.303307 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:00.303288    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 22:05:00.303778 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:00.303383    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 22:05:00.303778 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:00.303425    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 22:05:00.303778 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:00.303434    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 22:05:00.356282 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:00.356261    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-211.ec2.internal\" not found"
Jul 28 22:05:00.374888 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:00.374863    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 21:59:59 +0000 UTC" deadline="2028-04-13 23:01:28.616799412 +0000 UTC"
Jul 28 22:05:00.374888 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:00.374885    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15000h56m28.241917077s"
Jul 28 22:05:00.456840 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:00.456808    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-211.ec2.internal\" not found"
Jul 28 22:05:00.520739 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:05:00.520712    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56bb828bfe5067d560cc889e080056c0.slice/crio-51c5deffc27aeeb4309368a72467a93d82d9b9ac985d7526aae7c1794492b1eb WatchSource:0}: Error finding container 51c5deffc27aeeb4309368a72467a93d82d9b9ac985d7526aae7c1794492b1eb: Status 404 returned error can't find the container with id 51c5deffc27aeeb4309368a72467a93d82d9b9ac985d7526aae7c1794492b1eb
Jul 28 22:05:00.525367 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:00.525351    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 22:05:00.557915 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:00.557892    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-211.ec2.internal\" not found"
Jul 28 22:05:00.599477 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:00.599455    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 22:05:00.658246 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:00.658224    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-211.ec2.internal"
Jul 28 22:05:00.669363 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:00.669314    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 22:05:00.670362 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:00.670351    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal"
Jul 28 22:05:00.681706 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:00.681687    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 22:05:01.001134 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:05:01.001103    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c77808443d2cca2649284227dd8760.slice/crio-64d0a654abef83de2823385a76a456019d65684d6bcc19deb371a65ab59958fb WatchSource:0}: Error finding container 64d0a654abef83de2823385a76a456019d65684d6bcc19deb371a65ab59958fb: Status 404 returned error can't find the container with id 64d0a654abef83de2823385a76a456019d65684d6bcc19deb371a65ab59958fb
Jul 28 22:05:01.337701 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.337629    2564 apiserver.go:52] "Watching apiserver"
Jul 28 22:05:01.342445 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.342427    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 22:05:01.342802 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.342784    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-nlh6l","openshift-multus/network-metrics-daemon-klvjg","kube-system/konnectivity-agent-6xksh","kube-system/kube-apiserver-proxy-ip-10-0-134-211.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pwp9p","openshift-network-diagnostics/network-check-target-6dm7b","openshift-network-operator/iptables-alerter-2zltv","openshift-ovn-kubernetes/ovnkube-node-srsbn","kube-system/global-pull-secret-syncer-t6bj4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh","openshift-dns/node-resolver-dctt5","openshift-image-registry/node-ca-jf2mm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal","openshift-multus/multus-additional-cni-plugins-gdjkx"]
Jul 28 22:05:01.345420 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.345401    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.347374 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.347355    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dctt5"
Jul 28 22:05:01.347476 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.347435    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 22:05:01.347564 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.347545    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 22:05:01.347622 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.347562    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ldvzz\""
Jul 28 22:05:01.348437 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.348420    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 22:05:01.349027 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.348955    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 22:05:01.349027 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.348975    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 22:05:01.349183 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.349030    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cmsjt\""
Jul 28 22:05:01.349461 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.349446    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6xksh"
Jul 28 22:05:01.351031 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.351012    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xff8v\""
Jul 28 22:05:01.351031 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.351027    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 22:05:01.351154 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.351033    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 22:05:01.351638 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.351624    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.353332 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.353316    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 22:05:01.354676 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.353870    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 22:05:01.354676 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.353930    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 22:05:01.354676 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.353938    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dtfkc\""
Jul 28 22:05:01.354676 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.353964    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 22:05:01.354676 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.354028    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 22:05:01.354676 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.354508    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.356667 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.356647    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 22:05:01.356759 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.356678    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 22:05:01.356759 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.356654    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pwb2t\""
Jul 28 22:05:01.356971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.356956    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:01.357032 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.357016    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:01.358497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.358473    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 22:05:01.359027 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.359012    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:01.359100 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.359063    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:01.361336 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.361310    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.363139 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.363106    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 22:05:01.363238 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.363214    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 22:05:01.363299 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.363216    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jlvdh\""
Jul 28 22:05:01.363353 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.363304    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 22:05:01.363353 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.363320    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 22:05:01.363519 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.363505    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 22:05:01.363564 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.363534    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 22:05:01.363685 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.363668    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:01.363801 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.363775    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:01.366032 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.366015    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.367583 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.367568    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 22:05:01.367672 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.367659    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lbzkj\""
Jul 28 22:05:01.368259 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.368237    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2zltv"
Jul 28 22:05:01.369084 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.369061    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 22:05:01.370492 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370469    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-modprobe-d\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.370600 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370503    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.370600 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370527    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-run-netns\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.370600 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-ovnkube-config\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.370600 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-socket-dir\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.370810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-sysconfig\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.370810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-kubernetes\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.370810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-env-overrides\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.370810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370678    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ff19d47-9db7-4182-b0f8-42dea938de24-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.370810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370697    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jf2mm"
Jul 28 22:05:01.370810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370702    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ff19d47-9db7-4182-b0f8-42dea938de24-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.370810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370728    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-sys\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.370810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-host\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.370810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370768    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:01.370810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370787    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ff19d47-9db7-4182-b0f8-42dea938de24-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370853    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-systemd\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370885    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdbv4\" (UniqueName: \"kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4\") pod \"network-check-target-6dm7b\" (UID: \"92d4ce98-2041-44e4-9acb-9c2e6be92ca0\") " pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370928    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-kubelet\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370956    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-var-lib-openvswitch\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.370983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8dd3e5d4-2a3a-4b2d-bb32-d88de52e28a4-konnectivity-ca\") pod \"konnectivity-agent-6xksh\" (UID: \"8dd3e5d4-2a3a-4b2d-bb32-d88de52e28a4\") " pod="kube-system/konnectivity-agent-6xksh"
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8dd3e5d4-2a3a-4b2d-bb32-d88de52e28a4-agent-certs\") pod \"konnectivity-agent-6xksh\" (UID: \"8dd3e5d4-2a3a-4b2d-bb32-d88de52e28a4\") " pod="kube-system/konnectivity-agent-6xksh"
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371054    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ff19d47-9db7-4182-b0f8-42dea938de24-system-cni-dir\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371077    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmj7t\" (UniqueName: \"kubernetes.io/projected/1ff19d47-9db7-4182-b0f8-42dea938de24-kube-api-access-xmj7t\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371099    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d268c04e-d61a-493f-a465-5a048e4b815f-kubelet-config\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371126    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-sys-fs\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdp5t\" (UniqueName: \"kubernetes.io/projected/6824e8d1-ee18-41fb-aaa6-3a914506cef5-kube-api-access-zdp5t\") pod \"node-resolver-dctt5\" (UID: \"6824e8d1-ee18-41fb-aaa6-3a914506cef5\") " pod="openshift-dns/node-resolver-dctt5"
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371217    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371243    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-run-systemd\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371305    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-etc-openvswitch\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-node-log\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371397    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4bzzl\""
Jul 28 22:05:01.371497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371415    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-lib-modules\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371428    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371452    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4498c\" (UniqueName: \"kubernetes.io/projected/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-kube-api-access-4498c\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371499    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ff19d47-9db7-4182-b0f8-42dea938de24-cni-binary-copy\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-etc-selinux\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371607    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-slash\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-cni-bin\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-device-dir\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-run-ovn\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-log-socket\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371755    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-ovnkube-script-lib\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371781    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6824e8d1-ee18-41fb-aaa6-3a914506cef5-tmp-dir\") pod \"node-resolver-dctt5\" (UID: \"6824e8d1-ee18-41fb-aaa6-3a914506cef5\") " pod="openshift-dns/node-resolver-dctt5"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371814    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-sysctl-d\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371883    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-cni-netd\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371909    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371931    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-var-lib-kubelet\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371957    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-tuned\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.372228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.371982    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqttb\" (UniqueName: \"kubernetes.io/projected/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-kube-api-access-jqttb\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372004    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6824e8d1-ee18-41fb-aaa6-3a914506cef5-hosts-file\") pod \"node-resolver-dctt5\" (UID: \"6824e8d1-ee18-41fb-aaa6-3a914506cef5\") " pod="openshift-dns/node-resolver-dctt5"
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372018    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-sysctl-conf\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372051    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-run\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d268c04e-d61a-493f-a465-5a048e4b815f-dbus\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372097    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-systemd-units\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-run-openvswitch\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-run-ovn-kubernetes\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372237    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-registration-dir\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372262    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mppqk\" (UniqueName: \"kubernetes.io/projected/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-kube-api-access-mppqk\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372277    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ff19d47-9db7-4182-b0f8-42dea938de24-os-release\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372296    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-tmp\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-ovn-node-metrics-cert\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ff19d47-9db7-4182-b0f8-42dea938de24-cnibin\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372554    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372734    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 22:05:01.372885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.372865    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-57bs2\""
Jul 28 22:05:01.373461 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.373062    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 22:05:01.397813 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.397794    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hkrnt"
Jul 28 22:05:01.409185 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.409166    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hkrnt"
Jul 28 22:05:01.461819 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.461791    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 22:05:01.472684 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.472653    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-systemd\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.472815 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.472694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdbv4\" (UniqueName: \"kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4\") pod \"network-check-target-6dm7b\" (UID: \"92d4ce98-2041-44e4-9acb-9c2e6be92ca0\") " pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:01.472815 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.472722    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-kubelet\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.472815 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.472750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0-iptables-alerter-script\") pod \"iptables-alerter-2zltv\" (UID: \"4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0\") " pod="openshift-network-operator/iptables-alerter-2zltv"
Jul 28 22:05:01.472815 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.472778    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-var-lib-openvswitch\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.472815 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.472790    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-systemd\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.473043 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.472804    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-kubelet\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.473043 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.472844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-var-lib-openvswitch\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.473043 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.472926    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8dd3e5d4-2a3a-4b2d-bb32-d88de52e28a4-konnectivity-ca\") pod \"konnectivity-agent-6xksh\" (UID: \"8dd3e5d4-2a3a-4b2d-bb32-d88de52e28a4\") " pod="kube-system/konnectivity-agent-6xksh"
Jul 28 22:05:01.473043 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.472954    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-run-netns\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.473043 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.472978    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-etc-kubernetes\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.473043 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473002    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8dd3e5d4-2a3a-4b2d-bb32-d88de52e28a4-agent-certs\") pod \"konnectivity-agent-6xksh\" (UID: \"8dd3e5d4-2a3a-4b2d-bb32-d88de52e28a4\") " pod="kube-system/konnectivity-agent-6xksh"
Jul 28 22:05:01.473306 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ff19d47-9db7-4182-b0f8-42dea938de24-system-cni-dir\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.473306 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473167    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmj7t\" (UniqueName: \"kubernetes.io/projected/1ff19d47-9db7-4182-b0f8-42dea938de24-kube-api-access-xmj7t\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.473306 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdp55\" (UniqueName: \"kubernetes.io/projected/04ea5950-65fd-407e-aadc-392852a3a0bc-kube-api-access-gdp55\") pod \"node-ca-jf2mm\" (UID: \"04ea5950-65fd-407e-aadc-392852a3a0bc\") " pod="openshift-image-registry/node-ca-jf2mm"
Jul 28 22:05:01.473306 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473224    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-multus-conf-dir\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.473306 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473226    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ff19d47-9db7-4182-b0f8-42dea938de24-system-cni-dir\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.473306 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473249    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-run-multus-certs\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.473306 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473276    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d268c04e-d61a-493f-a465-5a048e4b815f-kubelet-config\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:01.473628 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473338    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d268c04e-d61a-493f-a465-5a048e4b815f-kubelet-config\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:01.473628 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473350    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-var-lib-kubelet\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.473628 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttnnz\" (UniqueName: \"kubernetes.io/projected/4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0-kube-api-access-ttnnz\") pod \"iptables-alerter-2zltv\" (UID: \"4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0\") " pod="openshift-network-operator/iptables-alerter-2zltv"
Jul 28 22:05:01.473628 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473430    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-sys-fs\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.473628 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473452    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 22:05:01.473628 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473455    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdp5t\" (UniqueName: \"kubernetes.io/projected/6824e8d1-ee18-41fb-aaa6-3a914506cef5-kube-api-access-zdp5t\") pod \"node-resolver-dctt5\" (UID: \"6824e8d1-ee18-41fb-aaa6-3a914506cef5\") " pod="openshift-dns/node-resolver-dctt5"
Jul 28 22:05:01.473628 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-run-systemd\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.473628 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473560    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8dd3e5d4-2a3a-4b2d-bb32-d88de52e28a4-konnectivity-ca\") pod \"konnectivity-agent-6xksh\" (UID: \"8dd3e5d4-2a3a-4b2d-bb32-d88de52e28a4\") " pod="kube-system/konnectivity-agent-6xksh"
Jul 28 22:05:01.473628 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473501    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-sys-fs\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.473628 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473597    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-etc-openvswitch\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.473628 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473625    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-node-log\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473640    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-run-systemd\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473652    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-etc-openvswitch\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473653    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcxpp\" (UniqueName: \"kubernetes.io/projected/f897e87e-7933-43c6-8073-5ed015c336e1-kube-api-access-jcxpp\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473687    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-node-log\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473723    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8dwd\" (UniqueName: \"kubernetes.io/projected/f795de7c-7235-4dd8-b3bb-1893cb3fd386-kube-api-access-v8dwd\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473751    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-lib-modules\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473774    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4498c\" (UniqueName: \"kubernetes.io/projected/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-kube-api-access-4498c\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ff19d47-9db7-4182-b0f8-42dea938de24-cni-binary-copy\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-multus-cni-dir\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473890    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-lib-modules\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473929    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-etc-selinux\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-slash\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.473984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-cni-bin\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474008    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-device-dir\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-run-ovn\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474054    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-log-socket\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.474153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474055    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-slash\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474068    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-cni-bin\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474078    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-ovnkube-script-lib\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-system-cni-dir\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474118    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-run-ovn\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6824e8d1-ee18-41fb-aaa6-3a914506cef5-tmp-dir\") pod \"node-resolver-dctt5\" (UID: \"6824e8d1-ee18-41fb-aaa6-3a914506cef5\") " pod="openshift-dns/node-resolver-dctt5"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474148    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-etc-selinux\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474167    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-sysctl-d\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474175    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-device-dir\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-cni-netd\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474237    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-log-socket\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474252    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474281    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-run-k8s-cni-cncf-io\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474305    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-var-lib-kubelet\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474325    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-tuned\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474333    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ff19d47-9db7-4182-b0f8-42dea938de24-cni-binary-copy\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-sysctl-d\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.474947 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqttb\" (UniqueName: \"kubernetes.io/projected/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-kube-api-access-jqttb\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474372    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6824e8d1-ee18-41fb-aaa6-3a914506cef5-hosts-file\") pod \"node-resolver-dctt5\" (UID: \"6824e8d1-ee18-41fb-aaa6-3a914506cef5\") " pod="openshift-dns/node-resolver-dctt5"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474429    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-sysctl-conf\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-run\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d268c04e-d61a-493f-a465-5a048e4b815f-dbus\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-systemd-units\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-var-lib-kubelet\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474528    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-run-openvswitch\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-run-ovn-kubernetes\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04ea5950-65fd-407e-aadc-392852a3a0bc-serviceca\") pod \"node-ca-jf2mm\" (UID: \"04ea5950-65fd-407e-aadc-392852a3a0bc\") " pod="openshift-image-registry/node-ca-jf2mm"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-var-lib-cni-multus\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474628    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-hostroot\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474653    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f795de7c-7235-4dd8-b3bb-1893cb3fd386-multus-daemon-config\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-registration-dir\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474689    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6824e8d1-ee18-41fb-aaa6-3a914506cef5-tmp-dir\") pod \"node-resolver-dctt5\" (UID: \"6824e8d1-ee18-41fb-aaa6-3a914506cef5\") " pod="openshift-dns/node-resolver-dctt5"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474705    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-ovnkube-script-lib\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.475749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474707    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mppqk\" (UniqueName: \"kubernetes.io/projected/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-kube-api-access-mppqk\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474750    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ff19d47-9db7-4182-b0f8-42dea938de24-os-release\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474782    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-tmp\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474802    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-ovn-node-metrics-cert\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474842    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ff19d47-9db7-4182-b0f8-42dea938de24-cnibin\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474868    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-sysctl-conf\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474928    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-run\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474979    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6824e8d1-ee18-41fb-aaa6-3a914506cef5-hosts-file\") pod \"node-resolver-dctt5\" (UID: \"6824e8d1-ee18-41fb-aaa6-3a914506cef5\") " pod="openshift-dns/node-resolver-dctt5"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d268c04e-d61a-493f-a465-5a048e4b815f-dbus\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475068    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-run-openvswitch\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475100    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-registration-dir\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.474869    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475111    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-run-ovn-kubernetes\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475141    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-cni-netd\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-modprobe-d\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475185    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475187    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ff19d47-9db7-4182-b0f8-42dea938de24-os-release\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.476551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-run-netns\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475245    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475289    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ff19d47-9db7-4182-b0f8-42dea938de24-cnibin\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475255    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-modprobe-d\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475290    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-systemd-units\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475294    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-host-run-netns\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475255    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-ovnkube-config\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475353    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-os-release\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475384    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f795de7c-7235-4dd8-b3bb-1893cb3fd386-cni-binary-copy\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-socket-dir\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475445    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-sysconfig\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-kubernetes\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475497    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-env-overrides\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ff19d47-9db7-4182-b0f8-42dea938de24-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475602    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ff19d47-9db7-4182-b0f8-42dea938de24-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475648    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-var-lib-cni-bin\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0-host-slash\") pod \"iptables-alerter-2zltv\" (UID: \"4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0\") " pod="openshift-network-operator/iptables-alerter-2zltv"
Jul 28 22:05:01.477408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475726    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-ovnkube-config\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475729    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-sys\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475774    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-host\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475818    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-sysconfig\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475846    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ff19d47-9db7-4182-b0f8-42dea938de24-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475874    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04ea5950-65fd-407e-aadc-392852a3a0bc-host\") pod \"node-ca-jf2mm\" (UID: \"04ea5950-65fd-407e-aadc-392852a3a0bc\") " pod="openshift-image-registry/node-ca-jf2mm"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475880    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-kubernetes\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-sys\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475937    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-cnibin\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-env-overrides\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.475963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-multus-socket-dir-parent\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.476054    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-host\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.476159    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ff19d47-9db7-4182-b0f8-42dea938de24-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.476264    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-socket-dir\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.476354    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.476411    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ff19d47-9db7-4182-b0f8-42dea938de24-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.478146 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.476433    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret podName:d268c04e-d61a-493f-a465-5a048e4b815f nodeName:}" failed. No retries permitted until 2026-07-28 22:05:01.976411667 +0000 UTC m=+2.972000250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret") pod "global-pull-secret-syncer-t6bj4" (UID: "d268c04e-d61a-493f-a465-5a048e4b815f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:01.478861 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.476511    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ff19d47-9db7-4182-b0f8-42dea938de24-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.478861 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.477310    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-ovn-node-metrics-cert\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.478861 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.477615    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-tmp\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.478861 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.477723    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-etc-tuned\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.478861 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.477748    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8dd3e5d4-2a3a-4b2d-bb32-d88de52e28a4-agent-certs\") pod \"konnectivity-agent-6xksh\" (UID: \"8dd3e5d4-2a3a-4b2d-bb32-d88de52e28a4\") " pod="kube-system/konnectivity-agent-6xksh"
Jul 28 22:05:01.479095 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.478879    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 22:05:01.479095 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.478903    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 22:05:01.479095 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.478925    2564 projected.go:196] Error preparing data for projected volume kube-api-access-cdbv4 for pod openshift-network-diagnostics/network-check-target-6dm7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:01.479095 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.479000    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4 podName:92d4ce98-2041-44e4-9acb-9c2e6be92ca0 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:01.97898492 +0000 UTC m=+2.974573485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cdbv4" (UniqueName: "kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4") pod "network-check-target-6dm7b" (UID: "92d4ce98-2041-44e4-9acb-9c2e6be92ca0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:01.481328 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.481305    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmj7t\" (UniqueName: \"kubernetes.io/projected/1ff19d47-9db7-4182-b0f8-42dea938de24-kube-api-access-xmj7t\") pod \"multus-additional-cni-plugins-gdjkx\" (UID: \"1ff19d47-9db7-4182-b0f8-42dea938de24\") " pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.481467 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.481451    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4498c\" (UniqueName: \"kubernetes.io/projected/65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9-kube-api-access-4498c\") pod \"tuned-pwp9p\" (UID: \"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9\") " pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.487988 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.487959    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdp5t\" (UniqueName: \"kubernetes.io/projected/6824e8d1-ee18-41fb-aaa6-3a914506cef5-kube-api-access-zdp5t\") pod \"node-resolver-dctt5\" (UID: \"6824e8d1-ee18-41fb-aaa6-3a914506cef5\") " pod="openshift-dns/node-resolver-dctt5"
Jul 28 22:05:01.488337 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.488307    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mppqk\" (UniqueName: \"kubernetes.io/projected/fe27dde5-04ae-4d2f-9cd4-6e75c4832dca-kube-api-access-mppqk\") pod \"ovnkube-node-srsbn\" (UID: \"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca\") " pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.488758 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.488739    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqttb\" (UniqueName: \"kubernetes.io/projected/cd65474d-d6e5-4e5f-8448-ea0ee4db8f77-kube-api-access-jqttb\") pod \"aws-ebs-csi-driver-node-68zmh\" (UID: \"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.508607 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.508555    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-211.ec2.internal" event={"ID":"66c77808443d2cca2649284227dd8760","Type":"ContainerStarted","Data":"64d0a654abef83de2823385a76a456019d65684d6bcc19deb371a65ab59958fb"}
Jul 28 22:05:01.509943 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.509917    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal" event={"ID":"56bb828bfe5067d560cc889e080056c0","Type":"ContainerStarted","Data":"51c5deffc27aeeb4309368a72467a93d82d9b9ac985d7526aae7c1794492b1eb"}
Jul 28 22:05:01.576262 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-system-cni-dir\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.576448 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576273    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-run-k8s-cni-cncf-io\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.576448 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04ea5950-65fd-407e-aadc-392852a3a0bc-serviceca\") pod \"node-ca-jf2mm\" (UID: \"04ea5950-65fd-407e-aadc-392852a3a0bc\") " pod="openshift-image-registry/node-ca-jf2mm"
Jul 28 22:05:01.576448 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-var-lib-cni-multus\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.576448 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576372    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-hostroot\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.576448 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576387    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f795de7c-7235-4dd8-b3bb-1893cb3fd386-multus-daemon-config\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.576448 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576411    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:01.576448 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-os-release\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.576774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576465    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f795de7c-7235-4dd8-b3bb-1893cb3fd386-cni-binary-copy\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.576774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-var-lib-cni-bin\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.576774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0-host-slash\") pod \"iptables-alerter-2zltv\" (UID: \"4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0\") " pod="openshift-network-operator/iptables-alerter-2zltv"
Jul 28 22:05:01.576774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576536    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04ea5950-65fd-407e-aadc-392852a3a0bc-host\") pod \"node-ca-jf2mm\" (UID: \"04ea5950-65fd-407e-aadc-392852a3a0bc\") " pod="openshift-image-registry/node-ca-jf2mm"
Jul 28 22:05:01.576774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576554    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-cnibin\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.576774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-multus-socket-dir-parent\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.576774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0-iptables-alerter-script\") pod \"iptables-alerter-2zltv\" (UID: \"4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0\") " pod="openshift-network-operator/iptables-alerter-2zltv"
Jul 28 22:05:01.576774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-run-netns\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.576774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-etc-kubernetes\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.576774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576709    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdp55\" (UniqueName: \"kubernetes.io/projected/04ea5950-65fd-407e-aadc-392852a3a0bc-kube-api-access-gdp55\") pod \"node-ca-jf2mm\" (UID: \"04ea5950-65fd-407e-aadc-392852a3a0bc\") " pod="openshift-image-registry/node-ca-jf2mm"
Jul 28 22:05:01.576774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576738    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-multus-conf-dir\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.576774 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.576746    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:01.576774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576765    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-run-multus-certs\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.576774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576780    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-var-lib-kubelet\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.577490 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576797    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttnnz\" (UniqueName: \"kubernetes.io/projected/4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0-kube-api-access-ttnnz\") pod \"iptables-alerter-2zltv\" (UID: \"4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0\") " pod="openshift-network-operator/iptables-alerter-2zltv"
Jul 28 22:05:01.577490 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.576857    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs podName:f897e87e-7933-43c6-8073-5ed015c336e1 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:02.076817267 +0000 UTC m=+3.072405842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs") pod "network-metrics-daemon-klvjg" (UID: "f897e87e-7933-43c6-8073-5ed015c336e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:01.577490 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcxpp\" (UniqueName: \"kubernetes.io/projected/f897e87e-7933-43c6-8073-5ed015c336e1-kube-api-access-jcxpp\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:01.577490 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576919    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8dwd\" (UniqueName: \"kubernetes.io/projected/f795de7c-7235-4dd8-b3bb-1893cb3fd386-kube-api-access-v8dwd\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.577490 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.576952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-multus-cni-dir\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.577490 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-multus-cni-dir\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.577490 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-os-release\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.577490 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577108    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-system-cni-dir\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.577490 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577147    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-run-k8s-cni-cncf-io\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.577971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577566    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04ea5950-65fd-407e-aadc-392852a3a0bc-serviceca\") pod \"node-ca-jf2mm\" (UID: \"04ea5950-65fd-407e-aadc-392852a3a0bc\") " pod="openshift-image-registry/node-ca-jf2mm"
Jul 28 22:05:01.577971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577604    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0-host-slash\") pod \"iptables-alerter-2zltv\" (UID: \"4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0\") " pod="openshift-network-operator/iptables-alerter-2zltv"
Jul 28 22:05:01.577971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577638    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-var-lib-cni-bin\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.577971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04ea5950-65fd-407e-aadc-392852a3a0bc-host\") pod \"node-ca-jf2mm\" (UID: \"04ea5950-65fd-407e-aadc-392852a3a0bc\") " pod="openshift-image-registry/node-ca-jf2mm"
Jul 28 22:05:01.577971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577686    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-var-lib-cni-multus\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.577971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577705    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-cnibin\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.577971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577570    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f795de7c-7235-4dd8-b3bb-1893cb3fd386-cni-binary-copy\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.577971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577734    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-etc-kubernetes\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.577971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577899    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-multus-socket-dir-parent\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.577971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-run-netns\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.577971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577965    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-run-multus-certs\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.578302 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.577997    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-host-var-lib-kubelet\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.578302 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.578044    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-hostroot\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.578302 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.578148    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f795de7c-7235-4dd8-b3bb-1893cb3fd386-multus-conf-dir\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.578433 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.578407    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0-iptables-alerter-script\") pod \"iptables-alerter-2zltv\" (UID: \"4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0\") " pod="openshift-network-operator/iptables-alerter-2zltv"
Jul 28 22:05:01.578952 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.578928    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f795de7c-7235-4dd8-b3bb-1893cb3fd386-multus-daemon-config\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.584780 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.584737    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttnnz\" (UniqueName: \"kubernetes.io/projected/4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0-kube-api-access-ttnnz\") pod \"iptables-alerter-2zltv\" (UID: \"4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0\") " pod="openshift-network-operator/iptables-alerter-2zltv"
Jul 28 22:05:01.586112 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.586089    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8dwd\" (UniqueName: \"kubernetes.io/projected/f795de7c-7235-4dd8-b3bb-1893cb3fd386-kube-api-access-v8dwd\") pod \"multus-nlh6l\" (UID: \"f795de7c-7235-4dd8-b3bb-1893cb3fd386\") " pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.586530 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.586511    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdp55\" (UniqueName: \"kubernetes.io/projected/04ea5950-65fd-407e-aadc-392852a3a0bc-kube-api-access-gdp55\") pod \"node-ca-jf2mm\" (UID: \"04ea5950-65fd-407e-aadc-392852a3a0bc\") " pod="openshift-image-registry/node-ca-jf2mm"
Jul 28 22:05:01.586713 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.586689    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcxpp\" (UniqueName: \"kubernetes.io/projected/f897e87e-7933-43c6-8073-5ed015c336e1-kube-api-access-jcxpp\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:01.650475 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.650395    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 22:05:01.656234 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.656050    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh"
Jul 28 22:05:01.661143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.661115    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dctt5"
Jul 28 22:05:01.667017 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:05:01.666987    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd65474d_d6e5_4e5f_8448_ea0ee4db8f77.slice/crio-5fb0e92dcbeae0f17c29cfa1984c7f23a28c3ef7c1942ccb35ac33b2d4a36d75 WatchSource:0}: Error finding container 5fb0e92dcbeae0f17c29cfa1984c7f23a28c3ef7c1942ccb35ac33b2d4a36d75: Status 404 returned error can't find the container with id 5fb0e92dcbeae0f17c29cfa1984c7f23a28c3ef7c1942ccb35ac33b2d4a36d75
Jul 28 22:05:01.668004 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.667983    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6xksh"
Jul 28 22:05:01.674260 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.674244    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gdjkx"
Jul 28 22:05:01.679265 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.679246    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pwp9p"
Jul 28 22:05:01.685740 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.685680    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:01.692858 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.692677    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nlh6l"
Jul 28 22:05:01.693999 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:05:01.693901    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ff19d47_9db7_4182_b0f8_42dea938de24.slice/crio-42b2135e0185ceea3f7569cd2340d414cfbec238604fa07eda0d8d953e9e7bd8 WatchSource:0}: Error finding container 42b2135e0185ceea3f7569cd2340d414cfbec238604fa07eda0d8d953e9e7bd8: Status 404 returned error can't find the container with id 42b2135e0185ceea3f7569cd2340d414cfbec238604fa07eda0d8d953e9e7bd8
Jul 28 22:05:01.697955 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:05:01.697919    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe27dde5_04ae_4d2f_9cd4_6e75c4832dca.slice/crio-81860f1dd793c75510799caa5374f4638889e705281aed6a7c0cf58b770b0a2f WatchSource:0}: Error finding container 81860f1dd793c75510799caa5374f4638889e705281aed6a7c0cf58b770b0a2f: Status 404 returned error can't find the container with id 81860f1dd793c75510799caa5374f4638889e705281aed6a7c0cf58b770b0a2f
Jul 28 22:05:01.699591 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.699572    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2zltv"
Jul 28 22:05:01.700859 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:05:01.700822    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65feb1b4_1dfc_4e0d_8d84_0f11ff0cd4a9.slice/crio-2a64d41a77415563903ff55fa30e0e21f629ff78f467ae02ed1397314f650974 WatchSource:0}: Error finding container 2a64d41a77415563903ff55fa30e0e21f629ff78f467ae02ed1397314f650974: Status 404 returned error can't find the container with id 2a64d41a77415563903ff55fa30e0e21f629ff78f467ae02ed1397314f650974
Jul 28 22:05:01.709778 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:05:01.709756    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf795de7c_7235_4dd8_b3bb_1893cb3fd386.slice/crio-562a4eda90d445b217a4567e1a13a759548106e130865eae0f720499fcb0394b WatchSource:0}: Error finding container 562a4eda90d445b217a4567e1a13a759548106e130865eae0f720499fcb0394b: Status 404 returned error can't find the container with id 562a4eda90d445b217a4567e1a13a759548106e130865eae0f720499fcb0394b
Jul 28 22:05:01.710563 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.710543    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jf2mm"
Jul 28 22:05:01.714677 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:05:01.714655    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b21bdb4_7198_4c1a_9fe0_8a9c2735daa0.slice/crio-bc2f7330e4296f5d4c93abab8b447c031bf09b91165f8ea018c2e62447a58e96 WatchSource:0}: Error finding container bc2f7330e4296f5d4c93abab8b447c031bf09b91165f8ea018c2e62447a58e96: Status 404 returned error can't find the container with id bc2f7330e4296f5d4c93abab8b447c031bf09b91165f8ea018c2e62447a58e96
Jul 28 22:05:01.723517 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:05:01.723493    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04ea5950_65fd_407e_aadc_392852a3a0bc.slice/crio-be10cc57996f94c63f32be25f61404377c8c94aba4da97794d852f420d4926f7 WatchSource:0}: Error finding container be10cc57996f94c63f32be25f61404377c8c94aba4da97794d852f420d4926f7: Status 404 returned error can't find the container with id be10cc57996f94c63f32be25f61404377c8c94aba4da97794d852f420d4926f7
Jul 28 22:05:01.980272 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.980197    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:01.980272 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:01.980240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdbv4\" (UniqueName: \"kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4\") pod \"network-check-target-6dm7b\" (UID: \"92d4ce98-2041-44e4-9acb-9c2e6be92ca0\") " pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:01.980487 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.980340    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:01.980487 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.980403    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret podName:d268c04e-d61a-493f-a465-5a048e4b815f nodeName:}" failed. No retries permitted until 2026-07-28 22:05:02.980386617 +0000 UTC m=+3.975975180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret") pod "global-pull-secret-syncer-t6bj4" (UID: "d268c04e-d61a-493f-a465-5a048e4b815f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:01.980487 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.980435    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 22:05:01.980487 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.980453    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 22:05:01.980487 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.980462    2564 projected.go:196] Error preparing data for projected volume kube-api-access-cdbv4 for pod openshift-network-diagnostics/network-check-target-6dm7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:01.980795 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:01.980503    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4 podName:92d4ce98-2041-44e4-9acb-9c2e6be92ca0 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:02.980491384 +0000 UTC m=+3.976079944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdbv4" (UniqueName: "kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4") pod "network-check-target-6dm7b" (UID: "92d4ce98-2041-44e4-9acb-9c2e6be92ca0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:02.080580 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.080546    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:02.080770 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:02.080677    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:02.080770 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:02.080738    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs podName:f897e87e-7933-43c6-8073-5ed015c336e1 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:03.080720663 +0000 UTC m=+4.076309224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs") pod "network-metrics-daemon-klvjg" (UID: "f897e87e-7933-43c6-8073-5ed015c336e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:02.412529 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.412421    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 22:00:01 +0000 UTC" deadline="2028-03-16 06:28:25.723274618 +0000 UTC"
Jul 28 22:05:02.412529 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.412481    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14312h23m23.31079768s"
Jul 28 22:05:02.502509 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.502486    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:02.502651 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:02.502604    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:02.514206 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.514174    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh" event={"ID":"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77","Type":"ContainerStarted","Data":"5fb0e92dcbeae0f17c29cfa1984c7f23a28c3ef7c1942ccb35ac33b2d4a36d75"}
Jul 28 22:05:02.516552 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.516524    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nlh6l" event={"ID":"f795de7c-7235-4dd8-b3bb-1893cb3fd386","Type":"ContainerStarted","Data":"562a4eda90d445b217a4567e1a13a759548106e130865eae0f720499fcb0394b"}
Jul 28 22:05:02.518802 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.518780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn" event={"ID":"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca","Type":"ContainerStarted","Data":"81860f1dd793c75510799caa5374f4638889e705281aed6a7c0cf58b770b0a2f"}
Jul 28 22:05:02.521361 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.521340    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pwp9p" event={"ID":"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9","Type":"ContainerStarted","Data":"2a64d41a77415563903ff55fa30e0e21f629ff78f467ae02ed1397314f650974"}
Jul 28 22:05:02.523267 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.523243    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdjkx" event={"ID":"1ff19d47-9db7-4182-b0f8-42dea938de24","Type":"ContainerStarted","Data":"42b2135e0185ceea3f7569cd2340d414cfbec238604fa07eda0d8d953e9e7bd8"}
Jul 28 22:05:02.524807 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.524784    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6xksh" event={"ID":"8dd3e5d4-2a3a-4b2d-bb32-d88de52e28a4","Type":"ContainerStarted","Data":"0c206ea5af58a40ee337d0c1e007617c706947935f805b78c366177f3a753d98"}
Jul 28 22:05:02.526236 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.526212    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jf2mm" event={"ID":"04ea5950-65fd-407e-aadc-392852a3a0bc","Type":"ContainerStarted","Data":"be10cc57996f94c63f32be25f61404377c8c94aba4da97794d852f420d4926f7"}
Jul 28 22:05:02.527714 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.527686    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2zltv" event={"ID":"4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0","Type":"ContainerStarted","Data":"bc2f7330e4296f5d4c93abab8b447c031bf09b91165f8ea018c2e62447a58e96"}
Jul 28 22:05:02.529410 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.529392    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dctt5" event={"ID":"6824e8d1-ee18-41fb-aaa6-3a914506cef5","Type":"ContainerStarted","Data":"5155008dd1196990ac753f011a9b97162b170bfb08fa87bd3e4d5e07168e681a"}
Jul 28 22:05:02.681880 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.681787    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 22:05:02.987111 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.987029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:02.987111 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:02.987089    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdbv4\" (UniqueName: \"kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4\") pod \"network-check-target-6dm7b\" (UID: \"92d4ce98-2041-44e4-9acb-9c2e6be92ca0\") " pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:02.987324 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:02.987249    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 22:05:02.987324 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:02.987267    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 22:05:02.987324 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:02.987281    2564 projected.go:196] Error preparing data for projected volume kube-api-access-cdbv4 for pod openshift-network-diagnostics/network-check-target-6dm7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:02.987475 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:02.987350    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4 podName:92d4ce98-2041-44e4-9acb-9c2e6be92ca0 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:04.987321173 +0000 UTC m=+5.982909735 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdbv4" (UniqueName: "kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4") pod "network-check-target-6dm7b" (UID: "92d4ce98-2041-44e4-9acb-9c2e6be92ca0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:02.987757 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:02.987740    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:02.987853 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:02.987794    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret podName:d268c04e-d61a-493f-a465-5a048e4b815f nodeName:}" failed. No retries permitted until 2026-07-28 22:05:04.987780292 +0000 UTC m=+5.983368855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret") pod "global-pull-secret-syncer-t6bj4" (UID: "d268c04e-d61a-493f-a465-5a048e4b815f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:03.089253 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:03.088678    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:03.089253 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:03.088859    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:03.089253 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:03.088923    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs podName:f897e87e-7933-43c6-8073-5ed015c336e1 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:05.088906045 +0000 UTC m=+6.084494621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs") pod "network-metrics-daemon-klvjg" (UID: "f897e87e-7933-43c6-8073-5ed015c336e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:03.157327 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:03.157301    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 22:05:03.413125 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:03.413040    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 22:00:01 +0000 UTC" deadline="2028-01-30 19:54:59.803065229 +0000 UTC"
Jul 28 22:05:03.413125 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:03.413077    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13221h49m56.389992752s"
Jul 28 22:05:03.503234 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:03.502958    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:03.503234 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:03.503113    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:03.503234 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:03.503123    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:03.503234 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:03.503203    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:04.502368 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:04.501884    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:04.502368 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:04.502010    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:05.006069 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:05.005472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:05.006069 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:05.005510    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdbv4\" (UniqueName: \"kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4\") pod \"network-check-target-6dm7b\" (UID: \"92d4ce98-2041-44e4-9acb-9c2e6be92ca0\") " pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:05.006069 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:05.005635    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 22:05:05.006069 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:05.005649    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 22:05:05.006069 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:05.005657    2564 projected.go:196] Error preparing data for projected volume kube-api-access-cdbv4 for pod openshift-network-diagnostics/network-check-target-6dm7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:05.006069 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:05.005702    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4 podName:92d4ce98-2041-44e4-9acb-9c2e6be92ca0 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:09.005688936 +0000 UTC m=+10.001277499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdbv4" (UniqueName: "kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4") pod "network-check-target-6dm7b" (UID: "92d4ce98-2041-44e4-9acb-9c2e6be92ca0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:05.006069 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:05.005995    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:05.006069 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:05.006029    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret podName:d268c04e-d61a-493f-a465-5a048e4b815f nodeName:}" failed. No retries permitted until 2026-07-28 22:05:09.006020397 +0000 UTC m=+10.001608957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret") pod "global-pull-secret-syncer-t6bj4" (UID: "d268c04e-d61a-493f-a465-5a048e4b815f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:05.106178 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:05.106145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:05.106360 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:05.106276    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:05.106360 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:05.106338    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs podName:f897e87e-7933-43c6-8073-5ed015c336e1 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:09.106321216 +0000 UTC m=+10.101909790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs") pod "network-metrics-daemon-klvjg" (UID: "f897e87e-7933-43c6-8073-5ed015c336e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:05.502571 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:05.502500    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:05.503022 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:05.502721    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:05.503117 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:05.503098    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:05.503247 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:05.503192    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:06.502608 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:06.502576    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:06.503130 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:06.502690    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:07.503167 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:07.502481    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:07.503167 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:07.502632    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:07.503167 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:07.503009    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:07.503167 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:07.503105    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:08.503041 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:08.502619    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:08.503041 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:08.502722    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:09.038347 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:09.038085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:09.038347 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:09.038137    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdbv4\" (UniqueName: \"kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4\") pod \"network-check-target-6dm7b\" (UID: \"92d4ce98-2041-44e4-9acb-9c2e6be92ca0\") " pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:09.038347 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:09.038255    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:09.038347 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:09.038270    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 22:05:09.038347 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:09.038286    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 22:05:09.038347 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:09.038298    2564 projected.go:196] Error preparing data for projected volume kube-api-access-cdbv4 for pod openshift-network-diagnostics/network-check-target-6dm7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:09.038347 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:09.038335    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret podName:d268c04e-d61a-493f-a465-5a048e4b815f nodeName:}" failed. No retries permitted until 2026-07-28 22:05:17.038315051 +0000 UTC m=+18.033903615 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret") pod "global-pull-secret-syncer-t6bj4" (UID: "d268c04e-d61a-493f-a465-5a048e4b815f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:09.038347 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:09.038355    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4 podName:92d4ce98-2041-44e4-9acb-9c2e6be92ca0 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:17.038345636 +0000 UTC m=+18.033934200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdbv4" (UniqueName: "kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4") pod "network-check-target-6dm7b" (UID: "92d4ce98-2041-44e4-9acb-9c2e6be92ca0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:09.139106 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:09.138983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:09.139271 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:09.139128    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:09.139271 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:09.139196    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs podName:f897e87e-7933-43c6-8073-5ed015c336e1 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:17.139179615 +0000 UTC m=+18.134768180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs") pod "network-metrics-daemon-klvjg" (UID: "f897e87e-7933-43c6-8073-5ed015c336e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:09.504064 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:09.503280    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:09.504064 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:09.503639    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:09.504064 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:09.503806    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:09.504064 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:09.503915    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:10.502449 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:10.502415    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:10.502632 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:10.502584    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:11.502952 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:11.502925    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:11.503350 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:11.502926    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:11.503350 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:11.503025    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:11.503350 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:11.503110    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:12.501935 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:12.501905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:12.502086 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:12.502002    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:13.502598 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:13.502564    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:13.503077 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:13.502569    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:13.503077 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:13.502708    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:13.503077 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:13.502806    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:14.502555 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:14.502520    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:14.502709 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:14.502643    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:15.502390 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:15.502352    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:15.502579 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:15.502352    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:15.502579 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:15.502482    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:15.502694 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:15.502603    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:16.501937 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:16.501887    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:16.502426 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:16.502025    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:17.099646 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:17.099613    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:17.099646 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:17.099658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdbv4\" (UniqueName: \"kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4\") pod \"network-check-target-6dm7b\" (UID: \"92d4ce98-2041-44e4-9acb-9c2e6be92ca0\") " pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:17.099939 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:17.099762    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:17.099939 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:17.099774    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 22:05:17.099939 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:17.099787    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 22:05:17.099939 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:17.099800    2564 projected.go:196] Error preparing data for projected volume kube-api-access-cdbv4 for pod openshift-network-diagnostics/network-check-target-6dm7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:17.099939 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:17.099843    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret podName:d268c04e-d61a-493f-a465-5a048e4b815f nodeName:}" failed. No retries permitted until 2026-07-28 22:05:33.099810202 +0000 UTC m=+34.095398776 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret") pod "global-pull-secret-syncer-t6bj4" (UID: "d268c04e-d61a-493f-a465-5a048e4b815f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:17.099939 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:17.099861    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4 podName:92d4ce98-2041-44e4-9acb-9c2e6be92ca0 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:33.099852082 +0000 UTC m=+34.095440648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdbv4" (UniqueName: "kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4") pod "network-check-target-6dm7b" (UID: "92d4ce98-2041-44e4-9acb-9c2e6be92ca0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:17.200168 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:17.200134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:17.200350 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:17.200256    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:17.200350 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:17.200329    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs podName:f897e87e-7933-43c6-8073-5ed015c336e1 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:33.200309009 +0000 UTC m=+34.195897571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs") pod "network-metrics-daemon-klvjg" (UID: "f897e87e-7933-43c6-8073-5ed015c336e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:17.502496 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:17.502419    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:17.502931 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:17.502542    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:17.502931 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:17.502548    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:17.502931 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:17.502622    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:18.502803 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:18.502775    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:18.503278 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:18.502885    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:19.504948 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:19.504924    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:19.505362 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:19.504930    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:19.505362 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:19.505028    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:19.505362 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:19.505126    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:20.502365 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:20.502334    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:20.502520 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:20.502437    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:21.502335 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.502137    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:21.502894 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.502193    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:21.502894 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:21.502418    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:21.502894 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:21.502472    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:21.566114 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.566002    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jf2mm" event={"ID":"04ea5950-65fd-407e-aadc-392852a3a0bc","Type":"ContainerStarted","Data":"23c68059f96dfed0c41f0447fdb04d53a44a663f97ff82977e6132840904f22a"}
Jul 28 22:05:21.567337 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.567309    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dctt5" event={"ID":"6824e8d1-ee18-41fb-aaa6-3a914506cef5","Type":"ContainerStarted","Data":"19a4155c642513888864acf7bebcaadbb3431aaf1b2b33d8da9fda9a5495f99e"}
Jul 28 22:05:21.568671 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.568650    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh" event={"ID":"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77","Type":"ContainerStarted","Data":"f64d0f58691cc592be4611d1905c04cbe9d4b47f3ae67dfe60e1def61532c32c"}
Jul 28 22:05:21.570011 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.569986    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nlh6l" event={"ID":"f795de7c-7235-4dd8-b3bb-1893cb3fd386","Type":"ContainerStarted","Data":"7ce540e86153929b0a414f07da03ae20a9b4f645bd8b9b6dfcb4a08666a30874"}
Jul 28 22:05:21.573093 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.573075    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:05:21.573510 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.573485    2564 generic.go:356] "Generic (PLEG): container finished" podID="fe27dde5-04ae-4d2f-9cd4-6e75c4832dca" containerID="5a3efbc8ada3ba486f1135018e2dbff290107bc43bdda496dd1ab1ee671f81d3" exitCode=1
Jul 28 22:05:21.573615 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.573555    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn" event={"ID":"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca","Type":"ContainerStarted","Data":"216dad5725a1ae2d4a571d7281c0696d888e13ac4cf3d2e475ac1503d6540aaa"}
Jul 28 22:05:21.573679 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.573634    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn" event={"ID":"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca","Type":"ContainerStarted","Data":"4e5323be5a225d63b49c5660fd628816cfc677047c9d4621a44609c66e9af5c2"}
Jul 28 22:05:21.573736 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.573700    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn" event={"ID":"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca","Type":"ContainerStarted","Data":"60f56cacd0e798558680046680d851540e6efadcb9248b83c6f0a439ad23a23c"}
Jul 28 22:05:21.573795 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.573750    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn" event={"ID":"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca","Type":"ContainerStarted","Data":"3c15c9ed26957db7d2acf847de9bfb3a1f2ecfd317895fdde1645c91a149cf3c"}
Jul 28 22:05:21.573869 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.573801    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn" event={"ID":"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca","Type":"ContainerDied","Data":"5a3efbc8ada3ba486f1135018e2dbff290107bc43bdda496dd1ab1ee671f81d3"}
Jul 28 22:05:21.573929 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.573867    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn" event={"ID":"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca","Type":"ContainerStarted","Data":"009577625fb37dbabc06d40375c3996e8c8bdcea9a2d62644eb207c8b560d4f3"}
Jul 28 22:05:21.575239 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.575192    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pwp9p" event={"ID":"65feb1b4-1dfc-4e0d-8d84-0f11ff0cd4a9","Type":"ContainerStarted","Data":"1884a780e6ba61fccff1fbd46800381c6d33d0d363ffbe0792d9211258696b55"}
Jul 28 22:05:21.577191 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.577167    2564 generic.go:356] "Generic (PLEG): container finished" podID="1ff19d47-9db7-4182-b0f8-42dea938de24" containerID="8e5147c6738266b4fabf281f2b1391d0edb4cf4e1aea1bf9129e12ed13b1f0e0" exitCode=0
Jul 28 22:05:21.577283 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.577249    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdjkx" event={"ID":"1ff19d47-9db7-4182-b0f8-42dea938de24","Type":"ContainerDied","Data":"8e5147c6738266b4fabf281f2b1391d0edb4cf4e1aea1bf9129e12ed13b1f0e0"}
Jul 28 22:05:21.578872 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.578852    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6xksh" event={"ID":"8dd3e5d4-2a3a-4b2d-bb32-d88de52e28a4","Type":"ContainerStarted","Data":"6d866f25f0afac7687208d12c2fcb5979852437ad9be95ebc2c06019b633fd42"}
Jul 28 22:05:21.580492 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.580470    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-211.ec2.internal" event={"ID":"66c77808443d2cca2649284227dd8760","Type":"ContainerStarted","Data":"de61617393063158f1e751b5823152a7be66848bbcae898badb3657f309badac"}
Jul 28 22:05:21.581987 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.581966    2564 generic.go:356] "Generic (PLEG): container finished" podID="56bb828bfe5067d560cc889e080056c0" containerID="3593a2067c1d9ef6175665a0e8835c33822be0c00fe589445b35105067c9d002" exitCode=0
Jul 28 22:05:21.582113 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.581998    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal" event={"ID":"56bb828bfe5067d560cc889e080056c0","Type":"ContainerDied","Data":"3593a2067c1d9ef6175665a0e8835c33822be0c00fe589445b35105067c9d002"}
Jul 28 22:05:21.598429 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.598386    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jf2mm" podStartSLOduration=4.072607838 podStartE2EDuration="22.598373011s" totalImagesPullingTime="18.525765173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:21.597896243 +0000 UTC m=+22.593484826" watchObservedRunningTime="2026-07-28 22:05:21.598373011 +0000 UTC m=+22.593961589"
Jul 28 22:05:21.612492 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.612444    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dctt5" podStartSLOduration=3.642479108 podStartE2EDuration="22.612425229s" totalImagesPullingTime="18.969946121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:21.612416845 +0000 UTC m=+22.608005428" watchObservedRunningTime="2026-07-28 22:05:21.612425229 +0000 UTC m=+22.608013812"
Jul 28 22:05:21.642556 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.642501    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nlh6l" podStartSLOduration=3.541855487 podStartE2EDuration="22.642481898s" totalImagesPullingTime="19.100626411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:21.642303136 +0000 UTC m=+22.637891720" watchObservedRunningTime="2026-07-28 22:05:21.642481898 +0000 UTC m=+22.638070483"
Jul 28 22:05:21.642774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.642729    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6xksh" podStartSLOduration=4.074956072 podStartE2EDuration="22.642719834s" totalImagesPullingTime="18.567763762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:21.627026093 +0000 UTC m=+22.622614676" watchObservedRunningTime="2026-07-28 22:05:21.642719834 +0000 UTC m=+22.638308416"
Jul 28 22:05:21.670479 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.667998    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-211.ec2.internal" podStartSLOduration=21.667984189 podStartE2EDuration="21.667984189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:05:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:21.667466698 +0000 UTC m=+22.663055281" watchObservedRunningTime="2026-07-28 22:05:21.667984189 +0000 UTC m=+22.663572819"
Jul 28 22:05:21.706626 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:21.706578    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pwp9p" podStartSLOduration=3.765594458 podStartE2EDuration="22.706564489s" totalImagesPullingTime="18.940970031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:21.706144168 +0000 UTC m=+22.701732750" watchObservedRunningTime="2026-07-28 22:05:21.706564489 +0000 UTC m=+22.702153070"
Jul 28 22:05:22.316774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:22.316742    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 22:05:22.434328 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:22.434207    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T22:05:22.31676353Z","UUID":"a9d83a7d-12bb-4f4d-a18a-472cc01165d0","Handler":null,"Name":"","Endpoint":""}
Jul 28 22:05:22.435915 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:22.435895    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 22:05:22.436023 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:22.435937    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 22:05:22.502080 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:22.502004    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:22.502278 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:22.502111    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:22.586631 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:22.586409    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal" event={"ID":"56bb828bfe5067d560cc889e080056c0","Type":"ContainerStarted","Data":"054e4989f34af8ee532f4f1da74d456fc65feb604e8d2514eede8540ede4506e"}
Jul 28 22:05:22.588071 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:22.588045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2zltv" event={"ID":"4b21bdb4-7198-4c1a-9fe0-8a9c2735daa0","Type":"ContainerStarted","Data":"e615d6d2df6c7b19991a80c1c8862d1780ed9ac1565f1f33b601da7fa9779bc7"}
Jul 28 22:05:22.590038 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:22.590011    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh" event={"ID":"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77","Type":"ContainerStarted","Data":"2bd490c3b298407c21e9f034e9e1f412dd310b913288bddf2e17534bcc6f31bd"}
Jul 28 22:05:22.602075 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:22.602035    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-211.ec2.internal" podStartSLOduration=22.602023018 podStartE2EDuration="22.602023018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:05:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:22.601499371 +0000 UTC m=+23.597087954" watchObservedRunningTime="2026-07-28 22:05:22.602023018 +0000 UTC m=+23.597611600"
Jul 28 22:05:23.502264 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:23.502238    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:23.502407 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:23.502384    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:23.502465 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:23.502447    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:23.502579 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:23.502557    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:23.596799 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:23.596198    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh" event={"ID":"cd65474d-d6e5-4e5f-8448-ea0ee4db8f77","Type":"ContainerStarted","Data":"a229abfb751ddd72b6bf018842404b8e65f45d84177c85154a62a6150660c261"}
Jul 28 22:05:23.602265 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:23.602241    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:05:23.602794 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:23.602713    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn" event={"ID":"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca","Type":"ContainerStarted","Data":"a121a04667147febfc6de742399509fc8d477559864a57462ac19e688f2d76cf"}
Jul 28 22:05:23.614665 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:23.614595    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2zltv" podStartSLOduration=5.760876481 podStartE2EDuration="24.614577173s" totalImagesPullingTime="18.853700692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:22.61881247 +0000 UTC m=+23.614401052" watchObservedRunningTime="2026-07-28 22:05:23.614577173 +0000 UTC m=+24.610165760"
Jul 28 22:05:23.614980 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:23.614940    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68zmh" podStartSLOduration=3.556662121 podStartE2EDuration="24.61492667s" totalImagesPullingTime="21.058264549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:23.614057082 +0000 UTC m=+24.609645665" watchObservedRunningTime="2026-07-28 22:05:23.61492667 +0000 UTC m=+24.610515255"
Jul 28 22:05:24.035274 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:24.035192    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6xksh"
Jul 28 22:05:24.035818 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:24.035796    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6xksh"
Jul 28 22:05:24.502676 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:24.502652    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:24.502852 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:24.502761    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:24.605389 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:24.605363    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6xksh"
Jul 28 22:05:24.605862 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:24.605845    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6xksh"
Jul 28 22:05:25.502889 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:25.502856    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:25.503055 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:25.502864    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:25.503055 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:25.502982    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:25.503155 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:25.503059    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:26.502319 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:26.502149    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:26.502918 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:26.502395    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:26.612161 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:26.612137    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:05:26.612517 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:26.612494    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn" event={"ID":"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca","Type":"ContainerStarted","Data":"a68179af3f272a907bc94efa6356350eca620d872fa0ca5ae81394d4737649b3"}
Jul 28 22:05:26.612900 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:26.612870    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:26.613028 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:26.612940    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:26.613028 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:26.612963    2564 scope.go:117] "RemoveContainer" containerID="5a3efbc8ada3ba486f1135018e2dbff290107bc43bdda496dd1ab1ee671f81d3"
Jul 28 22:05:26.614389 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:26.614368    2564 generic.go:356] "Generic (PLEG): container finished" podID="1ff19d47-9db7-4182-b0f8-42dea938de24" containerID="e193940c9c6ae088945e199b67dcdf2805cadef0b1d89d2c9a6c416c883ed1f9" exitCode=0
Jul 28 22:05:26.614495 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:26.614402    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdjkx" event={"ID":"1ff19d47-9db7-4182-b0f8-42dea938de24","Type":"ContainerDied","Data":"e193940c9c6ae088945e199b67dcdf2805cadef0b1d89d2c9a6c416c883ed1f9"}
Jul 28 22:05:26.630946 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:26.630924    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:27.502453 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:27.502181    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:27.502867 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:27.502250    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:27.502867 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:27.502575    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:27.502867 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:27.502620    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:27.620690 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:27.620671    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:05:27.621135 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:27.621108    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn" event={"ID":"fe27dde5-04ae-4d2f-9cd4-6e75c4832dca","Type":"ContainerStarted","Data":"7e70a7b1985c87cb9e53088d56d6b3360f9b5e99ecbcefe8a4de22a4b622a490"}
Jul 28 22:05:27.621382 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:27.621364    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:27.623490 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:27.623412    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdjkx" event={"ID":"1ff19d47-9db7-4182-b0f8-42dea938de24","Type":"ContainerStarted","Data":"13363b61c35329c54f27a079cca84f852075e17fc455ede10ad5662fecda8400"}
Jul 28 22:05:27.636622 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:27.636602    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:05:27.645949 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:27.645905    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn" podStartSLOduration=9.65778815 podStartE2EDuration="28.645889051s" totalImagesPullingTime="18.988100901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:27.645110978 +0000 UTC m=+28.640699580" watchObservedRunningTime="2026-07-28 22:05:27.645889051 +0000 UTC m=+28.641477630"
Jul 28 22:05:27.948425 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:27.948338    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-klvjg"]
Jul 28 22:05:27.948584 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:27.948511    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:27.948641 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:27.948599    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:27.951196 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:27.951171    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t6bj4"]
Jul 28 22:05:27.951334 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:27.951263    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:27.951396 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:27.951337    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:27.959586 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:27.959562    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6dm7b"]
Jul 28 22:05:27.959715 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:27.959656    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:27.959758 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:27.959742    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:28.626959 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:28.626925    2564 generic.go:356] "Generic (PLEG): container finished" podID="1ff19d47-9db7-4182-b0f8-42dea938de24" containerID="13363b61c35329c54f27a079cca84f852075e17fc455ede10ad5662fecda8400" exitCode=0
Jul 28 22:05:28.627435 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:28.627011    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdjkx" event={"ID":"1ff19d47-9db7-4182-b0f8-42dea938de24","Type":"ContainerDied","Data":"13363b61c35329c54f27a079cca84f852075e17fc455ede10ad5662fecda8400"}
Jul 28 22:05:29.502980 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:29.502949    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:29.503126 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:29.503025    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:29.503189 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:29.503135    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:29.503269 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:29.503245    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:29.503320 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:29.503306    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:29.503390 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:29.503376    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:30.633348 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:30.633166    2564 generic.go:356] "Generic (PLEG): container finished" podID="1ff19d47-9db7-4182-b0f8-42dea938de24" containerID="aee7143bdb1bf9784c47ab0aee6dbc23cd0cdc86adb2716ed80c57989305a994" exitCode=0
Jul 28 22:05:30.633699 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:30.633245    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdjkx" event={"ID":"1ff19d47-9db7-4182-b0f8-42dea938de24","Type":"ContainerDied","Data":"aee7143bdb1bf9784c47ab0aee6dbc23cd0cdc86adb2716ed80c57989305a994"}
Jul 28 22:05:31.502387 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:31.502361    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:31.502387 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:31.502373    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:31.502620 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:31.502374    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:31.502620 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:31.502478    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:31.502620 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:31.502599    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:31.502764 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:31.502680    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:33.119153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:33.119115    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:33.119153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:33.119158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdbv4\" (UniqueName: \"kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4\") pod \"network-check-target-6dm7b\" (UID: \"92d4ce98-2041-44e4-9acb-9c2e6be92ca0\") " pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:33.119572 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:33.119274    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:33.119572 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:33.119351    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret podName:d268c04e-d61a-493f-a465-5a048e4b815f nodeName:}" failed. No retries permitted until 2026-07-28 22:06:05.119328284 +0000 UTC m=+66.114916847 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret") pod "global-pull-secret-syncer-t6bj4" (UID: "d268c04e-d61a-493f-a465-5a048e4b815f") : object "kube-system"/"original-pull-secret" not registered
Jul 28 22:05:33.119572 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:33.119280    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 22:05:33.119572 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:33.119391    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 22:05:33.119572 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:33.119405    2564 projected.go:196] Error preparing data for projected volume kube-api-access-cdbv4 for pod openshift-network-diagnostics/network-check-target-6dm7b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:33.119572 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:33.119459    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4 podName:92d4ce98-2041-44e4-9acb-9c2e6be92ca0 nodeName:}" failed. No retries permitted until 2026-07-28 22:06:05.119443418 +0000 UTC m=+66.115031981 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cdbv4" (UniqueName: "kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4") pod "network-check-target-6dm7b" (UID: "92d4ce98-2041-44e4-9acb-9c2e6be92ca0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 22:05:33.220203 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:33.220170    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:33.220347 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:33.220320    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:33.220418 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:33.220394    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs podName:f897e87e-7933-43c6-8073-5ed015c336e1 nodeName:}" failed. No retries permitted until 2026-07-28 22:06:05.220373987 +0000 UTC m=+66.215962564 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs") pod "network-metrics-daemon-klvjg" (UID: "f897e87e-7933-43c6-8073-5ed015c336e1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 22:05:33.502497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:33.502424    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:33.502641 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:33.502428    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:33.502641 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:33.502554    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:05:33.502641 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:33.502567    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:33.502758 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:33.502685    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6dm7b" podUID="92d4ce98-2041-44e4-9acb-9c2e6be92ca0"
Jul 28 22:05:33.502797 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:33.502755    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t6bj4" podUID="d268c04e-d61a-493f-a465-5a048e4b815f"
Jul 28 22:05:34.325786 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.325763    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-211.ec2.internal" event="NodeReady"
Jul 28 22:05:34.326246 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.325923    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 22:05:34.408657 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.408618    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qpdrd"]
Jul 28 22:05:34.415809 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.415783    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-scglc"]
Jul 28 22:05:34.415950 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.415918    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:34.418096 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.418065    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 22:05:34.418241 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.418217    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 22:05:34.418492 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.418474    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rvh82\""
Jul 28 22:05:34.423100 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.423081    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-scglc"
Jul 28 22:05:34.424874 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.424857    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 22:05:34.425002 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.424885    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 22:05:34.425002 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.424897    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c8bjt\""
Jul 28 22:05:34.425870 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.425850    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qpdrd"]
Jul 28 22:05:34.426355 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.426175    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 22:05:34.430800 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.430748    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-scglc"]
Jul 28 22:05:34.531285 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.530947    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7dca52ed-50f3-4956-b017-05aadb1710f7-config-volume\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:34.531285 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.530988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:34.531285 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.531031    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dca52ed-50f3-4956-b017-05aadb1710f7-tmp-dir\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:34.531285 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.531076    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae3c4870-bae7-4e87-ba4d-7b2029bb84fd-cert\") pod \"ingress-canary-scglc\" (UID: \"ae3c4870-bae7-4e87-ba4d-7b2029bb84fd\") " pod="openshift-ingress-canary/ingress-canary-scglc"
Jul 28 22:05:34.531285 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.531114    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk94g\" (UniqueName: \"kubernetes.io/projected/ae3c4870-bae7-4e87-ba4d-7b2029bb84fd-kube-api-access-fk94g\") pod \"ingress-canary-scglc\" (UID: \"ae3c4870-bae7-4e87-ba4d-7b2029bb84fd\") " pod="openshift-ingress-canary/ingress-canary-scglc"
Jul 28 22:05:34.531285 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.531145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr8xp\" (UniqueName: \"kubernetes.io/projected/7dca52ed-50f3-4956-b017-05aadb1710f7-kube-api-access-fr8xp\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:34.632125 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.632099    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae3c4870-bae7-4e87-ba4d-7b2029bb84fd-cert\") pod \"ingress-canary-scglc\" (UID: \"ae3c4870-bae7-4e87-ba4d-7b2029bb84fd\") " pod="openshift-ingress-canary/ingress-canary-scglc"
Jul 28 22:05:34.632289 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.632147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk94g\" (UniqueName: \"kubernetes.io/projected/ae3c4870-bae7-4e87-ba4d-7b2029bb84fd-kube-api-access-fk94g\") pod \"ingress-canary-scglc\" (UID: \"ae3c4870-bae7-4e87-ba4d-7b2029bb84fd\") " pod="openshift-ingress-canary/ingress-canary-scglc"
Jul 28 22:05:34.632289 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.632183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr8xp\" (UniqueName: \"kubernetes.io/projected/7dca52ed-50f3-4956-b017-05aadb1710f7-kube-api-access-fr8xp\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:34.632289 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.632220    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7dca52ed-50f3-4956-b017-05aadb1710f7-config-volume\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:34.632289 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.632245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:34.632481 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.632307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dca52ed-50f3-4956-b017-05aadb1710f7-tmp-dir\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:34.632481 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:34.632348    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:05:34.632481 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:34.632404    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls podName:7dca52ed-50f3-4956-b017-05aadb1710f7 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:35.132386812 +0000 UTC m=+36.127975387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls") pod "dns-default-qpdrd" (UID: "7dca52ed-50f3-4956-b017-05aadb1710f7") : secret "dns-default-metrics-tls" not found
Jul 28 22:05:34.632644 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.632627    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dca52ed-50f3-4956-b017-05aadb1710f7-tmp-dir\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:34.632908 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.632893    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7dca52ed-50f3-4956-b017-05aadb1710f7-config-volume\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:34.636341 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.636319    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae3c4870-bae7-4e87-ba4d-7b2029bb84fd-cert\") pod \"ingress-canary-scglc\" (UID: \"ae3c4870-bae7-4e87-ba4d-7b2029bb84fd\") " pod="openshift-ingress-canary/ingress-canary-scglc"
Jul 28 22:05:34.640112 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.640091    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk94g\" (UniqueName: \"kubernetes.io/projected/ae3c4870-bae7-4e87-ba4d-7b2029bb84fd-kube-api-access-fk94g\") pod \"ingress-canary-scglc\" (UID: \"ae3c4870-bae7-4e87-ba4d-7b2029bb84fd\") " pod="openshift-ingress-canary/ingress-canary-scglc"
Jul 28 22:05:34.640771 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.640744    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr8xp\" (UniqueName: \"kubernetes.io/projected/7dca52ed-50f3-4956-b017-05aadb1710f7-kube-api-access-fr8xp\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:34.737130 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.737104    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-scglc"
Jul 28 22:05:34.908643 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:34.908612    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-scglc"]
Jul 28 22:05:34.930795 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:05:34.930772    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3c4870_bae7_4e87_ba4d_7b2029bb84fd.slice/crio-90f278bad7ff2b6157bf3942754396e0baaa3fb04ae9fe4521e62c1f6c1827c7 WatchSource:0}: Error finding container 90f278bad7ff2b6157bf3942754396e0baaa3fb04ae9fe4521e62c1f6c1827c7: Status 404 returned error can't find the container with id 90f278bad7ff2b6157bf3942754396e0baaa3fb04ae9fe4521e62c1f6c1827c7
Jul 28 22:05:35.138141 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:35.137961    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:35.138141 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:35.138103    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:05:35.138307 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:35.138195    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls podName:7dca52ed-50f3-4956-b017-05aadb1710f7 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:36.138180522 +0000 UTC m=+37.133769082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls") pod "dns-default-qpdrd" (UID: "7dca52ed-50f3-4956-b017-05aadb1710f7") : secret "dns-default-metrics-tls" not found
Jul 28 22:05:35.502890 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:35.502864    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:05:35.502890 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:35.502879    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:05:35.503786 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:35.502888    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:05:35.505934 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:35.505681    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-65j7n\""
Jul 28 22:05:35.505934 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:35.505822    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f5pt7\""
Jul 28 22:05:35.505934 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:35.505877    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 22:05:35.505934 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:35.505898    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 22:05:35.506212 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:35.506183    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 22:05:35.506256 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:35.506214    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 22:05:35.646077 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:35.646037    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-scglc" event={"ID":"ae3c4870-bae7-4e87-ba4d-7b2029bb84fd","Type":"ContainerStarted","Data":"90f278bad7ff2b6157bf3942754396e0baaa3fb04ae9fe4521e62c1f6c1827c7"}
Jul 28 22:05:35.649234 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:35.649208    2564 generic.go:356] "Generic (PLEG): container finished" podID="1ff19d47-9db7-4182-b0f8-42dea938de24" containerID="fe9507f1b487767329cf03462a83027076240cf1009994007dbf2a3bb0e61a91" exitCode=0
Jul 28 22:05:35.649366 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:35.649248    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdjkx" event={"ID":"1ff19d47-9db7-4182-b0f8-42dea938de24","Type":"ContainerDied","Data":"fe9507f1b487767329cf03462a83027076240cf1009994007dbf2a3bb0e61a91"}
Jul 28 22:05:36.145979 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:36.145942    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:36.146161 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:36.146093    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:05:36.146161 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:36.146156    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls podName:7dca52ed-50f3-4956-b017-05aadb1710f7 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:38.146142647 +0000 UTC m=+39.141731210 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls") pod "dns-default-qpdrd" (UID: "7dca52ed-50f3-4956-b017-05aadb1710f7") : secret "dns-default-metrics-tls" not found
Jul 28 22:05:36.654957 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:36.654925    2564 generic.go:356] "Generic (PLEG): container finished" podID="1ff19d47-9db7-4182-b0f8-42dea938de24" containerID="47f86e8315dcdb09a9e8bc567317eddde3b245f09558843eac8da9be1c739bf9" exitCode=0
Jul 28 22:05:36.655425 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:36.654958    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdjkx" event={"ID":"1ff19d47-9db7-4182-b0f8-42dea938de24","Type":"ContainerDied","Data":"47f86e8315dcdb09a9e8bc567317eddde3b245f09558843eac8da9be1c739bf9"}
Jul 28 22:05:37.660786 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:37.660750    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gdjkx" event={"ID":"1ff19d47-9db7-4182-b0f8-42dea938de24","Type":"ContainerStarted","Data":"267128babc3f35bf3524a5eac25f76c9b8e07286bd755b26329747ba95f917ff"}
Jul 28 22:05:37.662293 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:37.662264    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-scglc" event={"ID":"ae3c4870-bae7-4e87-ba4d-7b2029bb84fd","Type":"ContainerStarted","Data":"653adc8f3bc80ef7d2eae04f074932aa9ed7c278852e7e5aa3e3987d6494cb3a"}
Jul 28 22:05:37.681601 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:37.681557    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gdjkx" podStartSLOduration=9.106048271 podStartE2EDuration="38.68154493s" totalImagesPullingTime="29.575496659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:37.680917492 +0000 UTC m=+38.676506074" watchObservedRunningTime="2026-07-28 22:05:37.68154493 +0000 UTC m=+38.677133512"
Jul 28 22:05:37.693125 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:37.692967    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-scglc" podStartSLOduration=1.1779182910000001 podStartE2EDuration="3.692951181s" totalImagesPullingTime="2.51503289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:05:37.692944248 +0000 UTC m=+38.688532832" watchObservedRunningTime="2026-07-28 22:05:37.692951181 +0000 UTC m=+38.688539760"
Jul 28 22:05:38.159725 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:38.159690    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:38.159904 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:38.159804    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:05:38.159904 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:38.159889    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls podName:7dca52ed-50f3-4956-b017-05aadb1710f7 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:42.159876773 +0000 UTC m=+43.155465333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls") pod "dns-default-qpdrd" (UID: "7dca52ed-50f3-4956-b017-05aadb1710f7") : secret "dns-default-metrics-tls" not found
Jul 28 22:05:42.186912 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:42.186687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:42.187315 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:42.186869    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:05:42.187315 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:42.187033    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls podName:7dca52ed-50f3-4956-b017-05aadb1710f7 nodeName:}" failed. No retries permitted until 2026-07-28 22:05:50.187015715 +0000 UTC m=+51.182604274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls") pod "dns-default-qpdrd" (UID: "7dca52ed-50f3-4956-b017-05aadb1710f7") : secret "dns-default-metrics-tls" not found
Jul 28 22:05:50.247814 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:50.247777    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:05:50.248289 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:50.247946    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:05:50.248289 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:05:50.248010    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls podName:7dca52ed-50f3-4956-b017-05aadb1710f7 nodeName:}" failed. No retries permitted until 2026-07-28 22:06:06.247993771 +0000 UTC m=+67.243582332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls") pod "dns-default-qpdrd" (UID: "7dca52ed-50f3-4956-b017-05aadb1710f7") : secret "dns-default-metrics-tls" not found
Jul 28 22:05:59.638662 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:05:59.638636    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-srsbn"
Jul 28 22:06:05.142478 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.142446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:06:05.142478 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.142480    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdbv4\" (UniqueName: \"kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4\") pod \"network-check-target-6dm7b\" (UID: \"92d4ce98-2041-44e4-9acb-9c2e6be92ca0\") " pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:06:05.144597 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.144577    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 22:06:05.144645 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.144614    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 22:06:05.154936 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.154903    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 22:06:05.159880 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.159854    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d268c04e-d61a-493f-a465-5a048e4b815f-original-pull-secret\") pod \"global-pull-secret-syncer-t6bj4\" (UID: \"d268c04e-d61a-493f-a465-5a048e4b815f\") " pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:06:05.165992 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.165969    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdbv4\" (UniqueName: \"kubernetes.io/projected/92d4ce98-2041-44e4-9acb-9c2e6be92ca0-kube-api-access-cdbv4\") pod \"network-check-target-6dm7b\" (UID: \"92d4ce98-2041-44e4-9acb-9c2e6be92ca0\") " pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:06:05.217285 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.217261    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-65j7n\""
Jul 28 22:06:05.222633 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.222616    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t6bj4"
Jul 28 22:06:05.226791 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.226767    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:06:05.243688 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.243664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:06:05.245854 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.245822    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 22:06:05.254361 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:06:05.254345    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 22:06:05.254479 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:06:05.254465    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs podName:f897e87e-7933-43c6-8073-5ed015c336e1 nodeName:}" failed. No retries permitted until 2026-07-28 22:07:09.25444351 +0000 UTC m=+130.250032073 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs") pod "network-metrics-daemon-klvjg" (UID: "f897e87e-7933-43c6-8073-5ed015c336e1") : secret "metrics-daemon-secret" not found
Jul 28 22:06:05.373183 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.373153    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t6bj4"]
Jul 28 22:06:05.376358 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:06:05.376332    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd268c04e_d61a_493f_a465_5a048e4b815f.slice/crio-5d90efa6d9f67637892642ac3d01cbdb07165489a58b5ef982a32683abb3d6e3 WatchSource:0}: Error finding container 5d90efa6d9f67637892642ac3d01cbdb07165489a58b5ef982a32683abb3d6e3: Status 404 returned error can't find the container with id 5d90efa6d9f67637892642ac3d01cbdb07165489a58b5ef982a32683abb3d6e3
Jul 28 22:06:05.388584 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.388560    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6dm7b"]
Jul 28 22:06:05.391925 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:06:05.391896    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d4ce98_2041_44e4_9acb_9c2e6be92ca0.slice/crio-1448d52c0cd67ca076618f119893c313b9d9bc8156ad4391b16b9568462c39c3 WatchSource:0}: Error finding container 1448d52c0cd67ca076618f119893c313b9d9bc8156ad4391b16b9568462c39c3: Status 404 returned error can't find the container with id 1448d52c0cd67ca076618f119893c313b9d9bc8156ad4391b16b9568462c39c3
Jul 28 22:06:05.727979 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.727887    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6dm7b" event={"ID":"92d4ce98-2041-44e4-9acb-9c2e6be92ca0","Type":"ContainerStarted","Data":"1448d52c0cd67ca076618f119893c313b9d9bc8156ad4391b16b9568462c39c3"}
Jul 28 22:06:05.728917 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:05.728891    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t6bj4" event={"ID":"d268c04e-d61a-493f-a465-5a048e4b815f","Type":"ContainerStarted","Data":"5d90efa6d9f67637892642ac3d01cbdb07165489a58b5ef982a32683abb3d6e3"}
Jul 28 22:06:06.249875 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:06.249823    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:06:06.250410 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:06:06.249956    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:06:06.250410 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:06:06.250043    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls podName:7dca52ed-50f3-4956-b017-05aadb1710f7 nodeName:}" failed. No retries permitted until 2026-07-28 22:06:38.250020361 +0000 UTC m=+99.245608938 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls") pod "dns-default-qpdrd" (UID: "7dca52ed-50f3-4956-b017-05aadb1710f7") : secret "dns-default-metrics-tls" not found
Jul 28 22:06:10.743579 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:10.743536    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t6bj4" event={"ID":"d268c04e-d61a-493f-a465-5a048e4b815f","Type":"ContainerStarted","Data":"13c41dfecff160c687ffe171511b6ab7bbe812e5c927086b7891ff90604bbc7e"}
Jul 28 22:06:10.744816 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:10.744788    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6dm7b" event={"ID":"92d4ce98-2041-44e4-9acb-9c2e6be92ca0","Type":"ContainerStarted","Data":"17fd596a527d68cf8eed81de39a3e1338c155efb96225bdf6058d738cc5664c5"}
Jul 28 22:06:10.744953 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:10.744939    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:06:10.757672 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:10.757632    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t6bj4" podStartSLOduration=67.3672836 podStartE2EDuration="1m11.75762055s" totalImagesPullingTime="4.39033695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:06:10.757286711 +0000 UTC m=+71.752875317" watchObservedRunningTime="2026-07-28 22:06:10.75762055 +0000 UTC m=+71.753209132"
Jul 28 22:06:10.770367 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:10.770337    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6dm7b" podStartSLOduration=67.398596212 podStartE2EDuration="1m11.770322296s" totalImagesPullingTime="4.371726084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:06:10.77017468 +0000 UTC m=+71.765763263" watchObservedRunningTime="2026-07-28 22:06:10.770322296 +0000 UTC m=+71.765910881"
Jul 28 22:06:34.220012 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.219878    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"]
Jul 28 22:06:34.224108 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.224087    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.227114 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.227088    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 22:06:34.227213 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.227131    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 28 22:06:34.227615 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.227594    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 22:06:34.227842 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.227806    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 28 22:06:34.227842 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.227815    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 28 22:06:34.228011 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.227845    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 28 22:06:34.228011 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.227874    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 22:06:34.235453 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.235434    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"]
Jul 28 22:06:34.335030 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.334990    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bfe4e5d-312d-4069-92ce-7596c03f3376-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.335030 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.335029    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4bfe4e5d-312d-4069-92ce-7596c03f3376-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.335249 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.335053    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4bfe4e5d-312d-4069-92ce-7596c03f3376-ca\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.335249 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.335075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gznzj\" (UniqueName: \"kubernetes.io/projected/4bfe4e5d-312d-4069-92ce-7596c03f3376-kube-api-access-gznzj\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.335249 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.335213    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4bfe4e5d-312d-4069-92ce-7596c03f3376-hub\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.335379 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.335252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4bfe4e5d-312d-4069-92ce-7596c03f3376-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.436037 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.435999    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4bfe4e5d-312d-4069-92ce-7596c03f3376-ca\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.436037 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.436042    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gznzj\" (UniqueName: \"kubernetes.io/projected/4bfe4e5d-312d-4069-92ce-7596c03f3376-kube-api-access-gznzj\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.436200 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.436091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4bfe4e5d-312d-4069-92ce-7596c03f3376-hub\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.436200 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.436107    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4bfe4e5d-312d-4069-92ce-7596c03f3376-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.436200 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.436131    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bfe4e5d-312d-4069-92ce-7596c03f3376-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.436200 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.436147    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4bfe4e5d-312d-4069-92ce-7596c03f3376-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.436922 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.436896    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4bfe4e5d-312d-4069-92ce-7596c03f3376-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.438609 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.438581    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4bfe4e5d-312d-4069-92ce-7596c03f3376-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.438755 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.438734    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4bfe4e5d-312d-4069-92ce-7596c03f3376-hub\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.438955 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.438930    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4bfe4e5d-312d-4069-92ce-7596c03f3376-ca\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.439057 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.438981    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4bfe4e5d-312d-4069-92ce-7596c03f3376-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.450051 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.450022    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gznzj\" (UniqueName: \"kubernetes.io/projected/4bfe4e5d-312d-4069-92ce-7596c03f3376-kube-api-access-gznzj\") pod \"cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p\" (UID: \"4bfe4e5d-312d-4069-92ce-7596c03f3376\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.552904 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.552809    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:06:34.699051 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.699023    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"]
Jul 28 22:06:34.702089 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:06:34.702065    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bfe4e5d_312d_4069_92ce_7596c03f3376.slice/crio-b7afdca2d11157d34390a3a1fb4981ad6cd7a24495b08022b68626f046e1d041 WatchSource:0}: Error finding container b7afdca2d11157d34390a3a1fb4981ad6cd7a24495b08022b68626f046e1d041: Status 404 returned error can't find the container with id b7afdca2d11157d34390a3a1fb4981ad6cd7a24495b08022b68626f046e1d041
Jul 28 22:06:34.802026 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:34.801990    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p" event={"ID":"4bfe4e5d-312d-4069-92ce-7596c03f3376","Type":"ContainerStarted","Data":"b7afdca2d11157d34390a3a1fb4981ad6cd7a24495b08022b68626f046e1d041"}
Jul 28 22:06:38.262925 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:38.262888    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:06:38.263331 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:06:38.263033    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:06:38.263331 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:06:38.263101    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls podName:7dca52ed-50f3-4956-b017-05aadb1710f7 nodeName:}" failed. No retries permitted until 2026-07-28 22:07:42.263073642 +0000 UTC m=+163.258662216 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls") pod "dns-default-qpdrd" (UID: "7dca52ed-50f3-4956-b017-05aadb1710f7") : secret "dns-default-metrics-tls" not found
Jul 28 22:06:38.814954 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:38.814875    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p" event={"ID":"4bfe4e5d-312d-4069-92ce-7596c03f3376","Type":"ContainerStarted","Data":"8db5710177190c57934e418f9646c80adc43233bca23bc74bbd8a0d3e7da01b5"}
Jul 28 22:06:38.814954 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:38.814918    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p" event={"ID":"4bfe4e5d-312d-4069-92ce-7596c03f3376","Type":"ContainerStarted","Data":"4515b8fb2bd2977c2fe2e9b8ac3dbdc9348b6cb87cf04816959af62dd0e7d1f9"}
Jul 28 22:06:38.814954 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:38.814935    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p" event={"ID":"4bfe4e5d-312d-4069-92ce-7596c03f3376","Type":"ContainerStarted","Data":"2e61748061273582443f37d314e80d12953eb0e48ba927c5799bf9cdf10880cd"}
Jul 28 22:06:38.835020 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:38.834976    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p" podStartSLOduration=1.018674122 podStartE2EDuration="4.834962054s" totalImagesPullingTime="3.816287932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:06:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:06:38.833914129 +0000 UTC m=+99.829502710" watchObservedRunningTime="2026-07-28 22:06:38.834962054 +0000 UTC m=+99.830550636"
Jul 28 22:06:41.749474 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:06:41.749445    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6dm7b"
Jul 28 22:07:09.257660 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:07:09.257620    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:07:09.258100 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:07:09.257770    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 22:07:09.258100 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:07:09.257864    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs podName:f897e87e-7933-43c6-8073-5ed015c336e1 nodeName:}" failed. No retries permitted until 2026-07-28 22:09:11.257847023 +0000 UTC m=+252.253435598 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs") pod "network-metrics-daemon-klvjg" (UID: "f897e87e-7933-43c6-8073-5ed015c336e1") : secret "metrics-daemon-secret" not found
Jul 28 22:07:37.427656 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:07:37.427622    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qpdrd" podUID="7dca52ed-50f3-4956-b017-05aadb1710f7"
Jul 28 22:07:37.979786 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:07:37.979758    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:07:38.528756 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:07:38.528710    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:07:42.277604 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:07:42.277559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:07:42.278043 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:07:42.277675    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 22:07:42.278043 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:07:42.277725    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls podName:7dca52ed-50f3-4956-b017-05aadb1710f7 nodeName:}" failed. No retries permitted until 2026-07-28 22:09:44.277712887 +0000 UTC m=+285.273301446 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls") pod "dns-default-qpdrd" (UID: "7dca52ed-50f3-4956-b017-05aadb1710f7") : secret "dns-default-metrics-tls" not found
Jul 28 22:07:53.502226 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:07:53.502144    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:09:01.407652 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.407624    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4"]
Jul 28 22:09:01.410316 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.410299    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4"
Jul 28 22:09:01.413819 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.413796    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 28 22:09:01.414433 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.414418    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 28 22:09:01.415141 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.415123    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 28 22:09:01.415418 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.415403    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bsnzd\""
Jul 28 22:09:01.415750 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.415733    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 28 22:09:01.420149 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.420128    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4"]
Jul 28 22:09:01.498145 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.498123    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11c8fe10-4233-4115-9ed1-5802ccf58d4c-serving-cert\") pod \"service-ca-operator-5d6c75f84f-7hqd4\" (UID: \"11c8fe10-4233-4115-9ed1-5802ccf58d4c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4"
Jul 28 22:09:01.498264 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.498151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8tkp\" (UniqueName: \"kubernetes.io/projected/11c8fe10-4233-4115-9ed1-5802ccf58d4c-kube-api-access-d8tkp\") pod \"service-ca-operator-5d6c75f84f-7hqd4\" (UID: \"11c8fe10-4233-4115-9ed1-5802ccf58d4c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4"
Jul 28 22:09:01.498264 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.498194    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11c8fe10-4233-4115-9ed1-5802ccf58d4c-config\") pod \"service-ca-operator-5d6c75f84f-7hqd4\" (UID: \"11c8fe10-4233-4115-9ed1-5802ccf58d4c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4"
Jul 28 22:09:01.598713 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.598676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11c8fe10-4233-4115-9ed1-5802ccf58d4c-serving-cert\") pod \"service-ca-operator-5d6c75f84f-7hqd4\" (UID: \"11c8fe10-4233-4115-9ed1-5802ccf58d4c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4"
Jul 28 22:09:01.598713 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.598716    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8tkp\" (UniqueName: \"kubernetes.io/projected/11c8fe10-4233-4115-9ed1-5802ccf58d4c-kube-api-access-d8tkp\") pod \"service-ca-operator-5d6c75f84f-7hqd4\" (UID: \"11c8fe10-4233-4115-9ed1-5802ccf58d4c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4"
Jul 28 22:09:01.598935 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.598751    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11c8fe10-4233-4115-9ed1-5802ccf58d4c-config\") pod \"service-ca-operator-5d6c75f84f-7hqd4\" (UID: \"11c8fe10-4233-4115-9ed1-5802ccf58d4c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4"
Jul 28 22:09:01.599273 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.599248    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11c8fe10-4233-4115-9ed1-5802ccf58d4c-config\") pod \"service-ca-operator-5d6c75f84f-7hqd4\" (UID: \"11c8fe10-4233-4115-9ed1-5802ccf58d4c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4"
Jul 28 22:09:01.600971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.600953    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11c8fe10-4233-4115-9ed1-5802ccf58d4c-serving-cert\") pod \"service-ca-operator-5d6c75f84f-7hqd4\" (UID: \"11c8fe10-4233-4115-9ed1-5802ccf58d4c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4"
Jul 28 22:09:01.606172 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.606150    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8tkp\" (UniqueName: \"kubernetes.io/projected/11c8fe10-4233-4115-9ed1-5802ccf58d4c-kube-api-access-d8tkp\") pod \"service-ca-operator-5d6c75f84f-7hqd4\" (UID: \"11c8fe10-4233-4115-9ed1-5802ccf58d4c\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4"
Jul 28 22:09:01.718646 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.718570    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4"
Jul 28 22:09:01.866441 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:01.866401    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4"]
Jul 28 22:09:01.870354 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:09:01.870324    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c8fe10_4233_4115_9ed1_5802ccf58d4c.slice/crio-5538508c815c0dc2cfda861b7c4046132d074c17e9d314adf285695812636429 WatchSource:0}: Error finding container 5538508c815c0dc2cfda861b7c4046132d074c17e9d314adf285695812636429: Status 404 returned error can't find the container with id 5538508c815c0dc2cfda861b7c4046132d074c17e9d314adf285695812636429
Jul 28 22:09:02.209337 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:02.209306    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4" event={"ID":"11c8fe10-4233-4115-9ed1-5802ccf58d4c","Type":"ContainerStarted","Data":"5538508c815c0dc2cfda861b7c4046132d074c17e9d314adf285695812636429"}
Jul 28 22:09:05.218818 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:05.218780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4" event={"ID":"11c8fe10-4233-4115-9ed1-5802ccf58d4c","Type":"ContainerStarted","Data":"703fb07ed94cc2758233187f7ea8a9c25630da5dce9183229f9e4f7d342089e4"}
Jul 28 22:09:05.234289 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:05.234239    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4" podStartSLOduration=1.839758711 podStartE2EDuration="4.23422592s" totalImagesPullingTime="2.394467209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:05.234079901 +0000 UTC m=+246.229668486" watchObservedRunningTime="2026-07-28 22:09:05.23422592 +0000 UTC m=+246.229814502"
Jul 28 22:09:06.918180 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:06.918141    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6nj6n"]
Jul 28 22:09:06.921242 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:06.921223    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:06.923401 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:06.923373    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 22:09:06.923401 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:06.923392    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 22:09:06.923984 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:06.923968    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 22:09:06.924070 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:06.924001    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t4cf9\""
Jul 28 22:09:06.924070 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:06.924001    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 22:09:06.932137 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:06.932117    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6nj6n"]
Jul 28 22:09:07.035777 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:07.035751    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:07.035892 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:07.035780    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-crio-socket\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:07.035892 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:07.035798    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts7p9\" (UniqueName: \"kubernetes.io/projected/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-api-access-ts7p9\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:07.035892 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:07.035824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-data-volume\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:07.035996 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:07.035896    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:07.136391 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:07.136362    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:07.136391 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:07.136393    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-crio-socket\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:07.136552 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:07.136414    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts7p9\" (UniqueName: \"kubernetes.io/projected/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-api-access-ts7p9\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:07.136552 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:07.136446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-data-volume\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:07.136552 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:07.136502    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-crio-socket\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:07.136552 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:07.136531    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:07.136699 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:07.136598    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls podName:2b0c1ef3-8729-490a-ab6c-4eda696fa58f nodeName:}" failed. No retries permitted until 2026-07-28 22:09:07.636579831 +0000 UTC m=+248.632168406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6nj6n" (UID: "2b0c1ef3-8729-490a-ab6c-4eda696fa58f") : secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:07.136699 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:07.136626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:07.136780 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:07.136711    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 22:09:07.136780 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:07.136769    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm podName:2b0c1ef3-8729-490a-ab6c-4eda696fa58f nodeName:}" failed. No retries permitted until 2026-07-28 22:09:07.636753755 +0000 UTC m=+248.632342315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6nj6n" (UID: "2b0c1ef3-8729-490a-ab6c-4eda696fa58f") : configmap "kube-rbac-proxy" not found
Jul 28 22:09:07.136872 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:07.136777    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-data-volume\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:07.157650 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:07.157623    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts7p9\" (UniqueName: \"kubernetes.io/projected/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-api-access-ts7p9\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:07.640358 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:07.640330    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:07.640509 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:07.640376    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:07.640509 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:07.640446    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 22:09:07.640509 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:07.640478    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:07.640509 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:07.640506    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm podName:2b0c1ef3-8729-490a-ab6c-4eda696fa58f nodeName:}" failed. No retries permitted until 2026-07-28 22:09:08.640486848 +0000 UTC m=+249.636075411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6nj6n" (UID: "2b0c1ef3-8729-490a-ab6c-4eda696fa58f") : configmap "kube-rbac-proxy" not found
Jul 28 22:09:07.640643 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:07.640520    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls podName:2b0c1ef3-8729-490a-ab6c-4eda696fa58f nodeName:}" failed. No retries permitted until 2026-07-28 22:09:08.64051418 +0000 UTC m=+249.636102740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6nj6n" (UID: "2b0c1ef3-8729-490a-ab6c-4eda696fa58f") : secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:08.039065 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:08.038993    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-8pdqj"]
Jul 28 22:09:08.041909 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:08.041894    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-8pdqj"
Jul 28 22:09:08.044275 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:08.044250    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-211.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca\": no relationship found between node 'ip-10-0-134-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 28 22:09:08.044429 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:08.044405    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"service-ca-dockercfg-s7njm\" is forbidden: User \"system:node:ip-10-0-134-211.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca\": no relationship found between node 'ip-10-0-134-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-s7njm\"" type="*v1.Secret"
Jul 28 22:09:08.044539 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:08.044514    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"signing-cabundle\" is forbidden: User \"system:node:ip-10-0-134-211.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca\": no relationship found between node 'ip-10-0-134-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" type="*v1.ConfigMap"
Jul 28 22:09:08.044599 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:08.044563    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-211.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca\": no relationship found between node 'ip-10-0-134-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 28 22:09:08.044640 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:08.044613    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"signing-key\" is forbidden: User \"system:node:ip-10-0-134-211.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca\": no relationship found between node 'ip-10-0-134-211.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca\"/\"signing-key\"" type="*v1.Secret"
Jul 28 22:09:08.064444 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:08.064423    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-8pdqj"]
Jul 28 22:09:08.143674 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:08.143656    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4d95\" (UniqueName: \"kubernetes.io/projected/49de30e9-b8de-4130-a6e7-76bc7ae71e46-kube-api-access-c4d95\") pod \"service-ca-658d7b7c78-8pdqj\" (UID: \"49de30e9-b8de-4130-a6e7-76bc7ae71e46\") " pod="openshift-service-ca/service-ca-658d7b7c78-8pdqj"
Jul 28 22:09:08.143776 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:08.143685    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/49de30e9-b8de-4130-a6e7-76bc7ae71e46-signing-cabundle\") pod \"service-ca-658d7b7c78-8pdqj\" (UID: \"49de30e9-b8de-4130-a6e7-76bc7ae71e46\") " pod="openshift-service-ca/service-ca-658d7b7c78-8pdqj"
Jul 28 22:09:08.143776 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:08.143704    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/49de30e9-b8de-4130-a6e7-76bc7ae71e46-signing-key\") pod \"service-ca-658d7b7c78-8pdqj\" (UID: \"49de30e9-b8de-4130-a6e7-76bc7ae71e46\") " pod="openshift-service-ca/service-ca-658d7b7c78-8pdqj"
Jul 28 22:09:08.244791 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:08.244768    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4d95\" (UniqueName: \"kubernetes.io/projected/49de30e9-b8de-4130-a6e7-76bc7ae71e46-kube-api-access-c4d95\") pod \"service-ca-658d7b7c78-8pdqj\" (UID: \"49de30e9-b8de-4130-a6e7-76bc7ae71e46\") " pod="openshift-service-ca/service-ca-658d7b7c78-8pdqj"
Jul 28 22:09:08.244913 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:08.244801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/49de30e9-b8de-4130-a6e7-76bc7ae71e46-signing-cabundle\") pod \"service-ca-658d7b7c78-8pdqj\" (UID: \"49de30e9-b8de-4130-a6e7-76bc7ae71e46\") " pod="openshift-service-ca/service-ca-658d7b7c78-8pdqj"
Jul 28 22:09:08.244913 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:08.244847    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/49de30e9-b8de-4130-a6e7-76bc7ae71e46-signing-key\") pod \"service-ca-658d7b7c78-8pdqj\" (UID: \"49de30e9-b8de-4130-a6e7-76bc7ae71e46\") " pod="openshift-service-ca/service-ca-658d7b7c78-8pdqj"
Jul 28 22:09:08.648187 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:08.648156    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:08.648332 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:08.648216    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:08.648332 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:08.648287    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 22:09:08.648413 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:08.648336    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm podName:2b0c1ef3-8729-490a-ab6c-4eda696fa58f nodeName:}" failed. No retries permitted until 2026-07-28 22:09:10.648323528 +0000 UTC m=+251.643912091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6nj6n" (UID: "2b0c1ef3-8729-490a-ab6c-4eda696fa58f") : configmap "kube-rbac-proxy" not found
Jul 28 22:09:08.648413 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:08.648287    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:08.648413 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:08.648409    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls podName:2b0c1ef3-8729-490a-ab6c-4eda696fa58f nodeName:}" failed. No retries permitted until 2026-07-28 22:09:10.648397191 +0000 UTC m=+251.643985765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6nj6n" (UID: "2b0c1ef3-8729-490a-ab6c-4eda696fa58f") : secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:08.703367 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:08.703343    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dctt5_6824e8d1-ee18-41fb-aaa6-3a914506cef5/dns-node-resolver/0.log"
Jul 28 22:09:08.898798 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:08.898728    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 28 22:09:08.907926 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:08.907907    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/49de30e9-b8de-4130-a6e7-76bc7ae71e46-signing-key\") pod \"service-ca-658d7b7c78-8pdqj\" (UID: \"49de30e9-b8de-4130-a6e7-76bc7ae71e46\") " pod="openshift-service-ca/service-ca-658d7b7c78-8pdqj"
Jul 28 22:09:08.964323 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:08.964304    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-s7njm\""
Jul 28 22:09:09.152136 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:09.152074    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 28 22:09:09.155669 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:09.155652    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/49de30e9-b8de-4130-a6e7-76bc7ae71e46-signing-cabundle\") pod \"service-ca-658d7b7c78-8pdqj\" (UID: \"49de30e9-b8de-4130-a6e7-76bc7ae71e46\") " pod="openshift-service-ca/service-ca-658d7b7c78-8pdqj"
Jul 28 22:09:09.250825 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:09.250802    2564 projected.go:291] Couldn't get configMap openshift-service-ca/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 28 22:09:09.377644 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:09.377625    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 28 22:09:09.514326 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:09.514272    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 28 22:09:09.521102 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:09.521089    2564 projected.go:196] Error preparing data for projected volume kube-api-access-c4d95 for pod openshift-service-ca/service-ca-658d7b7c78-8pdqj: failed to sync configmap cache: timed out waiting for the condition
Jul 28 22:09:09.521157 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:09.521137    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49de30e9-b8de-4130-a6e7-76bc7ae71e46-kube-api-access-c4d95 podName:49de30e9-b8de-4130-a6e7-76bc7ae71e46 nodeName:}" failed. No retries permitted until 2026-07-28 22:09:10.021123773 +0000 UTC m=+251.016712333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c4d95" (UniqueName: "kubernetes.io/projected/49de30e9-b8de-4130-a6e7-76bc7ae71e46-kube-api-access-c4d95") pod "service-ca-658d7b7c78-8pdqj" (UID: "49de30e9-b8de-4130-a6e7-76bc7ae71e46") : failed to sync configmap cache: timed out waiting for the condition
Jul 28 22:09:09.901105 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:09.901082    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jf2mm_04ea5950-65fd-407e-aadc-392852a3a0bc/node-ca/0.log"
Jul 28 22:09:10.059513 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:10.059475    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4d95\" (UniqueName: \"kubernetes.io/projected/49de30e9-b8de-4130-a6e7-76bc7ae71e46-kube-api-access-c4d95\") pod \"service-ca-658d7b7c78-8pdqj\" (UID: \"49de30e9-b8de-4130-a6e7-76bc7ae71e46\") " pod="openshift-service-ca/service-ca-658d7b7c78-8pdqj"
Jul 28 22:09:10.062001 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:10.061984    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4d95\" (UniqueName: \"kubernetes.io/projected/49de30e9-b8de-4130-a6e7-76bc7ae71e46-kube-api-access-c4d95\") pod \"service-ca-658d7b7c78-8pdqj\" (UID: \"49de30e9-b8de-4130-a6e7-76bc7ae71e46\") " pod="openshift-service-ca/service-ca-658d7b7c78-8pdqj"
Jul 28 22:09:10.151076 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:10.151039    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-8pdqj"
Jul 28 22:09:10.272148 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:10.272043    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-8pdqj"]
Jul 28 22:09:10.275788 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:09:10.275764    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49de30e9_b8de_4130_a6e7_76bc7ae71e46.slice/crio-35c06ad16380411c6e1b4378e0559318ed3c0694124a384a315829c4ac7cbd26 WatchSource:0}: Error finding container 35c06ad16380411c6e1b4378e0559318ed3c0694124a384a315829c4ac7cbd26: Status 404 returned error can't find the container with id 35c06ad16380411c6e1b4378e0559318ed3c0694124a384a315829c4ac7cbd26
Jul 28 22:09:10.664216 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:10.664190    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:10.664401 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:10.664246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:10.664401 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:10.664310    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 22:09:10.664401 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:10.664340    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:10.664401 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:10.664360    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm podName:2b0c1ef3-8729-490a-ab6c-4eda696fa58f nodeName:}" failed. No retries permitted until 2026-07-28 22:09:14.664346065 +0000 UTC m=+255.659934624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6nj6n" (UID: "2b0c1ef3-8729-490a-ab6c-4eda696fa58f") : configmap "kube-rbac-proxy" not found
Jul 28 22:09:10.664401 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:10.664395    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls podName:2b0c1ef3-8729-490a-ab6c-4eda696fa58f nodeName:}" failed. No retries permitted until 2026-07-28 22:09:14.664379162 +0000 UTC m=+255.659967742 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6nj6n" (UID: "2b0c1ef3-8729-490a-ab6c-4eda696fa58f") : secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:10.701512 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:10.701484    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-scglc_ae3c4870-bae7-4e87-ba4d-7b2029bb84fd/serve-healthcheck-canary/0.log"
Jul 28 22:09:11.235705 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:11.235672    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-8pdqj" event={"ID":"49de30e9-b8de-4130-a6e7-76bc7ae71e46","Type":"ContainerStarted","Data":"06fdcc011f0b13d0a5c48b5600cf69ad3b4e6237f58e83c7dcdcd6e8b8d79471"}
Jul 28 22:09:11.235905 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:11.235718    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-8pdqj" event={"ID":"49de30e9-b8de-4130-a6e7-76bc7ae71e46","Type":"ContainerStarted","Data":"35c06ad16380411c6e1b4378e0559318ed3c0694124a384a315829c4ac7cbd26"}
Jul 28 22:09:11.267068 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:11.267023    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-8pdqj" podStartSLOduration=3.267007615 podStartE2EDuration="3.267007615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:11.266422601 +0000 UTC m=+252.262011185" watchObservedRunningTime="2026-07-28 22:09:11.267007615 +0000 UTC m=+252.262596197"
Jul 28 22:09:11.268651 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:11.268624    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:09:11.268793 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:11.268777    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 22:09:11.268871 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:11.268856    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs podName:f897e87e-7933-43c6-8073-5ed015c336e1 nodeName:}" failed. No retries permitted until 2026-07-28 22:11:13.268838279 +0000 UTC m=+374.264426854 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs") pod "network-metrics-daemon-klvjg" (UID: "f897e87e-7933-43c6-8073-5ed015c336e1") : secret "metrics-daemon-secret" not found
Jul 28 22:09:14.695646 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:14.695611    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:14.696074 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:14.695717    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:14.696074 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:14.695756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:14.696074 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:14.695764    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls podName:2b0c1ef3-8729-490a-ab6c-4eda696fa58f nodeName:}" failed. No retries permitted until 2026-07-28 22:09:22.69575088 +0000 UTC m=+263.691339439 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6nj6n" (UID: "2b0c1ef3-8729-490a-ab6c-4eda696fa58f") : secret "insights-runtime-extractor-tls" not found
Jul 28 22:09:14.696074 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:14.695873    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 22:09:14.696074 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:14.695919    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm podName:2b0c1ef3-8729-490a-ab6c-4eda696fa58f nodeName:}" failed. No retries permitted until 2026-07-28 22:09:22.695908202 +0000 UTC m=+263.691496762 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6nj6n" (UID: "2b0c1ef3-8729-490a-ab6c-4eda696fa58f") : configmap "kube-rbac-proxy" not found
Jul 28 22:09:22.752926 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:22.752849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:22.752926 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:22.752911    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:22.753345 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:22.753328    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:22.755114 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:22.755095    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b0c1ef3-8729-490a-ab6c-4eda696fa58f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6nj6n\" (UID: \"2b0c1ef3-8729-490a-ab6c-4eda696fa58f\") " pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:22.829889 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:22.829854    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6nj6n"
Jul 28 22:09:22.949410 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:22.949382    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6nj6n"]
Jul 28 22:09:22.952227 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:09:22.952204    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0c1ef3_8729_490a_ab6c_4eda696fa58f.slice/crio-3a9884ca602ef7250a071a67d9ac774c9e19533ba8b416d52b2505a2dbde03ef WatchSource:0}: Error finding container 3a9884ca602ef7250a071a67d9ac774c9e19533ba8b416d52b2505a2dbde03ef: Status 404 returned error can't find the container with id 3a9884ca602ef7250a071a67d9ac774c9e19533ba8b416d52b2505a2dbde03ef
Jul 28 22:09:23.272529 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:23.272490    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nj6n" event={"ID":"2b0c1ef3-8729-490a-ab6c-4eda696fa58f","Type":"ContainerStarted","Data":"3a9884ca602ef7250a071a67d9ac774c9e19533ba8b416d52b2505a2dbde03ef"}
Jul 28 22:09:24.554137 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:24.554065    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p" podUID="4bfe4e5d-312d-4069-92ce-7596c03f3376" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 28 22:09:28.289428 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:28.289348    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nj6n" event={"ID":"2b0c1ef3-8729-490a-ab6c-4eda696fa58f","Type":"ContainerStarted","Data":"3cb4dc33470218bded023e819c8c1c5a4e921a284562a97281880e7a8fd0579e"}
Jul 28 22:09:29.151767 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:29.151736    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-g8777"]
Jul 28 22:09:29.154659 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:29.154640    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-g8777"
Jul 28 22:09:29.156642 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:29.156615    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 22:09:29.156748 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:29.156695    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-8v5t4\""
Jul 28 22:09:29.156874 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:29.156823    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 22:09:29.165086 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:29.165066    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-g8777"]
Jul 28 22:09:29.298716 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:29.298685    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgdbh\" (UniqueName: \"kubernetes.io/projected/4eae46d2-636c-4978-b970-d238535e0f06-kube-api-access-xgdbh\") pod \"downloads-7c97dc4555-g8777\" (UID: \"4eae46d2-636c-4978-b970-d238535e0f06\") " pod="openshift-console/downloads-7c97dc4555-g8777"
Jul 28 22:09:29.399878 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:29.399850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgdbh\" (UniqueName: \"kubernetes.io/projected/4eae46d2-636c-4978-b970-d238535e0f06-kube-api-access-xgdbh\") pod \"downloads-7c97dc4555-g8777\" (UID: \"4eae46d2-636c-4978-b970-d238535e0f06\") " pod="openshift-console/downloads-7c97dc4555-g8777"
Jul 28 22:09:29.407931 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:29.407873    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgdbh\" (UniqueName: \"kubernetes.io/projected/4eae46d2-636c-4978-b970-d238535e0f06-kube-api-access-xgdbh\") pod \"downloads-7c97dc4555-g8777\" (UID: \"4eae46d2-636c-4978-b970-d238535e0f06\") " pod="openshift-console/downloads-7c97dc4555-g8777"
Jul 28 22:09:29.465751 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:29.465708    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-g8777"
Jul 28 22:09:31.239148 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:31.239115    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-g8777"]
Jul 28 22:09:31.259593 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:09:31.259564    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eae46d2_636c_4978_b970_d238535e0f06.slice/crio-db9b362c9a4ffb6e648c1378127e3154d1b58f65a49110f62445cec13fc687bc WatchSource:0}: Error finding container db9b362c9a4ffb6e648c1378127e3154d1b58f65a49110f62445cec13fc687bc: Status 404 returned error can't find the container with id db9b362c9a4ffb6e648c1378127e3154d1b58f65a49110f62445cec13fc687bc
Jul 28 22:09:31.300101 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:31.300068    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-g8777" event={"ID":"4eae46d2-636c-4978-b970-d238535e0f06","Type":"ContainerStarted","Data":"db9b362c9a4ffb6e648c1378127e3154d1b58f65a49110f62445cec13fc687bc"}
Jul 28 22:09:32.305580 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:32.305540    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nj6n" event={"ID":"2b0c1ef3-8729-490a-ab6c-4eda696fa58f","Type":"ContainerStarted","Data":"a67fbed989b6e46e4a7c5340a6248bd462ba799b10a2d27968afd3fab22c1bb0"}
Jul 28 22:09:34.554551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:34.554514    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p" podUID="4bfe4e5d-312d-4069-92ce-7596c03f3376" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 28 22:09:35.319632 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:35.319595    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6nj6n" event={"ID":"2b0c1ef3-8729-490a-ab6c-4eda696fa58f","Type":"ContainerStarted","Data":"fb59c90f45ca9ab45f7299727e141f83a50674715c6e6f43aef0e59ccdb0b7cc"}
Jul 28 22:09:35.339574 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:35.339525    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6nj6n" podStartSLOduration=17.187962065 podStartE2EDuration="29.339507157s" totalImagesPullingTime="12.151545092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 22:09:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:35.33899943 +0000 UTC m=+276.334588013" watchObservedRunningTime="2026-07-28 22:09:35.339507157 +0000 UTC m=+276.335095740"
Jul 28 22:09:36.675123 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.675089    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dfdd98d4c-ll2mv"]
Jul 28 22:09:36.678409 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.678390    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.680737 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.680486    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 22:09:36.680737 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.680546    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 22:09:36.680737 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.680564    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 22:09:36.680737 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.680515    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 22:09:36.681222 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.681201    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 22:09:36.681332 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.681235    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2m99s\""
Jul 28 22:09:36.689869 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.689849    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dfdd98d4c-ll2mv"]
Jul 28 22:09:36.757648 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.757621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-oauth-config\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.757799 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.757665    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-oauth-serving-cert\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.757799 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.757727    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-service-ca\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.757799 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.757780    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thstc\" (UniqueName: \"kubernetes.io/projected/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-kube-api-access-thstc\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.757938 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.757872    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-serving-cert\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.757938 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.757901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-config\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.858373 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.858338    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-serving-cert\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.858535 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.858398    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-config\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.858535 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.858445    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-oauth-config\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.858535 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.858483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-oauth-serving-cert\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.858535 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.858517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-service-ca\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.858757 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.858628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thstc\" (UniqueName: \"kubernetes.io/projected/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-kube-api-access-thstc\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.859498 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.859197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-config\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.859498 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.859445    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-oauth-serving-cert\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.859498 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.859445    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-service-ca\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.861297 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.861277    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-oauth-config\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.861431 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.861409    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-serving-cert\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.867692 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.867650    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thstc\" (UniqueName: \"kubernetes.io/projected/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-kube-api-access-thstc\") pod \"console-6dfdd98d4c-ll2mv\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") " pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:36.988568 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:36.988492    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:37.137296 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:37.137234    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dfdd98d4c-ll2mv"]
Jul 28 22:09:37.137913 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:09:37.137884    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5434eed9_9a95_4dae_aa18_e5b8d4bc9c89.slice/crio-21c4199ccc099c7b21e5231930af279b2dc14a47ef937801563e8c3940389fd2 WatchSource:0}: Error finding container 21c4199ccc099c7b21e5231930af279b2dc14a47ef937801563e8c3940389fd2: Status 404 returned error can't find the container with id 21c4199ccc099c7b21e5231930af279b2dc14a47ef937801563e8c3940389fd2
Jul 28 22:09:37.328235 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:37.328154    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfdd98d4c-ll2mv" event={"ID":"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89","Type":"ContainerStarted","Data":"21c4199ccc099c7b21e5231930af279b2dc14a47ef937801563e8c3940389fd2"}
Jul 28 22:09:40.980577 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:40.980524    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qpdrd" podUID="7dca52ed-50f3-4956-b017-05aadb1710f7"
Jul 28 22:09:41.344553 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:41.344462    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfdd98d4c-ll2mv" event={"ID":"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89","Type":"ContainerStarted","Data":"ec08c44cc1d9418cb88c05a33661fb2bc8999f4a87eb5ec36aab34b7f2bf1148"}
Jul 28 22:09:41.344553 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:41.344519    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:09:41.361161 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:41.361115    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dfdd98d4c-ll2mv" podStartSLOduration=2.136955489 podStartE2EDuration="5.361100396s" totalImagesPullingTime="3.224144907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:41.359503155 +0000 UTC m=+282.355091757" watchObservedRunningTime="2026-07-28 22:09:41.361100396 +0000 UTC m=+282.356688978"
Jul 28 22:09:43.645031 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.644278    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d7bq6"]
Jul 28 22:09:43.649919 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.649883    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.652459 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.652437    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 22:09:43.653292 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.653123    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 22:09:43.653292 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.653172    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 22:09:43.653292 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.653202    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 22:09:43.653781 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.653761    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 22:09:43.653983 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.653969    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 22:09:43.654144 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.654128    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rhrfd\""
Jul 28 22:09:43.817142 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.817104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60962d72-378f-4849-8ee9-12a0b8647cbc-sys\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.817318 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.817168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-textfile\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.817318 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.817197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-wtmp\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.817318 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.817220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60962d72-378f-4849-8ee9-12a0b8647cbc-metrics-client-ca\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.817318 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.817250    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-accelerators-collector-config\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.817318 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.817279    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdkw5\" (UniqueName: \"kubernetes.io/projected/60962d72-378f-4849-8ee9-12a0b8647cbc-kube-api-access-cdkw5\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.817555 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.817325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/60962d72-378f-4849-8ee9-12a0b8647cbc-root\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.817555 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.817349    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-tls\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.817555 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.817387    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.918058 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.917978    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60962d72-378f-4849-8ee9-12a0b8647cbc-sys\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.918058 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.918035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-textfile\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.918277 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.918061    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-wtmp\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.918277 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.918086    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60962d72-378f-4849-8ee9-12a0b8647cbc-metrics-client-ca\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.918277 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.918103    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60962d72-378f-4849-8ee9-12a0b8647cbc-sys\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.918277 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.918118    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-accelerators-collector-config\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.918277 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.918161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdkw5\" (UniqueName: \"kubernetes.io/projected/60962d72-378f-4849-8ee9-12a0b8647cbc-kube-api-access-cdkw5\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.918277 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.918215    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-wtmp\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.918277 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.918219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/60962d72-378f-4849-8ee9-12a0b8647cbc-root\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.918277 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.918259    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/60962d72-378f-4849-8ee9-12a0b8647cbc-root\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.918277 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.918269    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-tls\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.918780 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.918316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.918780 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.918398    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-textfile\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.918780 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:43.918495    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 22:09:43.918780 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:43.918554    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-tls podName:60962d72-378f-4849-8ee9-12a0b8647cbc nodeName:}" failed. No retries permitted until 2026-07-28 22:09:44.418534642 +0000 UTC m=+285.414123206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-tls") pod "node-exporter-d7bq6" (UID: "60962d72-378f-4849-8ee9-12a0b8647cbc") : secret "node-exporter-tls" not found
Jul 28 22:09:43.918780 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.918667    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-accelerators-collector-config\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.918780 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.918743    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60962d72-378f-4849-8ee9-12a0b8647cbc-metrics-client-ca\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.920771 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.920747    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:43.926819 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:43.926793    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdkw5\" (UniqueName: \"kubernetes.io/projected/60962d72-378f-4849-8ee9-12a0b8647cbc-kube-api-access-cdkw5\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:44.321655 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.321576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:09:44.324015 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.323989    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dca52ed-50f3-4956-b017-05aadb1710f7-metrics-tls\") pod \"dns-default-qpdrd\" (UID: \"7dca52ed-50f3-4956-b017-05aadb1710f7\") " pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:09:44.346965 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.346940    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rvh82\""
Jul 28 22:09:44.355626 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.355601    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:09:44.422359 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.422333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-tls\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:44.424601 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.424577    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/60962d72-378f-4849-8ee9-12a0b8647cbc-node-exporter-tls\") pod \"node-exporter-d7bq6\" (UID: \"60962d72-378f-4849-8ee9-12a0b8647cbc\") " pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:44.554236 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.554188    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p" podUID="4bfe4e5d-312d-4069-92ce-7596c03f3376" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 28 22:09:44.554395 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.554283    2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p"
Jul 28 22:09:44.554941 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.554899    2564 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"8db5710177190c57934e418f9646c80adc43233bca23bc74bbd8a0d3e7da01b5"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 28 22:09:44.555063 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.554969    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p" podUID="4bfe4e5d-312d-4069-92ce-7596c03f3376" containerName="service-proxy" containerID="cri-o://8db5710177190c57934e418f9646c80adc43233bca23bc74bbd8a0d3e7da01b5" gracePeriod=30
Jul 28 22:09:44.561973 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.561954    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d7bq6"
Jul 28 22:09:44.707724 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.707692    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 22:09:44.711585 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.711558    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.713269 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.713245    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 28 22:09:44.713777 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.713567    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 28 22:09:44.713777 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.713634    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 28 22:09:44.713777 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.713671    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 28 22:09:44.713777 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.713570    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 28 22:09:44.714160 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.714001    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r42x5\""
Jul 28 22:09:44.714160 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.714009    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 28 22:09:44.714160 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.714088    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 28 22:09:44.714160 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.714149    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 28 22:09:44.714438 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.714285    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 28 22:09:44.733112 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.733092    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 22:09:44.826128 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.826091    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-config-volume\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.826128 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.826130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.826321 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.826160    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.826321 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.826246    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.826321 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.826273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.826321 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.826294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.826321 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.826321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-web-config\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.826559 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.826357    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzhfv\" (UniqueName: \"kubernetes.io/projected/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-kube-api-access-pzhfv\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.826559 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.826439    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.826559 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.826480    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-config-out\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.826559 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.826505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.826741 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.826576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.826741 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.826626    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.927470 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.927434    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.927634 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.927484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.927634 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.927507    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.927634 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.927533    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.927634 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.927561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-web-config\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.927634 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.927590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzhfv\" (UniqueName: \"kubernetes.io/projected/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-kube-api-access-pzhfv\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.927634 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.927617    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.927962 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.927651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-config-out\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.927962 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.927673    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.927962 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.927726    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.927962 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.927768    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.927962 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.927809    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-config-volume\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.927962 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.927849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.928272 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:44.927620    2564 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 28 22:09:44.928333 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.928275    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.928333 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:44.928034    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-alertmanager-trusted-ca-bundle podName:5fb90dc9-8abc-4a49-b28f-21f82cccc14f nodeName:}" failed. No retries permitted until 2026-07-28 22:09:45.428008596 +0000 UTC m=+286.423597161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "5fb90dc9-8abc-4a49-b28f-21f82cccc14f") : configmap references non-existent config key: ca-bundle.crt
Jul 28 22:09:44.928333 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:44.928316    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-secret-alertmanager-main-tls podName:5fb90dc9-8abc-4a49-b28f-21f82cccc14f nodeName:}" failed. No retries permitted until 2026-07-28 22:09:45.42829815 +0000 UTC m=+286.423886711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "5fb90dc9-8abc-4a49-b28f-21f82cccc14f") : secret "alertmanager-main-tls" not found
Jul 28 22:09:44.928706 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.928681    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.930732 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.930684    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.931572 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.931251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-web-config\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.931572 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.931390    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-config-volume\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.931572 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.931419    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.931749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.931635    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.931749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.931677    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.932081 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.932060    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-config-out\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.933206 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.933187    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:44.937127 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:44.937106    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzhfv\" (UniqueName: \"kubernetes.io/projected/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-kube-api-access-pzhfv\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:45.432603 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:45.432557    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:45.432603 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:45.432609    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:45.433565 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:45.433525    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:45.435302 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:45.435270    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5fb90dc9-8abc-4a49-b28f-21f82cccc14f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5fb90dc9-8abc-4a49-b28f-21f82cccc14f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:45.623515 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:45.623482    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 22:09:46.989259 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:46.989218    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:46.989719 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:46.989302    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:46.994694 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:46.994672    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:47.371498 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:47.371470    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:09:48.556063 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:09:48.556032    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60962d72_378f_4849_8ee9_12a0b8647cbc.slice/crio-f3190bfc31b91fefe45d0bd44531c77263f24859b2847d619a2decb5df568b58 WatchSource:0}: Error finding container f3190bfc31b91fefe45d0bd44531c77263f24859b2847d619a2decb5df568b58: Status 404 returned error can't find the container with id f3190bfc31b91fefe45d0bd44531c77263f24859b2847d619a2decb5df568b58
Jul 28 22:09:48.744023 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:48.744001    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qpdrd"]
Jul 28 22:09:48.748443 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:48.748395    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 22:09:48.816114 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:09:48.816052    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dca52ed_50f3_4956_b017_05aadb1710f7.slice/crio-7c878720585a288f949f811cc5339cfd5b93279433809bc2f843fb40515d4c7a WatchSource:0}: Error finding container 7c878720585a288f949f811cc5339cfd5b93279433809bc2f843fb40515d4c7a: Status 404 returned error can't find the container with id 7c878720585a288f949f811cc5339cfd5b93279433809bc2f843fb40515d4c7a
Jul 28 22:09:48.816653 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:09:48.816622    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb90dc9_8abc_4a49_b28f_21f82cccc14f.slice/crio-38ccc95883c3cac75e72a1fd334059467c60011da8631e2e8bc3a23767ff2a8f WatchSource:0}: Error finding container 38ccc95883c3cac75e72a1fd334059467c60011da8631e2e8bc3a23767ff2a8f: Status 404 returned error can't find the container with id 38ccc95883c3cac75e72a1fd334059467c60011da8631e2e8bc3a23767ff2a8f
Jul 28 22:09:49.379315 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:49.379201    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb90dc9-8abc-4a49-b28f-21f82cccc14f","Type":"ContainerStarted","Data":"38ccc95883c3cac75e72a1fd334059467c60011da8631e2e8bc3a23767ff2a8f"}
Jul 28 22:09:49.382847 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:49.382675    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-g8777" event={"ID":"4eae46d2-636c-4978-b970-d238535e0f06","Type":"ContainerStarted","Data":"1dd0c4187be12c3d971f3dc1714018f93d35b0053b5034e49ed969a3ac9af2fd"}
Jul 28 22:09:49.385740 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:49.384868    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-g8777"
Jul 28 22:09:49.391019 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:49.390993    2564 generic.go:356] "Generic (PLEG): container finished" podID="4bfe4e5d-312d-4069-92ce-7596c03f3376" containerID="8db5710177190c57934e418f9646c80adc43233bca23bc74bbd8a0d3e7da01b5" exitCode=2
Jul 28 22:09:49.391140 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:49.391068    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p" event={"ID":"4bfe4e5d-312d-4069-92ce-7596c03f3376","Type":"ContainerDied","Data":"8db5710177190c57934e418f9646c80adc43233bca23bc74bbd8a0d3e7da01b5"}
Jul 28 22:09:49.391140 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:49.391098    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff6c9b45f-b6f2p" event={"ID":"4bfe4e5d-312d-4069-92ce-7596c03f3376","Type":"ContainerStarted","Data":"9411a4b9d25c7df94ff2582608fbb924067ddc91c88b9e45cf8535bb49b7400c"}
Jul 28 22:09:49.396025 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:49.395962    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qpdrd" event={"ID":"7dca52ed-50f3-4956-b017-05aadb1710f7","Type":"ContainerStarted","Data":"7c878720585a288f949f811cc5339cfd5b93279433809bc2f843fb40515d4c7a"}
Jul 28 22:09:49.398463 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:49.398010    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7bq6" event={"ID":"60962d72-378f-4849-8ee9-12a0b8647cbc","Type":"ContainerStarted","Data":"f3190bfc31b91fefe45d0bd44531c77263f24859b2847d619a2decb5df568b58"}
Jul 28 22:09:49.400855 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:49.400006    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-g8777" podStartSLOduration=2.793753278 podStartE2EDuration="20.399987721s" totalImagesPullingTime="17.606234443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:49.398327256 +0000 UTC m=+290.393915838" watchObservedRunningTime="2026-07-28 22:09:49.399987721 +0000 UTC m=+290.395576306"
Jul 28 22:09:49.400855 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:49.400785    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-g8777"
Jul 28 22:09:49.982122 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:49.980218    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 22:09:50.009286 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.009252    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.014143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.013973    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 28 22:09:50.014346 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.014206    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 28 22:09:50.014591 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.014502    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1eg8nfjllnpoh\""
Jul 28 22:09:50.014692 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.014684    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 28 22:09:50.014952 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.014932    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 28 22:09:50.015169 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.015153    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 22:09:50.015394 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.015375    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 28 22:09:50.022365 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.021084    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 28 22:09:50.022365 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.021442    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zr4dz\""
Jul 28 22:09:50.028486 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.023841    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 22:09:50.028486 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.023964    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 28 22:09:50.028486 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.024456    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 28 22:09:50.028486 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.024670    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 28 22:09:50.028486 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.024867    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 28 22:09:50.028486 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.025116    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 28 22:09:50.028486 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.025432    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 28 22:09:50.028486 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.025630    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 28 22:09:50.046400 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.046370    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 28 22:09:50.080802 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.080763    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.081071 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.081052    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.081215 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.081198    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.081320 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.081304    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.081418 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.081404    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrp2g\" (UniqueName: \"kubernetes.io/projected/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-kube-api-access-qrp2g\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.081527 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.081512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.081652 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.081625    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.081652 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.081653    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.081857 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.081683    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-config\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.081857 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.081706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-config-out\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.081963 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.081857    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.081963 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.081912    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.081963 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.081939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.082122 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.081972    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.082122 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.081998    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.082122 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.082030    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.082122 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.082055    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-web-config\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.082122 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.082083    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.082343 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.082123    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.082343 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.082151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.182718 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.182594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.182718 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.182638    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.182718 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.182672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.182718 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.182700    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-web-config\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.182718 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.182729    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.182768    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.182797    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.182870    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.182899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.182929    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.182955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.182978    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrp2g\" (UniqueName: \"kubernetes.io/projected/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-kube-api-access-qrp2g\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.183013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.183040    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.183073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.183108    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-config\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.183133    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-config-out\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.183183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.183229    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.183251    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.183608    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.184143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.183759    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.185095 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.183793    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.185095 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.184446    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.185095 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.184793    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.185665 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.185639    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.186100 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.186074    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.191781 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.191738    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.194597 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.194572    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.195489 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.195440    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-web-config\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.198900 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.198257    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.200852 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.200811    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.201337 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.201292    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.202216 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.201867    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrp2g\" (UniqueName: \"kubernetes.io/projected/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-kube-api-access-qrp2g\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.202216 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.202114    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.203120 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.203066    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-config\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.203120 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.203070    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.203629 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.203603    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.204667 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.204623    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-config-out\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.205933 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.205891    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bf81a6ad-d7ff-46bd-baa5-bc8c27441985-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bf81a6ad-d7ff-46bd-baa5-bc8c27441985\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.338448 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.338422    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:09:50.403243 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:50.403212    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7bq6" event={"ID":"60962d72-378f-4849-8ee9-12a0b8647cbc","Type":"ContainerStarted","Data":"7ccbb7c782991f7d73a5fef80ea2b749808dd2fa1aef615d2b37709e3fc8ecee"}
Jul 28 22:09:51.186642 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:51.186540    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 22:09:51.294874 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:09:51.294783    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf81a6ad_d7ff_46bd_baa5_bc8c27441985.slice/crio-89afcf680ea865625be05ac97e1615eda185ef974e80810b3186daba97392f9b WatchSource:0}: Error finding container 89afcf680ea865625be05ac97e1615eda185ef974e80810b3186daba97392f9b: Status 404 returned error can't find the container with id 89afcf680ea865625be05ac97e1615eda185ef974e80810b3186daba97392f9b
Jul 28 22:09:51.409225 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:51.409196    2564 generic.go:356] "Generic (PLEG): container finished" podID="60962d72-378f-4849-8ee9-12a0b8647cbc" containerID="7ccbb7c782991f7d73a5fef80ea2b749808dd2fa1aef615d2b37709e3fc8ecee" exitCode=0
Jul 28 22:09:51.409342 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:51.409309    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7bq6" event={"ID":"60962d72-378f-4849-8ee9-12a0b8647cbc","Type":"ContainerDied","Data":"7ccbb7c782991f7d73a5fef80ea2b749808dd2fa1aef615d2b37709e3fc8ecee"}
Jul 28 22:09:51.412311 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:51.411967    2564 generic.go:356] "Generic (PLEG): container finished" podID="5fb90dc9-8abc-4a49-b28f-21f82cccc14f" containerID="bf8cad8001fbb7f281cb6fcbdde5ae9af4466251635dd95fb456c9774e1ff0ac" exitCode=0
Jul 28 22:09:51.412311 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:51.412071    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb90dc9-8abc-4a49-b28f-21f82cccc14f","Type":"ContainerDied","Data":"bf8cad8001fbb7f281cb6fcbdde5ae9af4466251635dd95fb456c9774e1ff0ac"}
Jul 28 22:09:51.417677 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:51.417587    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf81a6ad-d7ff-46bd-baa5-bc8c27441985","Type":"ContainerStarted","Data":"89afcf680ea865625be05ac97e1615eda185ef974e80810b3186daba97392f9b"}
Jul 28 22:09:52.425824 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:52.425780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qpdrd" event={"ID":"7dca52ed-50f3-4956-b017-05aadb1710f7","Type":"ContainerStarted","Data":"2ffc49b982281aaf6e761e6807ab9117695951efe92ecc0883328206fc216ff3"}
Jul 28 22:09:52.426417 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:52.425876    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qpdrd" event={"ID":"7dca52ed-50f3-4956-b017-05aadb1710f7","Type":"ContainerStarted","Data":"22179a769d1081288b79145075b30a6cb3da652c902541f6d55eebb6c9084cd4"}
Jul 28 22:09:52.426417 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:52.425990    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:09:52.428671 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:52.428630    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7bq6" event={"ID":"60962d72-378f-4849-8ee9-12a0b8647cbc","Type":"ContainerStarted","Data":"3d49e6774fc37a9d0ac087af8ca7fb916e7b6a31e226e58f62ddb056419ed8e8"}
Jul 28 22:09:52.428816 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:52.428678    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7bq6" event={"ID":"60962d72-378f-4849-8ee9-12a0b8647cbc","Type":"ContainerStarted","Data":"8bde83a7b115ee30c18b40b54ccf68f605b18520720a9fe16f2919a42ff5d94c"}
Jul 28 22:09:52.430393 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:52.430371    2564 generic.go:356] "Generic (PLEG): container finished" podID="bf81a6ad-d7ff-46bd-baa5-bc8c27441985" containerID="55cbae86bef147dd2980be7fa819a33647d74fdb7085de286abb5c2b363292e7" exitCode=0
Jul 28 22:09:52.430502 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:52.430433    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf81a6ad-d7ff-46bd-baa5-bc8c27441985","Type":"ContainerDied","Data":"55cbae86bef147dd2980be7fa819a33647d74fdb7085de286abb5c2b363292e7"}
Jul 28 22:09:52.441732 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:52.441685    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qpdrd" podStartSLOduration=255.946647238 podStartE2EDuration="4m18.441668733s" totalImagesPullingTime="2.495021495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:52.441488692 +0000 UTC m=+293.437077296" watchObservedRunningTime="2026-07-28 22:09:52.441668733 +0000 UTC m=+293.437257318"
Jul 28 22:09:52.458068 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:52.457994    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d7bq6" podStartSLOduration=7.771844719 podStartE2EDuration="9.457980658s" totalImagesPullingTime="1.604332123s" totalInitContainerRuntime="81.803816ms" isStatefulPod=true podCreationTimestamp="2026-07-28 22:09:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:52.457763985 +0000 UTC m=+293.453352567" watchObservedRunningTime="2026-07-28 22:09:52.457980658 +0000 UTC m=+293.453569240"
Jul 28 22:09:54.445944 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:54.445907    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb90dc9-8abc-4a49-b28f-21f82cccc14f","Type":"ContainerStarted","Data":"3b8eaaa20b1823a81bb156005cae75356d175cc864b81bb91481fc9dfa1a2001"}
Jul 28 22:09:54.446358 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:54.445987    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb90dc9-8abc-4a49-b28f-21f82cccc14f","Type":"ContainerStarted","Data":"41dfa7d48162ea71d5e43deea7736cdca1c825e84ec57ce48c2119320d60dc42"}
Jul 28 22:09:54.446358 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:54.446031    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb90dc9-8abc-4a49-b28f-21f82cccc14f","Type":"ContainerStarted","Data":"d670cf00e66236ab1ac91e81049e88bd66064fda71da2c9f0dee87b337a45874"}
Jul 28 22:09:54.446358 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:54.446073    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb90dc9-8abc-4a49-b28f-21f82cccc14f","Type":"ContainerStarted","Data":"03bd8414b68e10cd9bbc31ebcb3e819fa9728248a174bc49bdaf8549588ba764"}
Jul 28 22:09:54.446358 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:54.446113    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb90dc9-8abc-4a49-b28f-21f82cccc14f","Type":"ContainerStarted","Data":"9a1d5e675f1e50e8511fe31876e1dee1774c7c3cab8db12f05162ef02f08d585"}
Jul 28 22:09:56.503703 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:09:56.503657    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-klvjg" podUID="f897e87e-7933-43c6-8073-5ed015c336e1"
Jul 28 22:09:57.467258 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:57.467224    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5fb90dc9-8abc-4a49-b28f-21f82cccc14f","Type":"ContainerStarted","Data":"712ec27f15f7082951d40dba91ef6ba72eaae46c51358fb709df9c333feddfb2"}
Jul 28 22:09:57.471275 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:57.471181    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf81a6ad-d7ff-46bd-baa5-bc8c27441985","Type":"ContainerStarted","Data":"2a440e9a10c49a351a2a2b7c63c0a913b04a64833ea9647ec60227cdbc2abcc3"}
Jul 28 22:09:57.498165 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:57.498106    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.140521647 podStartE2EDuration="13.498085064s" totalImagesPullingTime="7.338014691s" totalInitContainerRuntime="19.548726ms" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:09:57.49652348 +0000 UTC m=+298.492112063" watchObservedRunningTime="2026-07-28 22:09:57.498085064 +0000 UTC m=+298.493673647"
Jul 28 22:09:58.477193 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:58.477154    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf81a6ad-d7ff-46bd-baa5-bc8c27441985","Type":"ContainerStarted","Data":"fa84ed4349afce3019f97a1e175455526fa02a7694cf355e33fe60a08ea493a2"}
Jul 28 22:09:59.386109 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:59.386084    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:09:59.386303 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:59.386230    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:09:59.392433 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:09:59.392415    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 22:10:00.487301 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:00.487262    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf81a6ad-d7ff-46bd-baa5-bc8c27441985","Type":"ContainerStarted","Data":"569cc80cc9627bf8120888b1da75c84cd611878d8c448d688adecf8626e2f9a7"}
Jul 28 22:10:00.487744 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:00.487346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf81a6ad-d7ff-46bd-baa5-bc8c27441985","Type":"ContainerStarted","Data":"d7192e55cadeb1d5fd5eb9894a0baccc4efcfe30efa4c6b9dfef7d3c35ac1137"}
Jul 28 22:10:00.487744 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:00.487391    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf81a6ad-d7ff-46bd-baa5-bc8c27441985","Type":"ContainerStarted","Data":"42227177f9244564bb8a1d16a0f61f0bc4b55e2741fb936c8366076536540977"}
Jul 28 22:10:00.487744 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:00.487429    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf81a6ad-d7ff-46bd-baa5-bc8c27441985","Type":"ContainerStarted","Data":"2eaedf49cc5a3e5bc7dcaed36177294b59e9790ed7bf74d0d613a16dc09bbe23"}
Jul 28 22:10:00.519308 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:00.519231    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.535644743 podStartE2EDuration="11.5192153s" totalImagesPullingTime="6.944316372s" totalInitContainerRuntime="39.254185ms" isStatefulPod=false podCreationTimestamp="2026-07-28 22:09:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:10:00.51724 +0000 UTC m=+301.512828583" watchObservedRunningTime="2026-07-28 22:10:00.5192153 +0000 UTC m=+301.514803882"
Jul 28 22:10:02.437694 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:02.437667    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qpdrd"
Jul 28 22:10:05.339281 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:05.339242    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:10:06.191161 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:06.191126    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dfdd98d4c-ll2mv"]
Jul 28 22:10:08.502424 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:08.502393    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:10:15.538936 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:15.538904    2564 generic.go:356] "Generic (PLEG): container finished" podID="11c8fe10-4233-4115-9ed1-5802ccf58d4c" containerID="703fb07ed94cc2758233187f7ea8a9c25630da5dce9183229f9e4f7d342089e4" exitCode=0
Jul 28 22:10:15.539405 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:15.538973    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4" event={"ID":"11c8fe10-4233-4115-9ed1-5802ccf58d4c","Type":"ContainerDied","Data":"703fb07ed94cc2758233187f7ea8a9c25630da5dce9183229f9e4f7d342089e4"}
Jul 28 22:10:15.539405 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:15.539231    2564 scope.go:117] "RemoveContainer" containerID="703fb07ed94cc2758233187f7ea8a9c25630da5dce9183229f9e4f7d342089e4"
Jul 28 22:10:16.543900 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:16.543867    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-7hqd4" event={"ID":"11c8fe10-4233-4115-9ed1-5802ccf58d4c","Type":"ContainerStarted","Data":"625de6417f784d5b110b3b1a973427f71eced59c423b9e64a377aac2ec1abf4f"}
Jul 28 22:10:28.278882 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:28.278849    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-scglc_ae3c4870-bae7-4e87-ba4d-7b2029bb84fd/serve-healthcheck-canary/0.log"
Jul 28 22:10:31.212215 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.212152    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6dfdd98d4c-ll2mv" podUID="5434eed9-9a95-4dae-aa18-e5b8d4bc9c89" containerName="console" containerID="cri-o://ec08c44cc1d9418cb88c05a33661fb2bc8999f4a87eb5ec36aab34b7f2bf1148" gracePeriod=15
Jul 28 22:10:31.485951 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.485891    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:10:31.537340 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.537311    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-service-ca\") pod \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") "
Jul 28 22:10:31.537492 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.537367    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-oauth-serving-cert\") pod \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") "
Jul 28 22:10:31.537492 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.537392    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-config\") pod \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") "
Jul 28 22:10:31.537492 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.537446    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-oauth-config\") pod \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") "
Jul 28 22:10:31.537492 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.537467    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-serving-cert\") pod \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") "
Jul 28 22:10:31.537492 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.537486    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thstc\" (UniqueName: \"kubernetes.io/projected/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-kube-api-access-thstc\") pod \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\" (UID: \"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89\") "
Jul 28 22:10:31.537862 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.537813    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5434eed9-9a95-4dae-aa18-e5b8d4bc9c89" (UID: "5434eed9-9a95-4dae-aa18-e5b8d4bc9c89"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:10:31.537972 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.537845    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-service-ca" (OuterVolumeSpecName: "service-ca") pod "5434eed9-9a95-4dae-aa18-e5b8d4bc9c89" (UID: "5434eed9-9a95-4dae-aa18-e5b8d4bc9c89"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:10:31.538019 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.537979    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-config" (OuterVolumeSpecName: "console-config") pod "5434eed9-9a95-4dae-aa18-e5b8d4bc9c89" (UID: "5434eed9-9a95-4dae-aa18-e5b8d4bc9c89"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:10:31.539790 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.539757    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5434eed9-9a95-4dae-aa18-e5b8d4bc9c89" (UID: "5434eed9-9a95-4dae-aa18-e5b8d4bc9c89"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:10:31.539790 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.539777    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5434eed9-9a95-4dae-aa18-e5b8d4bc9c89" (UID: "5434eed9-9a95-4dae-aa18-e5b8d4bc9c89"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:10:31.539931 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.539815    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-kube-api-access-thstc" (OuterVolumeSpecName: "kube-api-access-thstc") pod "5434eed9-9a95-4dae-aa18-e5b8d4bc9c89" (UID: "5434eed9-9a95-4dae-aa18-e5b8d4bc9c89"). InnerVolumeSpecName "kube-api-access-thstc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:10:31.601045 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.601008    2564 generic.go:356] "Generic (PLEG): container finished" podID="5434eed9-9a95-4dae-aa18-e5b8d4bc9c89" containerID="ec08c44cc1d9418cb88c05a33661fb2bc8999f4a87eb5ec36aab34b7f2bf1148" exitCode=0
Jul 28 22:10:31.601210 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.601042    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfdd98d4c-ll2mv" event={"ID":"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89","Type":"ContainerDied","Data":"ec08c44cc1d9418cb88c05a33661fb2bc8999f4a87eb5ec36aab34b7f2bf1148"}
Jul 28 22:10:31.601210 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.601069    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dfdd98d4c-ll2mv"
Jul 28 22:10:31.601210 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.601135    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dfdd98d4c-ll2mv" event={"ID":"5434eed9-9a95-4dae-aa18-e5b8d4bc9c89","Type":"ContainerDied","Data":"21c4199ccc099c7b21e5231930af279b2dc14a47ef937801563e8c3940389fd2"}
Jul 28 22:10:31.601210 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.601164    2564 scope.go:117] "RemoveContainer" containerID="ec08c44cc1d9418cb88c05a33661fb2bc8999f4a87eb5ec36aab34b7f2bf1148"
Jul 28 22:10:31.609945 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.609929    2564 scope.go:117] "RemoveContainer" containerID="ec08c44cc1d9418cb88c05a33661fb2bc8999f4a87eb5ec36aab34b7f2bf1148"
Jul 28 22:10:31.610185 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:10:31.610165    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec08c44cc1d9418cb88c05a33661fb2bc8999f4a87eb5ec36aab34b7f2bf1148\": container with ID starting with ec08c44cc1d9418cb88c05a33661fb2bc8999f4a87eb5ec36aab34b7f2bf1148 not found: ID does not exist" containerID="ec08c44cc1d9418cb88c05a33661fb2bc8999f4a87eb5ec36aab34b7f2bf1148"
Jul 28 22:10:31.610248 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.610196    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec08c44cc1d9418cb88c05a33661fb2bc8999f4a87eb5ec36aab34b7f2bf1148"} err="failed to get container status \"ec08c44cc1d9418cb88c05a33661fb2bc8999f4a87eb5ec36aab34b7f2bf1148\": rpc error: code = NotFound desc = could not find container \"ec08c44cc1d9418cb88c05a33661fb2bc8999f4a87eb5ec36aab34b7f2bf1148\": container with ID starting with ec08c44cc1d9418cb88c05a33661fb2bc8999f4a87eb5ec36aab34b7f2bf1148 not found: ID does not exist"
Jul 28 22:10:31.620659 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.620639    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dfdd98d4c-ll2mv"]
Jul 28 22:10:31.624205 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.624187    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dfdd98d4c-ll2mv"]
Jul 28 22:10:31.638420 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.638402    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-service-ca\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:10:31.638420 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.638420    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-oauth-serving-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:10:31.638528 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.638430    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-config\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:10:31.638528 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.638439    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-oauth-config\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:10:31.638528 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.638448    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-console-serving-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:10:31.638528 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:31.638456    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thstc\" (UniqueName: \"kubernetes.io/projected/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89-kube-api-access-thstc\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:10:33.506400 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:33.506372    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5434eed9-9a95-4dae-aa18-e5b8d4bc9c89" path="/var/lib/kubelet/pods/5434eed9-9a95-4dae-aa18-e5b8d4bc9c89/volumes"
Jul 28 22:10:50.338844 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:50.338785    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:10:50.361362 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:50.361338    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:10:50.681469 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:10:50.681435    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 22:11:13.354697 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:11:13.354664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:11:13.357037 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:11:13.357013    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f897e87e-7933-43c6-8073-5ed015c336e1-metrics-certs\") pod \"network-metrics-daemon-klvjg\" (UID: \"f897e87e-7933-43c6-8073-5ed015c336e1\") " pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:11:13.605260 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:11:13.605193    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f5pt7\""
Jul 28 22:11:13.613802 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:11:13.613783    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-klvjg"
Jul 28 22:11:13.742230 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:11:13.742196    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-klvjg"]
Jul 28 22:11:13.745175 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:11:13.745149    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf897e87e_7933_43c6_8073_5ed015c336e1.slice/crio-9a4b5807ac3c42415045acbb332fcce2749dec82fbb85b2e36d9f197d55b7539 WatchSource:0}: Error finding container 9a4b5807ac3c42415045acbb332fcce2749dec82fbb85b2e36d9f197d55b7539: Status 404 returned error can't find the container with id 9a4b5807ac3c42415045acbb332fcce2749dec82fbb85b2e36d9f197d55b7539
Jul 28 22:11:13.747171 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:11:13.747151    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 22:11:13.750711 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:11:13.750688    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-klvjg" event={"ID":"f897e87e-7933-43c6-8073-5ed015c336e1","Type":"ContainerStarted","Data":"9a4b5807ac3c42415045acbb332fcce2749dec82fbb85b2e36d9f197d55b7539"}
Jul 28 22:11:14.761596 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:11:14.761569    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-klvjg" event={"ID":"f897e87e-7933-43c6-8073-5ed015c336e1","Type":"ContainerStarted","Data":"56fed8ff3ac4d41c53dac74064d6d184788af4129659dfdbd980b5d9f963cecf"}
Jul 28 22:11:15.767048 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:11:15.767013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-klvjg" event={"ID":"f897e87e-7933-43c6-8073-5ed015c336e1","Type":"ContainerStarted","Data":"0e1831c630cc0f7bc8bf1a72f6fbc9864a547d62e0b66490b9a89c01fe39c571"}
Jul 28 22:11:15.783300 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:11:15.783256    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-klvjg" podStartSLOduration=375.860418446 podStartE2EDuration="6m16.783240546s" totalImagesPullingTime="922.8221ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:11:15.782051944 +0000 UTC m=+376.777640527" watchObservedRunningTime="2026-07-28 22:11:15.783240546 +0000 UTC m=+376.778829127"
Jul 28 22:13:13.257236 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.257201    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"]
Jul 28 22:13:13.257659 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.257495    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5434eed9-9a95-4dae-aa18-e5b8d4bc9c89" containerName="console"
Jul 28 22:13:13.257659 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.257506    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5434eed9-9a95-4dae-aa18-e5b8d4bc9c89" containerName="console"
Jul 28 22:13:13.257659 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.257562    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5434eed9-9a95-4dae-aa18-e5b8d4bc9c89" containerName="console"
Jul 28 22:13:13.259411 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.259396    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.261688 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.261668    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 22:13:13.261941 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.261920    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 22:13:13.262051 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.261963    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-67bxr\""
Jul 28 22:13:13.262236 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.262220    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 22:13:13.264260 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.264241    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 22:13:13.293081 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.293053    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"]
Jul 28 22:13:13.380953 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.380920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5e2952ce-0018-4908-8d47-b0a441c86421-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-dr965\" (UID: \"5e2952ce-0018-4908-8d47-b0a441c86421\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.381143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.380970    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5e2952ce-0018-4908-8d47-b0a441c86421-manifests\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-dr965\" (UID: \"5e2952ce-0018-4908-8d47-b0a441c86421\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.381143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.381036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e2952ce-0018-4908-8d47-b0a441c86421-webhook-cert\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-dr965\" (UID: \"5e2952ce-0018-4908-8d47-b0a441c86421\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.381143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.381087    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e2952ce-0018-4908-8d47-b0a441c86421-tmp\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-dr965\" (UID: \"5e2952ce-0018-4908-8d47-b0a441c86421\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.381143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.381104    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2v2m\" (UniqueName: \"kubernetes.io/projected/5e2952ce-0018-4908-8d47-b0a441c86421-kube-api-access-m2v2m\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-dr965\" (UID: \"5e2952ce-0018-4908-8d47-b0a441c86421\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.481849 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.481800    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5e2952ce-0018-4908-8d47-b0a441c86421-manifests\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-dr965\" (UID: \"5e2952ce-0018-4908-8d47-b0a441c86421\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.482041 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.481857    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e2952ce-0018-4908-8d47-b0a441c86421-webhook-cert\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-dr965\" (UID: \"5e2952ce-0018-4908-8d47-b0a441c86421\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.482041 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.481890    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e2952ce-0018-4908-8d47-b0a441c86421-tmp\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-dr965\" (UID: \"5e2952ce-0018-4908-8d47-b0a441c86421\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.482041 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.481910    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2v2m\" (UniqueName: \"kubernetes.io/projected/5e2952ce-0018-4908-8d47-b0a441c86421-kube-api-access-m2v2m\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-dr965\" (UID: \"5e2952ce-0018-4908-8d47-b0a441c86421\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.482041 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.481944    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5e2952ce-0018-4908-8d47-b0a441c86421-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-dr965\" (UID: \"5e2952ce-0018-4908-8d47-b0a441c86421\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.482268 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.482246    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5e2952ce-0018-4908-8d47-b0a441c86421-manifests\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-dr965\" (UID: \"5e2952ce-0018-4908-8d47-b0a441c86421\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.484576 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.484555    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e2952ce-0018-4908-8d47-b0a441c86421-tmp\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-dr965\" (UID: \"5e2952ce-0018-4908-8d47-b0a441c86421\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.484859 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.484843    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5e2952ce-0018-4908-8d47-b0a441c86421-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-dr965\" (UID: \"5e2952ce-0018-4908-8d47-b0a441c86421\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.484916 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.484906    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5e2952ce-0018-4908-8d47-b0a441c86421-webhook-cert\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-dr965\" (UID: \"5e2952ce-0018-4908-8d47-b0a441c86421\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.491625 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.491605    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2v2m\" (UniqueName: \"kubernetes.io/projected/5e2952ce-0018-4908-8d47-b0a441c86421-kube-api-access-m2v2m\") pod \"opendatahub-operator-controller-manager-6974ffcb4c-dr965\" (UID: \"5e2952ce-0018-4908-8d47-b0a441c86421\") " pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.570231 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.570144    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:13.701039 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:13.701011    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"]
Jul 28 22:13:13.702240 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:13:13.702214    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e2952ce_0018_4908_8d47_b0a441c86421.slice/crio-ba4388bcb02b429187d95869bc8994df7a6885ff6f47eba7948275907f144ea4 WatchSource:0}: Error finding container ba4388bcb02b429187d95869bc8994df7a6885ff6f47eba7948275907f144ea4: Status 404 returned error can't find the container with id ba4388bcb02b429187d95869bc8994df7a6885ff6f47eba7948275907f144ea4
Jul 28 22:13:14.185719 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:14.185681    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965" event={"ID":"5e2952ce-0018-4908-8d47-b0a441c86421","Type":"ContainerStarted","Data":"ba4388bcb02b429187d95869bc8994df7a6885ff6f47eba7948275907f144ea4"}
Jul 28 22:13:17.201068 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:17.201029    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965" event={"ID":"5e2952ce-0018-4908-8d47-b0a441c86421","Type":"ContainerStarted","Data":"fb743d7fa952d16f370d7954bed55b1b7c22988428e963fe0e198b915ff40758"}
Jul 28 22:13:18.206329 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:18.206293    2564 generic.go:356] "Generic (PLEG): container finished" podID="5e2952ce-0018-4908-8d47-b0a441c86421" containerID="fb743d7fa952d16f370d7954bed55b1b7c22988428e963fe0e198b915ff40758" exitCode=0
Jul 28 22:13:18.206770 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:18.206387    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965" event={"ID":"5e2952ce-0018-4908-8d47-b0a441c86421","Type":"ContainerDied","Data":"fb743d7fa952d16f370d7954bed55b1b7c22988428e963fe0e198b915ff40758"}
Jul 28 22:13:19.212389 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:19.212346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965" event={"ID":"5e2952ce-0018-4908-8d47-b0a441c86421","Type":"ContainerStarted","Data":"5e2c65c5dbc94c8b4d587bb4e096f905636b22ecbb373e1481040186b2559cac"}
Jul 28 22:13:19.212802 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:19.212490    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:19.233270 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:19.233215    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965" podStartSLOduration=2.102283853 podStartE2EDuration="6.233195263s" totalImagesPullingTime="3.074039683s" totalInitContainerRuntime="1.056871727s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:13:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:13:19.23186336 +0000 UTC m=+500.227451936" watchObservedRunningTime="2026-07-28 22:13:19.233195263 +0000 UTC m=+500.228783847"
Jul 28 22:13:30.218873 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:30.218823    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6974ffcb4c-dr965"
Jul 28 22:13:41.202904 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.202870    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"]
Jul 28 22:13:41.215876 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.215848    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.219143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.219120    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-b7ssc\""
Jul 28 22:13:41.219301 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.219278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e04ffdad-4477-43df-9e3c-c2e535aa48e2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.219354 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.219316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67cmx\" (UniqueName: \"kubernetes.io/projected/e04ffdad-4477-43df-9e3c-c2e535aa48e2-kube-api-access-67cmx\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.219404 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.219352    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e04ffdad-4477-43df-9e3c-c2e535aa48e2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.219456 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.219413    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e04ffdad-4477-43df-9e3c-c2e535aa48e2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.219456 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.219449    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e04ffdad-4477-43df-9e3c-c2e535aa48e2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.219555 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.219508    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e04ffdad-4477-43df-9e3c-c2e535aa48e2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.219555 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.219535    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e04ffdad-4477-43df-9e3c-c2e535aa48e2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.219555 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.219551    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e04ffdad-4477-43df-9e3c-c2e535aa48e2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.219754 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.219572    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e04ffdad-4477-43df-9e3c-c2e535aa48e2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.219754 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.219646    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 22:13:41.219875 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.219765    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 22:13:41.220538 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.220516    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 22:13:41.227983 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.227959    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"]
Jul 28 22:13:41.320467 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.320433    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e04ffdad-4477-43df-9e3c-c2e535aa48e2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.320467 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.320466    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67cmx\" (UniqueName: \"kubernetes.io/projected/e04ffdad-4477-43df-9e3c-c2e535aa48e2-kube-api-access-67cmx\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.320715 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.320487    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e04ffdad-4477-43df-9e3c-c2e535aa48e2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.320715 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.320536    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e04ffdad-4477-43df-9e3c-c2e535aa48e2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.320715 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.320569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e04ffdad-4477-43df-9e3c-c2e535aa48e2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.320715 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.320610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e04ffdad-4477-43df-9e3c-c2e535aa48e2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.320715 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.320645    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e04ffdad-4477-43df-9e3c-c2e535aa48e2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.320715 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.320670    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e04ffdad-4477-43df-9e3c-c2e535aa48e2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.320715 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.320696    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e04ffdad-4477-43df-9e3c-c2e535aa48e2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.321084 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.320975    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e04ffdad-4477-43df-9e3c-c2e535aa48e2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.321202 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.321176    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e04ffdad-4477-43df-9e3c-c2e535aa48e2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.321407 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.321384    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e04ffdad-4477-43df-9e3c-c2e535aa48e2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.321580 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.321467    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e04ffdad-4477-43df-9e3c-c2e535aa48e2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.321658 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.321618    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e04ffdad-4477-43df-9e3c-c2e535aa48e2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.323162 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.323145    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e04ffdad-4477-43df-9e3c-c2e535aa48e2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.323302 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.323285    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e04ffdad-4477-43df-9e3c-c2e535aa48e2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.328416 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.328387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e04ffdad-4477-43df-9e3c-c2e535aa48e2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.329028 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.329006    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67cmx\" (UniqueName: \"kubernetes.io/projected/e04ffdad-4477-43df-9e3c-c2e535aa48e2-kube-api-access-67cmx\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799csnz9j\" (UID: \"e04ffdad-4477-43df-9e3c-c2e535aa48e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.527475 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.527391    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:41.656865 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:41.656824    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"]
Jul 28 22:13:41.659335 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:13:41.659303    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04ffdad_4477_43df_9e3c_c2e535aa48e2.slice/crio-83756e09324256c922f060d59a3576e3c2617fd7c6c49e7aca8f4b038d078efe WatchSource:0}: Error finding container 83756e09324256c922f060d59a3576e3c2617fd7c6c49e7aca8f4b038d078efe: Status 404 returned error can't find the container with id 83756e09324256c922f060d59a3576e3c2617fd7c6c49e7aca8f4b038d078efe
Jul 28 22:13:42.298705 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:42.298668    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j" event={"ID":"e04ffdad-4477-43df-9e3c-c2e535aa48e2","Type":"ContainerStarted","Data":"83756e09324256c922f060d59a3576e3c2617fd7c6c49e7aca8f4b038d078efe"}
Jul 28 22:13:43.340425 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.340391    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rkwww"]
Jul 28 22:13:43.344846 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.344815    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rkwww"
Jul 28 22:13:43.347626 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.347609    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lh27j\""
Jul 28 22:13:43.348285 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.348266    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 28 22:13:43.369554 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.369534    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rkwww"]
Jul 28 22:13:43.378145 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.378115    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9"]
Jul 28 22:13:43.381490 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.381471    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9"
Jul 28 22:13:43.383898 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.383878    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 28 22:13:43.383991 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.383910    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-vf9bm\""
Jul 28 22:13:43.401529 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.401503    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9"]
Jul 28 22:13:43.434992 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.434961    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f18a44c-ab99-4543-b19c-39e654f4dca0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nsqf9\" (UID: \"7f18a44c-ab99-4543-b19c-39e654f4dca0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9"
Jul 28 22:13:43.435163 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.435012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx8wf\" (UniqueName: \"kubernetes.io/projected/b602404e-1aef-416c-ab11-99c20549b324-kube-api-access-hx8wf\") pod \"kserve-controller-manager-d6f4b65b8-rkwww\" (UID: \"b602404e-1aef-416c-ab11-99c20549b324\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rkwww"
Jul 28 22:13:43.435163 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.435122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b602404e-1aef-416c-ab11-99c20549b324-cert\") pod \"kserve-controller-manager-d6f4b65b8-rkwww\" (UID: \"b602404e-1aef-416c-ab11-99c20549b324\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rkwww"
Jul 28 22:13:43.435163 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.435153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9zg\" (UniqueName: \"kubernetes.io/projected/7f18a44c-ab99-4543-b19c-39e654f4dca0-kube-api-access-6l9zg\") pod \"llmisvc-controller-manager-777c6bd7d5-nsqf9\" (UID: \"7f18a44c-ab99-4543-b19c-39e654f4dca0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9"
Jul 28 22:13:43.535842 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.535802    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f18a44c-ab99-4543-b19c-39e654f4dca0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nsqf9\" (UID: \"7f18a44c-ab99-4543-b19c-39e654f4dca0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9"
Jul 28 22:13:43.536042 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.535890    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx8wf\" (UniqueName: \"kubernetes.io/projected/b602404e-1aef-416c-ab11-99c20549b324-kube-api-access-hx8wf\") pod \"kserve-controller-manager-d6f4b65b8-rkwww\" (UID: \"b602404e-1aef-416c-ab11-99c20549b324\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rkwww"
Jul 28 22:13:43.536042 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.535946    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b602404e-1aef-416c-ab11-99c20549b324-cert\") pod \"kserve-controller-manager-d6f4b65b8-rkwww\" (UID: \"b602404e-1aef-416c-ab11-99c20549b324\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rkwww"
Jul 28 22:13:43.536042 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.535980    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9zg\" (UniqueName: \"kubernetes.io/projected/7f18a44c-ab99-4543-b19c-39e654f4dca0-kube-api-access-6l9zg\") pod \"llmisvc-controller-manager-777c6bd7d5-nsqf9\" (UID: \"7f18a44c-ab99-4543-b19c-39e654f4dca0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9"
Jul 28 22:13:43.538817 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.538792    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f18a44c-ab99-4543-b19c-39e654f4dca0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nsqf9\" (UID: \"7f18a44c-ab99-4543-b19c-39e654f4dca0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9"
Jul 28 22:13:43.539678 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.539634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b602404e-1aef-416c-ab11-99c20549b324-cert\") pod \"kserve-controller-manager-d6f4b65b8-rkwww\" (UID: \"b602404e-1aef-416c-ab11-99c20549b324\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rkwww"
Jul 28 22:13:43.549795 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.549669    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9zg\" (UniqueName: \"kubernetes.io/projected/7f18a44c-ab99-4543-b19c-39e654f4dca0-kube-api-access-6l9zg\") pod \"llmisvc-controller-manager-777c6bd7d5-nsqf9\" (UID: \"7f18a44c-ab99-4543-b19c-39e654f4dca0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9"
Jul 28 22:13:43.551811 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.551789    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx8wf\" (UniqueName: \"kubernetes.io/projected/b602404e-1aef-416c-ab11-99c20549b324-kube-api-access-hx8wf\") pod \"kserve-controller-manager-d6f4b65b8-rkwww\" (UID: \"b602404e-1aef-416c-ab11-99c20549b324\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rkwww"
Jul 28 22:13:43.646794 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.646760    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"]
Jul 28 22:13:43.652920 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.651097    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:13:43.654698 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.654658    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 28 22:13:43.657143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.657121    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qhskp\""
Jul 28 22:13:43.657340 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.657319    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rkwww"
Jul 28 22:13:43.657522 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.657139    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 22:13:43.657761 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.657197    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 28 22:13:43.657873 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.657263    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 28 22:13:43.657873 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.657142    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 22:13:43.666231 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.666212    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"]
Jul 28 22:13:43.693172 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.693147    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9"
Jul 28 22:13:43.738292 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.738072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c12a7e2e-5362-47bb-ac44-d5e4073fa403-manager-config\") pod \"lws-controller-manager-75cf9697f-w9qht\" (UID: \"c12a7e2e-5362-47bb-ac44-d5e4073fa403\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:13:43.738292 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.738132    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c12a7e2e-5362-47bb-ac44-d5e4073fa403-metrics-cert\") pod \"lws-controller-manager-75cf9697f-w9qht\" (UID: \"c12a7e2e-5362-47bb-ac44-d5e4073fa403\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:13:43.738292 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.738165    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c12a7e2e-5362-47bb-ac44-d5e4073fa403-cert\") pod \"lws-controller-manager-75cf9697f-w9qht\" (UID: \"c12a7e2e-5362-47bb-ac44-d5e4073fa403\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:13:43.738292 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.738216    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8g9v\" (UniqueName: \"kubernetes.io/projected/c12a7e2e-5362-47bb-ac44-d5e4073fa403-kube-api-access-n8g9v\") pod \"lws-controller-manager-75cf9697f-w9qht\" (UID: \"c12a7e2e-5362-47bb-ac44-d5e4073fa403\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:13:43.840203 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.839626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c12a7e2e-5362-47bb-ac44-d5e4073fa403-metrics-cert\") pod \"lws-controller-manager-75cf9697f-w9qht\" (UID: \"c12a7e2e-5362-47bb-ac44-d5e4073fa403\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:13:43.840203 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.839682    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c12a7e2e-5362-47bb-ac44-d5e4073fa403-cert\") pod \"lws-controller-manager-75cf9697f-w9qht\" (UID: \"c12a7e2e-5362-47bb-ac44-d5e4073fa403\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:13:43.840203 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.839732    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8g9v\" (UniqueName: \"kubernetes.io/projected/c12a7e2e-5362-47bb-ac44-d5e4073fa403-kube-api-access-n8g9v\") pod \"lws-controller-manager-75cf9697f-w9qht\" (UID: \"c12a7e2e-5362-47bb-ac44-d5e4073fa403\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:13:43.840203 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.839821    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c12a7e2e-5362-47bb-ac44-d5e4073fa403-manager-config\") pod \"lws-controller-manager-75cf9697f-w9qht\" (UID: \"c12a7e2e-5362-47bb-ac44-d5e4073fa403\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:13:43.840587 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.840563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c12a7e2e-5362-47bb-ac44-d5e4073fa403-manager-config\") pod \"lws-controller-manager-75cf9697f-w9qht\" (UID: \"c12a7e2e-5362-47bb-ac44-d5e4073fa403\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:13:43.843091 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.843047    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c12a7e2e-5362-47bb-ac44-d5e4073fa403-cert\") pod \"lws-controller-manager-75cf9697f-w9qht\" (UID: \"c12a7e2e-5362-47bb-ac44-d5e4073fa403\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:13:43.843297 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.843255    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c12a7e2e-5362-47bb-ac44-d5e4073fa403-metrics-cert\") pod \"lws-controller-manager-75cf9697f-w9qht\" (UID: \"c12a7e2e-5362-47bb-ac44-d5e4073fa403\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:13:43.856583 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.856531    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8g9v\" (UniqueName: \"kubernetes.io/projected/c12a7e2e-5362-47bb-ac44-d5e4073fa403-kube-api-access-n8g9v\") pod \"lws-controller-manager-75cf9697f-w9qht\" (UID: \"c12a7e2e-5362-47bb-ac44-d5e4073fa403\") " pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:13:43.964610 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:43.964313    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:13:44.056771 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:44.056720    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rkwww"]
Jul 28 22:13:44.059629 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:13:44.059595    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb602404e_1aef_416c_ab11_99c20549b324.slice/crio-53e1bc63893cf7d78d2c9c44435d7845491bb82e99b9cb62df50dd1b4fe289cd WatchSource:0}: Error finding container 53e1bc63893cf7d78d2c9c44435d7845491bb82e99b9cb62df50dd1b4fe289cd: Status 404 returned error can't find the container with id 53e1bc63893cf7d78d2c9c44435d7845491bb82e99b9cb62df50dd1b4fe289cd
Jul 28 22:13:44.076993 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:44.076552    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9"]
Jul 28 22:13:44.079965 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:13:44.079937    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7f18a44c_ab99_4543_b19c_39e654f4dca0.slice/crio-59532c478520d2df01e90b693cf02bd09581e5372d862a110077768168fe8c7a WatchSource:0}: Error finding container 59532c478520d2df01e90b693cf02bd09581e5372d862a110077768168fe8c7a: Status 404 returned error can't find the container with id 59532c478520d2df01e90b693cf02bd09581e5372d862a110077768168fe8c7a
Jul 28 22:13:44.131322 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:44.131281    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"]
Jul 28 22:13:44.134642 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:13:44.134615    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc12a7e2e_5362_47bb_ac44_d5e4073fa403.slice/crio-06a687be07a85f74c208c3dd905e2795ad39063ff0c5f01cbabd82f36c04b92c WatchSource:0}: Error finding container 06a687be07a85f74c208c3dd905e2795ad39063ff0c5f01cbabd82f36c04b92c: Status 404 returned error can't find the container with id 06a687be07a85f74c208c3dd905e2795ad39063ff0c5f01cbabd82f36c04b92c
Jul 28 22:13:44.310127 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:44.310019    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht" event={"ID":"c12a7e2e-5362-47bb-ac44-d5e4073fa403","Type":"ContainerStarted","Data":"06a687be07a85f74c208c3dd905e2795ad39063ff0c5f01cbabd82f36c04b92c"}
Jul 28 22:13:44.311465 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:44.311426    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rkwww" event={"ID":"b602404e-1aef-416c-ab11-99c20549b324","Type":"ContainerStarted","Data":"53e1bc63893cf7d78d2c9c44435d7845491bb82e99b9cb62df50dd1b4fe289cd"}
Jul 28 22:13:44.312747 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:44.312711    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9" event={"ID":"7f18a44c-ab99-4543-b19c-39e654f4dca0","Type":"ContainerStarted","Data":"59532c478520d2df01e90b693cf02bd09581e5372d862a110077768168fe8c7a"}
Jul 28 22:13:45.514111 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:45.514079    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:13:45.514367 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:45.514162    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:13:45.514367 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:45.514196    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:13:46.333067 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:46.332137    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j" event={"ID":"e04ffdad-4477-43df-9e3c-c2e535aa48e2","Type":"ContainerStarted","Data":"abe6bf23ea7d449520e0ba2da9a99d1d06cdeb9355fa7f006af0efbe43497e91"}
Jul 28 22:13:46.356438 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:46.356341    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j" podStartSLOduration=1.504052895 podStartE2EDuration="5.356318806s" totalImagesPullingTime="3.852265911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:13:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:13:46.354881496 +0000 UTC m=+527.350470082" watchObservedRunningTime="2026-07-28 22:13:46.356318806 +0000 UTC m=+527.351907392"
Jul 28 22:13:46.528403 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:46.528321    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:46.534553 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:46.534527    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:47.339621 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:47.339583    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:47.341133 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:47.341074    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799csnz9j"
Jul 28 22:13:49.348948 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:49.348907    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht" event={"ID":"c12a7e2e-5362-47bb-ac44-d5e4073fa403","Type":"ContainerStarted","Data":"d9a5240f9a8ca156d19dd9637355ed1a68687b0ac7e625f954e2d75deba2be0a"}
Jul 28 22:13:49.349422 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:49.349038    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:13:49.350494 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:49.350464    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rkwww" event={"ID":"b602404e-1aef-416c-ab11-99c20549b324","Type":"ContainerStarted","Data":"149bc0fb522477772d75a8eb0a292bba0bd5c94ac30ff72bd1c191dc98296827"}
Jul 28 22:13:49.350627 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:49.350517    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rkwww"
Jul 28 22:13:49.351896 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:49.351869    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9" event={"ID":"7f18a44c-ab99-4543-b19c-39e654f4dca0","Type":"ContainerStarted","Data":"b3bf67e300c70ca7f80fdce6fae1dca7f42a0cb5df9b5d6400eb920206508aec"}
Jul 28 22:13:49.352065 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:49.352046    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9"
Jul 28 22:13:49.365492 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:49.365450    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht" podStartSLOduration=1.5671419530000001 podStartE2EDuration="6.365437134s" totalImagesPullingTime="4.798295181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:13:49.364427669 +0000 UTC m=+530.360016270" watchObservedRunningTime="2026-07-28 22:13:49.365437134 +0000 UTC m=+530.361025715"
Jul 28 22:13:49.379231 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:49.379196    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9" podStartSLOduration=1.523137859 podStartE2EDuration="6.379184214s" totalImagesPullingTime="4.856046355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:13:49.378728708 +0000 UTC m=+530.374317290" watchObservedRunningTime="2026-07-28 22:13:49.379184214 +0000 UTC m=+530.374772841"
Jul 28 22:13:49.394782 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:13:49.394740    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rkwww" podStartSLOduration=1.525104508 podStartE2EDuration="6.394728197s" totalImagesPullingTime="4.869623689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:13:49.394159641 +0000 UTC m=+530.389748222" watchObservedRunningTime="2026-07-28 22:13:49.394728197 +0000 UTC m=+530.390316782"
Jul 28 22:14:00.357653 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:14:00.357583    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75cf9697f-w9qht"
Jul 28 22:14:20.357917 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:14:20.357795    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nsqf9"
Jul 28 22:14:20.360719 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:14:20.360697    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rkwww"
Jul 28 22:14:59.411230 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:14:59.411200    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:14:59.412364 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:14:59.412346    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:15:12.215984 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:12.215951    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlskb"]
Jul 28 22:15:12.218157 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:12.218140    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlskb"
Jul 28 22:15:12.220015 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:12.219998    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 28 22:15:12.220252 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:12.220239    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-v86tb\""
Jul 28 22:15:12.220560 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:12.220543    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 22:15:12.220616 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:12.220585    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 22:15:12.229463 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:12.229439    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlskb"]
Jul 28 22:15:12.296897 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:12.296868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqf5n\" (UniqueName: \"kubernetes.io/projected/d9b6bddd-d25b-48da-92a5-bce0f8df552e-kube-api-access-cqf5n\") pod \"dns-operator-controller-manager-864dd78c4c-qlskb\" (UID: \"d9b6bddd-d25b-48da-92a5-bce0f8df552e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlskb"
Jul 28 22:15:12.397994 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:12.397958    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqf5n\" (UniqueName: \"kubernetes.io/projected/d9b6bddd-d25b-48da-92a5-bce0f8df552e-kube-api-access-cqf5n\") pod \"dns-operator-controller-manager-864dd78c4c-qlskb\" (UID: \"d9b6bddd-d25b-48da-92a5-bce0f8df552e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlskb"
Jul 28 22:15:12.410775 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:12.410747    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqf5n\" (UniqueName: \"kubernetes.io/projected/d9b6bddd-d25b-48da-92a5-bce0f8df552e-kube-api-access-cqf5n\") pod \"dns-operator-controller-manager-864dd78c4c-qlskb\" (UID: \"d9b6bddd-d25b-48da-92a5-bce0f8df552e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlskb"
Jul 28 22:15:12.528475 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:12.528402    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlskb"
Jul 28 22:15:12.656790 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:12.656760    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlskb"]
Jul 28 22:15:12.659524 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:15:12.659497    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b6bddd_d25b_48da_92a5_bce0f8df552e.slice/crio-b8bf741f01fed5f625fe9c35be53b33f846da4a5dca8a994612df92502db37dc WatchSource:0}: Error finding container b8bf741f01fed5f625fe9c35be53b33f846da4a5dca8a994612df92502db37dc: Status 404 returned error can't find the container with id b8bf741f01fed5f625fe9c35be53b33f846da4a5dca8a994612df92502db37dc
Jul 28 22:15:12.693979 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:12.693950    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlskb" event={"ID":"d9b6bddd-d25b-48da-92a5-bce0f8df552e","Type":"ContainerStarted","Data":"b8bf741f01fed5f625fe9c35be53b33f846da4a5dca8a994612df92502db37dc"}
Jul 28 22:15:14.818998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:14.818965    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"]
Jul 28 22:15:14.823628 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:14.823602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:14.826520 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:14.826496    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kn4bn\""
Jul 28 22:15:14.830762 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:14.830740    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"]
Jul 28 22:15:14.915395 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:14.915357    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dckv8\" (UniqueName: \"kubernetes.io/projected/207ecd98-f788-4c4b-8a12-a592243d3c78-kube-api-access-dckv8\") pod \"limitador-operator-controller-manager-859d7b78bd-trh8p\" (UID: \"207ecd98-f788-4c4b-8a12-a592243d3c78\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:15.016288 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:15.016253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dckv8\" (UniqueName: \"kubernetes.io/projected/207ecd98-f788-4c4b-8a12-a592243d3c78-kube-api-access-dckv8\") pod \"limitador-operator-controller-manager-859d7b78bd-trh8p\" (UID: \"207ecd98-f788-4c4b-8a12-a592243d3c78\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:15.027543 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:15.027514    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dckv8\" (UniqueName: \"kubernetes.io/projected/207ecd98-f788-4c4b-8a12-a592243d3c78-kube-api-access-dckv8\") pod \"limitador-operator-controller-manager-859d7b78bd-trh8p\" (UID: \"207ecd98-f788-4c4b-8a12-a592243d3c78\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:15.139139 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:15.139104    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:15.575407 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:15.575387    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"]
Jul 28 22:15:15.578079 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:15:15.578051    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod207ecd98_f788_4c4b_8a12_a592243d3c78.slice/crio-bfbbe40e1e989e5f11efed56d7faa7a3d1040c29d0112d867ebcbbbbf98c14da WatchSource:0}: Error finding container bfbbe40e1e989e5f11efed56d7faa7a3d1040c29d0112d867ebcbbbbf98c14da: Status 404 returned error can't find the container with id bfbbe40e1e989e5f11efed56d7faa7a3d1040c29d0112d867ebcbbbbf98c14da
Jul 28 22:15:15.707290 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:15.707198    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p" event={"ID":"207ecd98-f788-4c4b-8a12-a592243d3c78","Type":"ContainerStarted","Data":"bfbbe40e1e989e5f11efed56d7faa7a3d1040c29d0112d867ebcbbbbf98c14da"}
Jul 28 22:15:15.708625 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:15.708602    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlskb" event={"ID":"d9b6bddd-d25b-48da-92a5-bce0f8df552e","Type":"ContainerStarted","Data":"1d53f12a6cd3fd2c097df74350b5cd328c4eac9fbca5536f0729c02ef8659e40"}
Jul 28 22:15:15.708731 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:15.708725    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlskb"
Jul 28 22:15:15.724271 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:15.724231    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlskb" podStartSLOduration=0.902452398 podStartE2EDuration="3.724216545s" totalImagesPullingTime="2.821764147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:15:15.722889664 +0000 UTC m=+616.718478246" watchObservedRunningTime="2026-07-28 22:15:15.724216545 +0000 UTC m=+616.719805126"
Jul 28 22:15:17.722329 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:17.722207    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p" event={"ID":"207ecd98-f788-4c4b-8a12-a592243d3c78","Type":"ContainerStarted","Data":"64169c4db6b7cf242a16fe9a6531d8dabb1b4900638c708f398bcef32dcf0745"}
Jul 28 22:15:17.722760 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:17.722347    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:17.741739 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:17.741685    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p" podStartSLOduration=1.9001881109999998 podStartE2EDuration="3.741667071s" totalImagesPullingTime="1.84147896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:15:17.739207411 +0000 UTC m=+618.734796004" watchObservedRunningTime="2026-07-28 22:15:17.741667071 +0000 UTC m=+618.737255655"
Jul 28 22:15:26.717762 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:26.717686    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlskb"
Jul 28 22:15:27.709683 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:27.709648    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"]
Jul 28 22:15:27.712865 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:27.712849    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"
Jul 28 22:15:27.715022 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:27.715000    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pknb7\""
Jul 28 22:15:27.719570 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:27.719546    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"]
Jul 28 22:15:27.823783 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:27.823754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxjxn\" (UniqueName: \"kubernetes.io/projected/b957b201-554b-4c98-8013-b9bec70d7ddd-kube-api-access-dxjxn\") pod \"kuadrant-operator-controller-manager-55467d9f7-k7c5w\" (UID: \"b957b201-554b-4c98-8013-b9bec70d7ddd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"
Jul 28 22:15:27.823783 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:27.823789    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b957b201-554b-4c98-8013-b9bec70d7ddd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-k7c5w\" (UID: \"b957b201-554b-4c98-8013-b9bec70d7ddd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"
Jul 28 22:15:27.924849 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:27.924786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxjxn\" (UniqueName: \"kubernetes.io/projected/b957b201-554b-4c98-8013-b9bec70d7ddd-kube-api-access-dxjxn\") pod \"kuadrant-operator-controller-manager-55467d9f7-k7c5w\" (UID: \"b957b201-554b-4c98-8013-b9bec70d7ddd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"
Jul 28 22:15:27.925031 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:27.924854    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b957b201-554b-4c98-8013-b9bec70d7ddd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-k7c5w\" (UID: \"b957b201-554b-4c98-8013-b9bec70d7ddd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"
Jul 28 22:15:27.925223 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:27.925205    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b957b201-554b-4c98-8013-b9bec70d7ddd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-k7c5w\" (UID: \"b957b201-554b-4c98-8013-b9bec70d7ddd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"
Jul 28 22:15:27.933986 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:27.933963    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxjxn\" (UniqueName: \"kubernetes.io/projected/b957b201-554b-4c98-8013-b9bec70d7ddd-kube-api-access-dxjxn\") pod \"kuadrant-operator-controller-manager-55467d9f7-k7c5w\" (UID: \"b957b201-554b-4c98-8013-b9bec70d7ddd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"
Jul 28 22:15:28.023584 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.023510    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"
Jul 28 22:15:28.111814 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.111784    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"]
Jul 28 22:15:28.116003 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.115977    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"]
Jul 28 22:15:28.136307 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.136272    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"]
Jul 28 22:15:28.140015 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.139994    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"
Jul 28 22:15:28.159699 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.159665    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"]
Jul 28 22:15:28.161678 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.161587    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"]
Jul 28 22:15:28.161869 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.161803    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p" podUID="207ecd98-f788-4c4b-8a12-a592243d3c78" containerName="manager" containerID="cri-o://64169c4db6b7cf242a16fe9a6531d8dabb1b4900638c708f398bcef32dcf0745" gracePeriod=2
Jul 28 22:15:28.163586 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.163567    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:28.177055 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.176997    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"]
Jul 28 22:15:28.177540 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:15:28.177500    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-trh8p\" is forbidden: User \"system:node:ip-10-0-134-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-211.ec2.internal' and this object" podUID="207ecd98-f788-4c4b-8a12-a592243d3c78" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:28.197193 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.197165    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8c6t"]
Jul 28 22:15:28.197679 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.197662    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="207ecd98-f788-4c4b-8a12-a592243d3c78" containerName="manager"
Jul 28 22:15:28.197735 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.197684    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="207ecd98-f788-4c4b-8a12-a592243d3c78" containerName="manager"
Jul 28 22:15:28.197782 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.197768    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="207ecd98-f788-4c4b-8a12-a592243d3c78" containerName="manager"
Jul 28 22:15:28.200887 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.200866    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8c6t"
Jul 28 22:15:28.218402 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.218244    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8c6t"]
Jul 28 22:15:28.227481 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.227454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s8zz\" (UniqueName: \"kubernetes.io/projected/6e495d59-fcba-4661-856a-32ae821606bf-kube-api-access-4s8zz\") pod \"kuadrant-operator-controller-manager-55467d9f7-gvsbk\" (UID: \"6e495d59-fcba-4661-856a-32ae821606bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"
Jul 28 22:15:28.227615 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.227518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e495d59-fcba-4661-856a-32ae821606bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gvsbk\" (UID: \"6e495d59-fcba-4661-856a-32ae821606bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"
Jul 28 22:15:28.227680 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.227656    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhqf6\" (UniqueName: \"kubernetes.io/projected/df1bf9a1-8d53-439d-85f5-3542257fceb2-kube-api-access-vhqf6\") pod \"limitador-operator-controller-manager-859d7b78bd-v8c6t\" (UID: \"df1bf9a1-8d53-439d-85f5-3542257fceb2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8c6t"
Jul 28 22:15:28.233005 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:15:28.232971    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-trh8p\" is forbidden: User \"system:node:ip-10-0-134-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-211.ec2.internal' and this object" podUID="207ecd98-f788-4c4b-8a12-a592243d3c78" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:28.280718 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:15:28.280687    2564 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 28 22:15:28.280718 ip-10-0-134-211 kubenswrapper[2564]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-k7c5w_kuadrant-system_b957b201-554b-4c98-8013-b9bec70d7ddd_0(0b5259bdb1e23de1047bd3f513f176d6a99d081494ac5980795fd87b5d0ce45a): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-k7c5w to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0b5259bdb1e23de1047bd3f513f176d6a99d081494ac5980795fd87b5d0ce45a" Netns:"/var/run/netns/dbdc68e1-df70-42a7-9fde-7ece5eb7d993" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-k7c5w;K8S_POD_INFRA_CONTAINER_ID=0b5259bdb1e23de1047bd3f513f176d6a99d081494ac5980795fd87b5d0ce45a;K8S_POD_UID=b957b201-554b-4c98-8013-b9bec70d7ddd" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w/b957b201-554b-4c98-8013-b9bec70d7ddd:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w 0b5259bdb1e23de1047bd3f513f176d6a99d081494ac5980795fd87b5d0ce45a network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:17 [10.133.0.23/23]
Jul 28 22:15:28.280718 ip-10-0-134-211 kubenswrapper[2564]:         '
Jul 28 22:15:28.280718 ip-10-0-134-211 kubenswrapper[2564]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 28 22:15:28.280718 ip-10-0-134-211 kubenswrapper[2564]:  >
Jul 28 22:15:28.281049 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:15:28.280742    2564 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 28 22:15:28.281049 ip-10-0-134-211 kubenswrapper[2564]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-k7c5w_kuadrant-system_b957b201-554b-4c98-8013-b9bec70d7ddd_0(0b5259bdb1e23de1047bd3f513f176d6a99d081494ac5980795fd87b5d0ce45a): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-k7c5w to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0b5259bdb1e23de1047bd3f513f176d6a99d081494ac5980795fd87b5d0ce45a" Netns:"/var/run/netns/dbdc68e1-df70-42a7-9fde-7ece5eb7d993" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-k7c5w;K8S_POD_INFRA_CONTAINER_ID=0b5259bdb1e23de1047bd3f513f176d6a99d081494ac5980795fd87b5d0ce45a;K8S_POD_UID=b957b201-554b-4c98-8013-b9bec70d7ddd" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w/b957b201-554b-4c98-8013-b9bec70d7ddd:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w 0b5259bdb1e23de1047bd3f513f176d6a99d081494ac5980795fd87b5d0ce45a network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:17 [10.133.0.23/23]
Jul 28 22:15:28.281049 ip-10-0-134-211 kubenswrapper[2564]:         '
Jul 28 22:15:28.281049 ip-10-0-134-211 kubenswrapper[2564]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 28 22:15:28.281049 ip-10-0-134-211 kubenswrapper[2564]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"
Jul 28 22:15:28.328427 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.328388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e495d59-fcba-4661-856a-32ae821606bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gvsbk\" (UID: \"6e495d59-fcba-4661-856a-32ae821606bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"
Jul 28 22:15:28.328598 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.328465    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhqf6\" (UniqueName: \"kubernetes.io/projected/df1bf9a1-8d53-439d-85f5-3542257fceb2-kube-api-access-vhqf6\") pod \"limitador-operator-controller-manager-859d7b78bd-v8c6t\" (UID: \"df1bf9a1-8d53-439d-85f5-3542257fceb2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8c6t"
Jul 28 22:15:28.328598 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.328496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s8zz\" (UniqueName: \"kubernetes.io/projected/6e495d59-fcba-4661-856a-32ae821606bf-kube-api-access-4s8zz\") pod \"kuadrant-operator-controller-manager-55467d9f7-gvsbk\" (UID: \"6e495d59-fcba-4661-856a-32ae821606bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"
Jul 28 22:15:28.328810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.328787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e495d59-fcba-4661-856a-32ae821606bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gvsbk\" (UID: \"6e495d59-fcba-4661-856a-32ae821606bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"
Jul 28 22:15:28.337746 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.337718    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s8zz\" (UniqueName: \"kubernetes.io/projected/6e495d59-fcba-4661-856a-32ae821606bf-kube-api-access-4s8zz\") pod \"kuadrant-operator-controller-manager-55467d9f7-gvsbk\" (UID: \"6e495d59-fcba-4661-856a-32ae821606bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"
Jul 28 22:15:28.338309 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.338281    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhqf6\" (UniqueName: \"kubernetes.io/projected/df1bf9a1-8d53-439d-85f5-3542257fceb2-kube-api-access-vhqf6\") pod \"limitador-operator-controller-manager-859d7b78bd-v8c6t\" (UID: \"df1bf9a1-8d53-439d-85f5-3542257fceb2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8c6t"
Jul 28 22:15:28.392805 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.392780    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:28.394503 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:15:28.394478    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-trh8p\" is forbidden: User \"system:node:ip-10-0-134-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-211.ec2.internal' and this object" podUID="207ecd98-f788-4c4b-8a12-a592243d3c78" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:28.429371 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.429346    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dckv8\" (UniqueName: \"kubernetes.io/projected/207ecd98-f788-4c4b-8a12-a592243d3c78-kube-api-access-dckv8\") pod \"207ecd98-f788-4c4b-8a12-a592243d3c78\" (UID: \"207ecd98-f788-4c4b-8a12-a592243d3c78\") "
Jul 28 22:15:28.431405 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.431385    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/207ecd98-f788-4c4b-8a12-a592243d3c78-kube-api-access-dckv8" (OuterVolumeSpecName: "kube-api-access-dckv8") pod "207ecd98-f788-4c4b-8a12-a592243d3c78" (UID: "207ecd98-f788-4c4b-8a12-a592243d3c78"). InnerVolumeSpecName "kube-api-access-dckv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:15:28.452573 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.452550    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"
Jul 28 22:15:28.530963 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.530935    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dckv8\" (UniqueName: \"kubernetes.io/projected/207ecd98-f788-4c4b-8a12-a592243d3c78-kube-api-access-dckv8\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:15:28.546361 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.546335    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8c6t"
Jul 28 22:15:28.577841 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.577806    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"]
Jul 28 22:15:28.580245 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:15:28.580223    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e495d59_fcba_4661_856a_32ae821606bf.slice/crio-204dfb07d238664ad4a9cdea4821d09eb92cf1dc94b6d9694b9440c6ffd7e738 WatchSource:0}: Error finding container 204dfb07d238664ad4a9cdea4821d09eb92cf1dc94b6d9694b9440c6ffd7e738: Status 404 returned error can't find the container with id 204dfb07d238664ad4a9cdea4821d09eb92cf1dc94b6d9694b9440c6ffd7e738
Jul 28 22:15:28.680841 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.680805    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8c6t"]
Jul 28 22:15:28.683266 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:15:28.683245    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf1bf9a1_8d53_439d_85f5_3542257fceb2.slice/crio-9926738e402a736f2c5c91c9879b4e3813c776f361b99ae0934dae44172174b3 WatchSource:0}: Error finding container 9926738e402a736f2c5c91c9879b4e3813c776f361b99ae0934dae44172174b3: Status 404 returned error can't find the container with id 9926738e402a736f2c5c91c9879b4e3813c776f361b99ae0934dae44172174b3
Jul 28 22:15:28.771226 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.771193    2564 generic.go:356] "Generic (PLEG): container finished" podID="207ecd98-f788-4c4b-8a12-a592243d3c78" containerID="64169c4db6b7cf242a16fe9a6531d8dabb1b4900638c708f398bcef32dcf0745" exitCode=0
Jul 28 22:15:28.771587 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.771236    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:28.771587 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.771289    2564 scope.go:117] "RemoveContainer" containerID="64169c4db6b7cf242a16fe9a6531d8dabb1b4900638c708f398bcef32dcf0745"
Jul 28 22:15:28.773057 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.773030    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8c6t" event={"ID":"df1bf9a1-8d53-439d-85f5-3542257fceb2","Type":"ContainerStarted","Data":"b24f9537343577bcb0c7e910772b9a07ec2a275fb6bb8b8047f4bc57de4109b4"}
Jul 28 22:15:28.773179 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:15:28.773061    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-trh8p\" is forbidden: User \"system:node:ip-10-0-134-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-211.ec2.internal' and this object" podUID="207ecd98-f788-4c4b-8a12-a592243d3c78" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:28.773179 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.773093    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8c6t"
Jul 28 22:15:28.773179 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.773120    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8c6t" event={"ID":"df1bf9a1-8d53-439d-85f5-3542257fceb2","Type":"ContainerStarted","Data":"9926738e402a736f2c5c91c9879b4e3813c776f361b99ae0934dae44172174b3"}
Jul 28 22:15:28.774513 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.774495    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"
Jul 28 22:15:28.774513 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.774500    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk" event={"ID":"6e495d59-fcba-4661-856a-32ae821606bf","Type":"ContainerStarted","Data":"204dfb07d238664ad4a9cdea4821d09eb92cf1dc94b6d9694b9440c6ffd7e738"}
Jul 28 22:15:28.780003 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.779941    2564 scope.go:117] "RemoveContainer" containerID="64169c4db6b7cf242a16fe9a6531d8dabb1b4900638c708f398bcef32dcf0745"
Jul 28 22:15:28.780259 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:15:28.780238    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64169c4db6b7cf242a16fe9a6531d8dabb1b4900638c708f398bcef32dcf0745\": container with ID starting with 64169c4db6b7cf242a16fe9a6531d8dabb1b4900638c708f398bcef32dcf0745 not found: ID does not exist" containerID="64169c4db6b7cf242a16fe9a6531d8dabb1b4900638c708f398bcef32dcf0745"
Jul 28 22:15:28.780352 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.780267    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64169c4db6b7cf242a16fe9a6531d8dabb1b4900638c708f398bcef32dcf0745"} err="failed to get container status \"64169c4db6b7cf242a16fe9a6531d8dabb1b4900638c708f398bcef32dcf0745\": rpc error: code = NotFound desc = could not find container \"64169c4db6b7cf242a16fe9a6531d8dabb1b4900638c708f398bcef32dcf0745\": container with ID starting with 64169c4db6b7cf242a16fe9a6531d8dabb1b4900638c708f398bcef32dcf0745 not found: ID does not exist"
Jul 28 22:15:28.782274 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.782261    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"
Jul 28 22:15:28.787148 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.787109    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8c6t" podStartSLOduration=0.78709861 podStartE2EDuration="787.09861ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:15:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:15:28.786611965 +0000 UTC m=+629.782200549" watchObservedRunningTime="2026-07-28 22:15:28.78709861 +0000 UTC m=+629.782687247"
Jul 28 22:15:28.787976 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:15:28.787956    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-trh8p\" is forbidden: User \"system:node:ip-10-0-134-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-211.ec2.internal' and this object" podUID="207ecd98-f788-4c4b-8a12-a592243d3c78" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:28.789201 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:15:28.789180    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-k7c5w\" is forbidden: User \"system:node:ip-10-0-134-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-211.ec2.internal' and this object" podUID="b957b201-554b-4c98-8013-b9bec70d7ddd" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"
Jul 28 22:15:28.790287 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:15:28.790267    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-trh8p\" is forbidden: User \"system:node:ip-10-0-134-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-211.ec2.internal' and this object" podUID="207ecd98-f788-4c4b-8a12-a592243d3c78" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:28.833336 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.833305    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxjxn\" (UniqueName: \"kubernetes.io/projected/b957b201-554b-4c98-8013-b9bec70d7ddd-kube-api-access-dxjxn\") pod \"b957b201-554b-4c98-8013-b9bec70d7ddd\" (UID: \"b957b201-554b-4c98-8013-b9bec70d7ddd\") "
Jul 28 22:15:28.833452 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.833358    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b957b201-554b-4c98-8013-b9bec70d7ddd-extensions-socket-volume\") pod \"b957b201-554b-4c98-8013-b9bec70d7ddd\" (UID: \"b957b201-554b-4c98-8013-b9bec70d7ddd\") "
Jul 28 22:15:28.833581 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.833561    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b957b201-554b-4c98-8013-b9bec70d7ddd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b957b201-554b-4c98-8013-b9bec70d7ddd" (UID: "b957b201-554b-4c98-8013-b9bec70d7ddd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:15:28.835358 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.835326    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b957b201-554b-4c98-8013-b9bec70d7ddd-kube-api-access-dxjxn" (OuterVolumeSpecName: "kube-api-access-dxjxn") pod "b957b201-554b-4c98-8013-b9bec70d7ddd" (UID: "b957b201-554b-4c98-8013-b9bec70d7ddd"). InnerVolumeSpecName "kube-api-access-dxjxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:15:28.933981 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.933955    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxjxn\" (UniqueName: \"kubernetes.io/projected/b957b201-554b-4c98-8013-b9bec70d7ddd-kube-api-access-dxjxn\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:15:28.933981 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:28.933979    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b957b201-554b-4c98-8013-b9bec70d7ddd-extensions-socket-volume\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:15:29.507486 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:15:29.507446    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-k7c5w\" is forbidden: User \"system:node:ip-10-0-134-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-211.ec2.internal' and this object" podUID="b957b201-554b-4c98-8013-b9bec70d7ddd" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"
Jul 28 22:15:29.510056 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:15:29.510019    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-trh8p\" is forbidden: User \"system:node:ip-10-0-134-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-211.ec2.internal' and this object" podUID="207ecd98-f788-4c4b-8a12-a592243d3c78" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-trh8p"
Jul 28 22:15:29.510242 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:29.510218    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="207ecd98-f788-4c4b-8a12-a592243d3c78" path="/var/lib/kubelet/pods/207ecd98-f788-4c4b-8a12-a592243d3c78/volumes"
Jul 28 22:15:29.510931 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:29.510682    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b957b201-554b-4c98-8013-b9bec70d7ddd" path="/var/lib/kubelet/pods/b957b201-554b-4c98-8013-b9bec70d7ddd/volumes"
Jul 28 22:15:29.780995 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:29.780914    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"
Jul 28 22:15:29.785759 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:15:29.785718    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-k7c5w\" is forbidden: User \"system:node:ip-10-0-134-211.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-211.ec2.internal' and this object" podUID="b957b201-554b-4c98-8013-b9bec70d7ddd" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-k7c5w"
Jul 28 22:15:32.796201 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:32.796160    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk" event={"ID":"6e495d59-fcba-4661-856a-32ae821606bf","Type":"ContainerStarted","Data":"d5313d29a0fc548a81f746a7dc129639c68f4bfe307af44663704c03219fb35b"}
Jul 28 22:15:32.796661 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:32.796240    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"
Jul 28 22:15:32.816222 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:32.816153    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk" podStartSLOduration=1.141960165 podStartE2EDuration="4.81613389s" totalImagesPullingTime="3.674173725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:15:32.815672596 +0000 UTC m=+633.811261178" watchObservedRunningTime="2026-07-28 22:15:32.81613389 +0000 UTC m=+633.811722472"
Jul 28 22:15:39.783177 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:39.783147    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v8c6t"
Jul 28 22:15:43.802708 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:43.802671    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"
Jul 28 22:15:56.503406 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.503364    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"]
Jul 28 22:15:56.503975 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.503578    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk" podUID="6e495d59-fcba-4661-856a-32ae821606bf" containerName="manager" containerID="cri-o://d5313d29a0fc548a81f746a7dc129639c68f4bfe307af44663704c03219fb35b" gracePeriod=10
Jul 28 22:15:56.746406 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.746380    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"
Jul 28 22:15:56.890490 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.890450    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s8zz\" (UniqueName: \"kubernetes.io/projected/6e495d59-fcba-4661-856a-32ae821606bf-kube-api-access-4s8zz\") pod \"6e495d59-fcba-4661-856a-32ae821606bf\" (UID: \"6e495d59-fcba-4661-856a-32ae821606bf\") "
Jul 28 22:15:56.890691 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.890505    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e495d59-fcba-4661-856a-32ae821606bf-extensions-socket-volume\") pod \"6e495d59-fcba-4661-856a-32ae821606bf\" (UID: \"6e495d59-fcba-4661-856a-32ae821606bf\") "
Jul 28 22:15:56.891049 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.891013    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e495d59-fcba-4661-856a-32ae821606bf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6e495d59-fcba-4661-856a-32ae821606bf" (UID: "6e495d59-fcba-4661-856a-32ae821606bf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:15:56.892649 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.892618    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e495d59-fcba-4661-856a-32ae821606bf-kube-api-access-4s8zz" (OuterVolumeSpecName: "kube-api-access-4s8zz") pod "6e495d59-fcba-4661-856a-32ae821606bf" (UID: "6e495d59-fcba-4661-856a-32ae821606bf"). InnerVolumeSpecName "kube-api-access-4s8zz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:15:56.902889 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.902862    2564 generic.go:356] "Generic (PLEG): container finished" podID="6e495d59-fcba-4661-856a-32ae821606bf" containerID="d5313d29a0fc548a81f746a7dc129639c68f4bfe307af44663704c03219fb35b" exitCode=0
Jul 28 22:15:56.902994 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.902893    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"
Jul 28 22:15:56.902994 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.902924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk" event={"ID":"6e495d59-fcba-4661-856a-32ae821606bf","Type":"ContainerDied","Data":"d5313d29a0fc548a81f746a7dc129639c68f4bfe307af44663704c03219fb35b"}
Jul 28 22:15:56.902994 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.902974    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk" event={"ID":"6e495d59-fcba-4661-856a-32ae821606bf","Type":"ContainerDied","Data":"204dfb07d238664ad4a9cdea4821d09eb92cf1dc94b6d9694b9440c6ffd7e738"}
Jul 28 22:15:56.903152 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.902997    2564 scope.go:117] "RemoveContainer" containerID="d5313d29a0fc548a81f746a7dc129639c68f4bfe307af44663704c03219fb35b"
Jul 28 22:15:56.912210 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.912193    2564 scope.go:117] "RemoveContainer" containerID="d5313d29a0fc548a81f746a7dc129639c68f4bfe307af44663704c03219fb35b"
Jul 28 22:15:56.912475 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:15:56.912456    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5313d29a0fc548a81f746a7dc129639c68f4bfe307af44663704c03219fb35b\": container with ID starting with d5313d29a0fc548a81f746a7dc129639c68f4bfe307af44663704c03219fb35b not found: ID does not exist" containerID="d5313d29a0fc548a81f746a7dc129639c68f4bfe307af44663704c03219fb35b"
Jul 28 22:15:56.912535 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.912488    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5313d29a0fc548a81f746a7dc129639c68f4bfe307af44663704c03219fb35b"} err="failed to get container status \"d5313d29a0fc548a81f746a7dc129639c68f4bfe307af44663704c03219fb35b\": rpc error: code = NotFound desc = could not find container \"d5313d29a0fc548a81f746a7dc129639c68f4bfe307af44663704c03219fb35b\": container with ID starting with d5313d29a0fc548a81f746a7dc129639c68f4bfe307af44663704c03219fb35b not found: ID does not exist"
Jul 28 22:15:56.930486 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.930456    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"]
Jul 28 22:15:56.932343 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.932320    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gvsbk"]
Jul 28 22:15:56.992057 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.992021    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s8zz\" (UniqueName: \"kubernetes.io/projected/6e495d59-fcba-4661-856a-32ae821606bf-kube-api-access-4s8zz\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:15:56.992057 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:56.992055    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e495d59-fcba-4661-856a-32ae821606bf-extensions-socket-volume\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:15:57.507551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:15:57.507518    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e495d59-fcba-4661-856a-32ae821606bf" path="/var/lib/kubelet/pods/6e495d59-fcba-4661-856a-32ae821606bf/volumes"
Jul 28 22:16:00.236451 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.236417    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"]
Jul 28 22:16:00.236845 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.236738    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e495d59-fcba-4661-856a-32ae821606bf" containerName="manager"
Jul 28 22:16:00.236845 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.236749    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e495d59-fcba-4661-856a-32ae821606bf" containerName="manager"
Jul 28 22:16:00.236845 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.236815    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e495d59-fcba-4661-856a-32ae821606bf" containerName="manager"
Jul 28 22:16:00.240596 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.240579    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.242464 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.242450    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-59ds6\""
Jul 28 22:16:00.251984 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.251961    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"]
Jul 28 22:16:00.418708 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.418664    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22cd99ff-18bb-41cf-a90c-41df4020b3a1-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.418946 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.418724    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbww4\" (UniqueName: \"kubernetes.io/projected/22cd99ff-18bb-41cf-a90c-41df4020b3a1-kube-api-access-hbww4\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.418946 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.418777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22cd99ff-18bb-41cf-a90c-41df4020b3a1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.418946 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.418811    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22cd99ff-18bb-41cf-a90c-41df4020b3a1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.418946 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.418870    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22cd99ff-18bb-41cf-a90c-41df4020b3a1-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.418946 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.418932    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22cd99ff-18bb-41cf-a90c-41df4020b3a1-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.419143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.418960    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22cd99ff-18bb-41cf-a90c-41df4020b3a1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.419143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.418988    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22cd99ff-18bb-41cf-a90c-41df4020b3a1-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.419143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.419061    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22cd99ff-18bb-41cf-a90c-41df4020b3a1-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.520028 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.519939    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22cd99ff-18bb-41cf-a90c-41df4020b3a1-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.520028 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.519976    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22cd99ff-18bb-41cf-a90c-41df4020b3a1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.520028 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.519997    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22cd99ff-18bb-41cf-a90c-41df4020b3a1-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.520028 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.520031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22cd99ff-18bb-41cf-a90c-41df4020b3a1-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.520342 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.520065    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22cd99ff-18bb-41cf-a90c-41df4020b3a1-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.520342 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.520246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbww4\" (UniqueName: \"kubernetes.io/projected/22cd99ff-18bb-41cf-a90c-41df4020b3a1-kube-api-access-hbww4\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.520342 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.520300    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22cd99ff-18bb-41cf-a90c-41df4020b3a1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.520342 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.520330    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22cd99ff-18bb-41cf-a90c-41df4020b3a1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.520529 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.520353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22cd99ff-18bb-41cf-a90c-41df4020b3a1-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.520529 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.520387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22cd99ff-18bb-41cf-a90c-41df4020b3a1-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.520618 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.520556    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22cd99ff-18bb-41cf-a90c-41df4020b3a1-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.520661 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.520614    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22cd99ff-18bb-41cf-a90c-41df4020b3a1-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.520802 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.520780    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22cd99ff-18bb-41cf-a90c-41df4020b3a1-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.521112 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.521094    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22cd99ff-18bb-41cf-a90c-41df4020b3a1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.522548 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.522526    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22cd99ff-18bb-41cf-a90c-41df4020b3a1-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.522635 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.522566    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22cd99ff-18bb-41cf-a90c-41df4020b3a1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.527877 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.527855    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22cd99ff-18bb-41cf-a90c-41df4020b3a1-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.528064 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.528036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbww4\" (UniqueName: \"kubernetes.io/projected/22cd99ff-18bb-41cf-a90c-41df4020b3a1-kube-api-access-hbww4\") pod \"maas-default-gateway-openshift-default-5ccb968c66-vvp5n\" (UID: \"22cd99ff-18bb-41cf-a90c-41df4020b3a1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.552899 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.552871    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:00.682875 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.682824    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"]
Jul 28 22:16:00.685205 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:16:00.685182    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22cd99ff_18bb_41cf_a90c_41df4020b3a1.slice/crio-1a6a2f726a87889cd60b15d20d540b2b47aa453ee90ab463ce2540e279548d17 WatchSource:0}: Error finding container 1a6a2f726a87889cd60b15d20d540b2b47aa453ee90ab463ce2540e279548d17: Status 404 returned error can't find the container with id 1a6a2f726a87889cd60b15d20d540b2b47aa453ee90ab463ce2540e279548d17
Jul 28 22:16:00.687415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.687384    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:16:00.687510 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.687463    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:16:00.687569 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.687506    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:16:00.925768 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.925730    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n" event={"ID":"22cd99ff-18bb-41cf-a90c-41df4020b3a1","Type":"ContainerStarted","Data":"bcbf63f0bbd81abbcb3a470cdb480c1ffa89ed4f67c9bf75600ef2d073b051b8"}
Jul 28 22:16:00.925982 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.925795    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n" event={"ID":"22cd99ff-18bb-41cf-a90c-41df4020b3a1","Type":"ContainerStarted","Data":"1a6a2f726a87889cd60b15d20d540b2b47aa453ee90ab463ce2540e279548d17"}
Jul 28 22:16:00.944259 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:00.944189    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n" podStartSLOduration=0.944173541 podStartE2EDuration="944.173541ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:16:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:16:00.942384075 +0000 UTC m=+661.937972657" watchObservedRunningTime="2026-07-28 22:16:00.944173541 +0000 UTC m=+661.939762185"
Jul 28 22:16:01.553645 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:01.553607    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:01.558368 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:01.558343    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:01.930484 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:01.930442    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:01.931509 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:01.931493    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:16:15.030450 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.030415    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:16:15.033130 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.033107    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"
Jul 28 22:16:15.034893 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.034874    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 28 22:16:15.034992 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.034975    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cltnz\""
Jul 28 22:16:15.045398 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.045369    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:16:15.075844 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.075790    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:16:15.154347 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.154314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8-config-file\") pod \"limitador-limitador-54d6d988d5-wtlnc\" (UID: \"0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"
Jul 28 22:16:15.154519 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.154354    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55db6\" (UniqueName: \"kubernetes.io/projected/0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8-kube-api-access-55db6\") pod \"limitador-limitador-54d6d988d5-wtlnc\" (UID: \"0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"
Jul 28 22:16:15.255111 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.255071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55db6\" (UniqueName: \"kubernetes.io/projected/0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8-kube-api-access-55db6\") pod \"limitador-limitador-54d6d988d5-wtlnc\" (UID: \"0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"
Jul 28 22:16:15.255284 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.255175    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8-config-file\") pod \"limitador-limitador-54d6d988d5-wtlnc\" (UID: \"0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"
Jul 28 22:16:15.255737 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.255719    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8-config-file\") pod \"limitador-limitador-54d6d988d5-wtlnc\" (UID: \"0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"
Jul 28 22:16:15.263160 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.263127    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55db6\" (UniqueName: \"kubernetes.io/projected/0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8-kube-api-access-55db6\") pod \"limitador-limitador-54d6d988d5-wtlnc\" (UID: \"0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"
Jul 28 22:16:15.344997 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.344915    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"
Jul 28 22:16:15.473723 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.473658    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:16:15.476182 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:16:15.476155    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b285f1f_3f64_4ab6_ad8c_0b28e0e3b4a8.slice/crio-57169d6520d25c27e7267c21d091e389e57f104461e99fc3faec1f2699539a38 WatchSource:0}: Error finding container 57169d6520d25c27e7267c21d091e389e57f104461e99fc3faec1f2699539a38: Status 404 returned error can't find the container with id 57169d6520d25c27e7267c21d091e389e57f104461e99fc3faec1f2699539a38
Jul 28 22:16:15.478567 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.478550    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 22:16:15.995415 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:15.995374    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wtlnc" event={"ID":"0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8","Type":"ContainerStarted","Data":"57169d6520d25c27e7267c21d091e389e57f104461e99fc3faec1f2699539a38"}
Jul 28 22:16:18.007695 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:18.007655    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wtlnc" event={"ID":"0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8","Type":"ContainerStarted","Data":"5a7b8ffccf3419b1164069e29674050439899c14d3cc654e23b0fe250a178e25"}
Jul 28 22:16:18.008100 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:18.007731    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"
Jul 28 22:16:18.024806 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:18.024761    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-wtlnc" podStartSLOduration=0.675709549 podStartE2EDuration="3.024745738s" totalImagesPullingTime="2.349036189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:16:18.023630438 +0000 UTC m=+679.019219034" watchObservedRunningTime="2026-07-28 22:16:18.024745738 +0000 UTC m=+679.020334319"
Jul 28 22:16:29.013785 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:16:29.013755    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"
Jul 28 22:17:30.393794 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:30.393761    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:17:38.364444 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:38.364407    2564 generic.go:356] "Generic (PLEG): container finished" podID="22cd99ff-18bb-41cf-a90c-41df4020b3a1" containerID="bcbf63f0bbd81abbcb3a470cdb480c1ffa89ed4f67c9bf75600ef2d073b051b8" exitCode=0
Jul 28 22:17:38.364996 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:38.364488    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n" event={"ID":"22cd99ff-18bb-41cf-a90c-41df4020b3a1","Type":"ContainerDied","Data":"bcbf63f0bbd81abbcb3a470cdb480c1ffa89ed4f67c9bf75600ef2d073b051b8"}
Jul 28 22:17:38.365074 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:38.364993    2564 scope.go:117] "RemoveContainer" containerID="bcbf63f0bbd81abbcb3a470cdb480c1ffa89ed4f67c9bf75600ef2d073b051b8"
Jul 28 22:17:38.366018 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:38.365992    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:17:38.366122 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:38.366091    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:17:38.366188 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:38.366137    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:17:39.370804 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:39.370770    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n" event={"ID":"22cd99ff-18bb-41cf-a90c-41df4020b3a1","Type":"ContainerStarted","Data":"0f15cb79fa031996387ed6cddcb036b97c62f38ab6eca993036d978a49e04cbe"}
Jul 28 22:17:39.553519 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:39.553477    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:17:39.553750 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:39.553725    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-vvp5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Jul 28 22:17:39.553851 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:39.553786    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n" podUID="22cd99ff-18bb-41cf-a90c-41df4020b3a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Jul 28 22:17:40.553801 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:40.553763    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-vvp5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Jul 28 22:17:40.554221 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:40.553816    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n" podUID="22cd99ff-18bb-41cf-a90c-41df4020b3a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Jul 28 22:17:41.554062 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:41.554028    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-vvp5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Jul 28 22:17:41.554487 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:41.554095    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n" podUID="22cd99ff-18bb-41cf-a90c-41df4020b3a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Jul 28 22:17:42.553390 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:42.553349    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-vvp5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Jul 28 22:17:42.553589 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:42.553414    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n" podUID="22cd99ff-18bb-41cf-a90c-41df4020b3a1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Jul 28 22:17:43.557154 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:43.557127    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:17:43.557536 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:43.557402    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:17:43.558082 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:43.558065    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-vvp5n"
Jul 28 22:17:46.889221 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:46.889188    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:17:59.701449 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:17:59.701415    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:18:09.987516 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:09.987484    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:18:25.491536 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:25.491461    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:18:40.495165 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:40.495134    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:18:54.981432 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:54.981400    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"]
Jul 28 22:18:54.984761 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:54.984741    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:54.987462 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:54.987438    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lntbc\""
Jul 28 22:18:54.987562 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:54.987478    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 28 22:18:54.987562 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:54.987450    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 22:18:54.987562 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:54.987440    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 22:18:54.996888 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:54.996866    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"]
Jul 28 22:18:55.139454 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.139425    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d91b65b5-3d5b-410e-a01c-28593a3cee55-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.139616 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.139475    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d91b65b5-3d5b-410e-a01c-28593a3cee55-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.139616 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.139541    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d91b65b5-3d5b-410e-a01c-28593a3cee55-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.139616 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.139610    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d91b65b5-3d5b-410e-a01c-28593a3cee55-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.139776 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.139668    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj9cf\" (UniqueName: \"kubernetes.io/projected/d91b65b5-3d5b-410e-a01c-28593a3cee55-kube-api-access-gj9cf\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.139776 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.139695    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d91b65b5-3d5b-410e-a01c-28593a3cee55-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.240329 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.240254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d91b65b5-3d5b-410e-a01c-28593a3cee55-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.240329 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.240298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d91b65b5-3d5b-410e-a01c-28593a3cee55-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.240499 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.240342    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d91b65b5-3d5b-410e-a01c-28593a3cee55-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.240499 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.240401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj9cf\" (UniqueName: \"kubernetes.io/projected/d91b65b5-3d5b-410e-a01c-28593a3cee55-kube-api-access-gj9cf\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.240499 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.240439    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d91b65b5-3d5b-410e-a01c-28593a3cee55-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.240499 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.240469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d91b65b5-3d5b-410e-a01c-28593a3cee55-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.240823 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.240799    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d91b65b5-3d5b-410e-a01c-28593a3cee55-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.240927 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.240864    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d91b65b5-3d5b-410e-a01c-28593a3cee55-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.240927 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.240896    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d91b65b5-3d5b-410e-a01c-28593a3cee55-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.242576 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.242555    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d91b65b5-3d5b-410e-a01c-28593a3cee55-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.242882 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.242857    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d91b65b5-3d5b-410e-a01c-28593a3cee55-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.248638 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.248609    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj9cf\" (UniqueName: \"kubernetes.io/projected/d91b65b5-3d5b-410e-a01c-28593a3cee55-kube-api-access-gj9cf\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-668ft\" (UID: \"d91b65b5-3d5b-410e-a01c-28593a3cee55\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.293966 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.293938    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:18:55.423844 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.423798    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"]
Jul 28 22:18:55.426842 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:18:55.426803    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd91b65b5_3d5b_410e_a01c_28593a3cee55.slice/crio-46feb1663e994b4b0ecc67043183030235aab065749f30787db02b7029c63fed WatchSource:0}: Error finding container 46feb1663e994b4b0ecc67043183030235aab065749f30787db02b7029c63fed: Status 404 returned error can't find the container with id 46feb1663e994b4b0ecc67043183030235aab065749f30787db02b7029c63fed
Jul 28 22:18:55.706711 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:55.706675    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft" event={"ID":"d91b65b5-3d5b-410e-a01c-28593a3cee55","Type":"ContainerStarted","Data":"46feb1663e994b4b0ecc67043183030235aab065749f30787db02b7029c63fed"}
Jul 28 22:18:56.712891 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:56.712807    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft" event={"ID":"d91b65b5-3d5b-410e-a01c-28593a3cee55","Type":"ContainerStarted","Data":"702ca6da53f3ef0f0ee85770e650db5fa346ecd958b39d5ce0f02d213bdee06d"}
Jul 28 22:18:56.727470 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:56.727405    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft" podStartSLOduration=1.7431434810000002 podStartE2EDuration="2.72735753s" totalImagesPullingTime="984.214049ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:18:56.72702101 +0000 UTC m=+837.722609591" watchObservedRunningTime="2026-07-28 22:18:56.72735753 +0000 UTC m=+837.722946115"
Jul 28 22:18:57.594463 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:18:57.594431    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:19:05.294593 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:19:05.294556    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:19:05.294593 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:19:05.294599    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:19:05.307302 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:19:05.307274    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:19:05.762989 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:19:05.762959    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-668ft"
Jul 28 22:19:59.437474 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:19:59.437398    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:19:59.440638 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:19:59.440616    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:20:26.604721 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:20:26.604686    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:20:36.997372 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:20:36.997336    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:20:47.306732 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:20:47.306692    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:22:26.392047 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:22:26.392002    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:22:37.387127 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:22:37.387089    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:23:13.399309 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:23:13.399273    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:23:22.894768 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:23:22.894734    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:23:31.687153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:23:31.687122    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:23:40.892169 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:23:40.892137    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:23:50.787873 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:23:50.787821    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:24:04.891346 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:24:04.891314    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:24:11.193753 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:24:11.193722    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:24:19.488608 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:24:19.488571    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:24:42.792920 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:24:42.792842    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:24:51.888186 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:24:51.888154    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:24:59.468264 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:24:59.468233    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:24:59.476648 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:24:59.476624    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:25:15.688322 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:25:15.688292    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:25:27.921324 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:25:27.921286    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:25:38.096368 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:25:38.096337    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:25:53.802051 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:25:53.801964    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:26:02.593442 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:26:02.593413    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:26:12.117563 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:26:12.117527    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:26:21.487849 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:26:21.487802    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:26:30.004217 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:26:30.004181    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:26:42.799363 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:26:42.799324    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:26:51.112222 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:26:51.112186    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:28:32.593499 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:28:32.593464    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:28:43.800865 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:28:43.800817    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:28:57.797051 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:28:57.796955    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:29:13.892103 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:29:13.892064    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:29:24.096899 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:29:24.096863    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:29:34.498225 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:29:34.498193    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:29:45.788169 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:29:45.788137    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:29:56.985413 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:29:56.985382    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:29:59.495516 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:29:59.495489    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:29:59.511538 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:29:59.511511    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:30:05.089267 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:30:05.089233    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:30:16.091241 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:30:16.091205    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:30:31.085765 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:30:31.085688    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:30:39.686411 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:30:39.686378    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:30:51.592444 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:30:51.592410    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:31:00.797399 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:00.797368    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:31:09.374357 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.374320    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"]
Jul 28 22:31:09.377419 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.377400    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.379334 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.379310    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-cc9cd1b9-kserve-self-signed-certs\""
Jul 28 22:31:09.386995 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.386976    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"]
Jul 28 22:31:09.479327 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.479297    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/951d395b-cfeb-4378-b7b6-b423905a3664-tls-certs\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.479486 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.479338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbgbp\" (UniqueName: \"kubernetes.io/projected/951d395b-cfeb-4378-b7b6-b423905a3664-kube-api-access-lbgbp\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.479486 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.479366    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-home\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.479486 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.479444    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-dshm\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.479486 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.479476    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-tmp-dir\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.479711 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.479490    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-model-cache\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.580061 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.580031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbgbp\" (UniqueName: \"kubernetes.io/projected/951d395b-cfeb-4378-b7b6-b423905a3664-kube-api-access-lbgbp\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.580249 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.580105    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-home\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.580249 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.580234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-dshm\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.580473 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.580452    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-tmp-dir\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.580555 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.580491    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-model-cache\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.580555 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.580494    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-home\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.580659 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.580636    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/951d395b-cfeb-4378-b7b6-b423905a3664-tls-certs\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.580751 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.580728    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-tmp-dir\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.580808 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.580778    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-model-cache\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.582553 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.582531    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-dshm\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.582817 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.582793    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/951d395b-cfeb-4378-b7b6-b423905a3664-tls-certs\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.588466 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.588445    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbgbp\" (UniqueName: \"kubernetes.io/projected/951d395b-cfeb-4378-b7b6-b423905a3664-kube-api-access-lbgbp\") pod \"e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") " pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.687709 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.687637    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:09.817216 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.817191    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"]
Jul 28 22:31:09.819700 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:31:09.819673    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod951d395b_cfeb_4378_b7b6_b423905a3664.slice/crio-02c8d5d9e12af2bb481e73b58478a00515dc64900e90802c3f281be39badb59f WatchSource:0}: Error finding container 02c8d5d9e12af2bb481e73b58478a00515dc64900e90802c3f281be39badb59f: Status 404 returned error can't find the container with id 02c8d5d9e12af2bb481e73b58478a00515dc64900e90802c3f281be39badb59f
Jul 28 22:31:09.984463 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.984375    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw" event={"ID":"951d395b-cfeb-4378-b7b6-b423905a3664","Type":"ContainerStarted","Data":"914ccf90eef842bcce0e7c48657c8fe5742fb87322e2ec8c48ecb8a6e4c36ab8"}
Jul 28 22:31:09.984463 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:09.984422    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw" event={"ID":"951d395b-cfeb-4378-b7b6-b423905a3664","Type":"ContainerStarted","Data":"02c8d5d9e12af2bb481e73b58478a00515dc64900e90802c3f281be39badb59f"}
Jul 28 22:31:10.000506 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:10.000457    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw" podStartSLOduration=1.000442355 podStartE2EDuration="1.000442355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:31:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:31:09.999010256 +0000 UTC m=+1570.994598840" watchObservedRunningTime="2026-07-28 22:31:10.000442355 +0000 UTC m=+1570.996030916"
Jul 28 22:31:12.496056 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:12.496027    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:31:19.688054 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:19.687971    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:19.688054 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:19.688048    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:19.703847 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:19.700705    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:20.040680 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:20.040607    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:31:22.362245 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.362212    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"]
Jul 28 22:31:22.366131 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.366107    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.367958 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.367935    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-cc9cd1b9-kserve-self-signed-certs\""
Jul 28 22:31:22.376984 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.376962    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"]
Jul 28 22:31:22.391389 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.391364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c468f68-eaea-4698-afd0-c55788fd7083-tls-certs\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.391510 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.391395    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-home\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.391578 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.391521    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-tmp-dir\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.391622 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.391574    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzcq7\" (UniqueName: \"kubernetes.io/projected/7c468f68-eaea-4698-afd0-c55788fd7083-kube-api-access-nzcq7\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.391622 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.391611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-dshm\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.391702 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.391628    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-model-cache\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.492048 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.492018    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzcq7\" (UniqueName: \"kubernetes.io/projected/7c468f68-eaea-4698-afd0-c55788fd7083-kube-api-access-nzcq7\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.492274 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.492062    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-dshm\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.492274 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.492081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-model-cache\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.492274 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.492121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c468f68-eaea-4698-afd0-c55788fd7083-tls-certs\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.492274 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.492138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-home\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.492274 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.492219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-tmp-dir\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.492546 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.492528    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-model-cache\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.492594 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.492565    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-home\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.492594 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.492575    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-tmp-dir\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.494239 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.494206    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-dshm\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.494719 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.494700    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c468f68-eaea-4698-afd0-c55788fd7083-tls-certs\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.499402 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.499383    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzcq7\" (UniqueName: \"kubernetes.io/projected/7c468f68-eaea-4698-afd0-c55788fd7083-kube-api-access-nzcq7\") pod \"e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") " pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.677169 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.677077    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:22.804413 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:22.804390    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"]
Jul 28 22:31:22.806312 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:31:22.806287    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c468f68_eaea_4698_afd0_c55788fd7083.slice/crio-d3ddd89e000af5081c6af17adccb19200f418e42f5e836f49d6b2a8c61ef3917 WatchSource:0}: Error finding container d3ddd89e000af5081c6af17adccb19200f418e42f5e836f49d6b2a8c61ef3917: Status 404 returned error can't find the container with id d3ddd89e000af5081c6af17adccb19200f418e42f5e836f49d6b2a8c61ef3917
Jul 28 22:31:23.044467 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:23.044386    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65" event={"ID":"7c468f68-eaea-4698-afd0-c55788fd7083","Type":"ContainerStarted","Data":"51a7e5b095477a10e2021e8c8948ca40c66253123fac093b7ec05829e2d02c37"}
Jul 28 22:31:23.044467 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:23.044426    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65" event={"ID":"7c468f68-eaea-4698-afd0-c55788fd7083","Type":"ContainerStarted","Data":"d3ddd89e000af5081c6af17adccb19200f418e42f5e836f49d6b2a8c61ef3917"}
Jul 28 22:31:23.059768 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:23.059724    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65" podStartSLOduration=1.059708832 podStartE2EDuration="1.059708832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:31:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:31:23.058249643 +0000 UTC m=+1584.053838235" watchObservedRunningTime="2026-07-28 22:31:23.059708832 +0000 UTC m=+1584.055297414"
Jul 28 22:31:26.600566 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:26.600535    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:31:32.677495 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:32.677463    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:32.677952 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:32.677553    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:32.689810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:32.689785    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:33.099270 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:33.099247    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:31:48.718011 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:48.717982    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"]
Jul 28 22:31:49.711889 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:49.711856    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"]
Jul 28 22:31:52.258400 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:31:52.258325    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:32:03.736619 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:03.736566    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw" podUID="951d395b-cfeb-4378-b7b6-b423905a3664" containerName="main" containerID="cri-o://914ccf90eef842bcce0e7c48657c8fe5742fb87322e2ec8c48ecb8a6e4c36ab8" gracePeriod=45
Jul 28 22:32:03.986495 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:03.986472    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:32:04.144208 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.144182    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/951d395b-cfeb-4378-b7b6-b423905a3664-tls-certs\") pod \"951d395b-cfeb-4378-b7b6-b423905a3664\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") "
Jul 28 22:32:04.144365 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.144217    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-home\") pod \"951d395b-cfeb-4378-b7b6-b423905a3664\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") "
Jul 28 22:32:04.144365 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.144280    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-tmp-dir\") pod \"951d395b-cfeb-4378-b7b6-b423905a3664\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") "
Jul 28 22:32:04.144365 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.144307    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-dshm\") pod \"951d395b-cfeb-4378-b7b6-b423905a3664\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") "
Jul 28 22:32:04.144365 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.144343    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbgbp\" (UniqueName: \"kubernetes.io/projected/951d395b-cfeb-4378-b7b6-b423905a3664-kube-api-access-lbgbp\") pod \"951d395b-cfeb-4378-b7b6-b423905a3664\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") "
Jul 28 22:32:04.144579 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.144371    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-model-cache\") pod \"951d395b-cfeb-4378-b7b6-b423905a3664\" (UID: \"951d395b-cfeb-4378-b7b6-b423905a3664\") "
Jul 28 22:32:04.144634 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.144609    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "951d395b-cfeb-4378-b7b6-b423905a3664" (UID: "951d395b-cfeb-4378-b7b6-b423905a3664"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:32:04.144684 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.144625    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-home" (OuterVolumeSpecName: "home") pod "951d395b-cfeb-4378-b7b6-b423905a3664" (UID: "951d395b-cfeb-4378-b7b6-b423905a3664"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:32:04.144684 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.144648    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-model-cache" (OuterVolumeSpecName: "model-cache") pod "951d395b-cfeb-4378-b7b6-b423905a3664" (UID: "951d395b-cfeb-4378-b7b6-b423905a3664"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:32:04.146468 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.146439    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-dshm" (OuterVolumeSpecName: "dshm") pod "951d395b-cfeb-4378-b7b6-b423905a3664" (UID: "951d395b-cfeb-4378-b7b6-b423905a3664"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:32:04.146599 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.146476    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951d395b-cfeb-4378-b7b6-b423905a3664-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "951d395b-cfeb-4378-b7b6-b423905a3664" (UID: "951d395b-cfeb-4378-b7b6-b423905a3664"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:32:04.146599 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.146584    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/951d395b-cfeb-4378-b7b6-b423905a3664-kube-api-access-lbgbp" (OuterVolumeSpecName: "kube-api-access-lbgbp") pod "951d395b-cfeb-4378-b7b6-b423905a3664" (UID: "951d395b-cfeb-4378-b7b6-b423905a3664"). InnerVolumeSpecName "kube-api-access-lbgbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:32:04.231451 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.231400    2564 generic.go:356] "Generic (PLEG): container finished" podID="951d395b-cfeb-4378-b7b6-b423905a3664" containerID="914ccf90eef842bcce0e7c48657c8fe5742fb87322e2ec8c48ecb8a6e4c36ab8" exitCode=0
Jul 28 22:32:04.231451 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.231441    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"
Jul 28 22:32:04.231610 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.231481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw" event={"ID":"951d395b-cfeb-4378-b7b6-b423905a3664","Type":"ContainerDied","Data":"914ccf90eef842bcce0e7c48657c8fe5742fb87322e2ec8c48ecb8a6e4c36ab8"}
Jul 28 22:32:04.231610 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.231524    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw" event={"ID":"951d395b-cfeb-4378-b7b6-b423905a3664","Type":"ContainerDied","Data":"02c8d5d9e12af2bb481e73b58478a00515dc64900e90802c3f281be39badb59f"}
Jul 28 22:32:04.231610 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.231542    2564 scope.go:117] "RemoveContainer" containerID="914ccf90eef842bcce0e7c48657c8fe5742fb87322e2ec8c48ecb8a6e4c36ab8"
Jul 28 22:32:04.240142 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.240128    2564 scope.go:117] "RemoveContainer" containerID="914ccf90eef842bcce0e7c48657c8fe5742fb87322e2ec8c48ecb8a6e4c36ab8"
Jul 28 22:32:04.240389 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:32:04.240358    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"914ccf90eef842bcce0e7c48657c8fe5742fb87322e2ec8c48ecb8a6e4c36ab8\": container with ID starting with 914ccf90eef842bcce0e7c48657c8fe5742fb87322e2ec8c48ecb8a6e4c36ab8 not found: ID does not exist" containerID="914ccf90eef842bcce0e7c48657c8fe5742fb87322e2ec8c48ecb8a6e4c36ab8"
Jul 28 22:32:04.240451 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.240403    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"914ccf90eef842bcce0e7c48657c8fe5742fb87322e2ec8c48ecb8a6e4c36ab8"} err="failed to get container status \"914ccf90eef842bcce0e7c48657c8fe5742fb87322e2ec8c48ecb8a6e4c36ab8\": rpc error: code = NotFound desc = could not find container \"914ccf90eef842bcce0e7c48657c8fe5742fb87322e2ec8c48ecb8a6e4c36ab8\": container with ID starting with 914ccf90eef842bcce0e7c48657c8fe5742fb87322e2ec8c48ecb8a6e4c36ab8 not found: ID does not exist"
Jul 28 22:32:04.245852 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.245817    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/951d395b-cfeb-4378-b7b6-b423905a3664-tls-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:32:04.245852 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.245854    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-home\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:32:04.245973 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.245863    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-tmp-dir\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:32:04.245973 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.245870    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-dshm\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:32:04.245973 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.245878    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbgbp\" (UniqueName: \"kubernetes.io/projected/951d395b-cfeb-4378-b7b6-b423905a3664-kube-api-access-lbgbp\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:32:04.245973 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.245886    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/951d395b-cfeb-4378-b7b6-b423905a3664-model-cache\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:32:04.251627 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.251606    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"]
Jul 28 22:32:04.254719 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.254696    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-cc9cd1b9-kserve-5c8859bbff-996hw"]
Jul 28 22:32:04.733616 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.733582    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65" podUID="7c468f68-eaea-4698-afd0-c55788fd7083" containerName="main" containerID="cri-o://51a7e5b095477a10e2021e8c8948ca40c66253123fac093b7ec05829e2d02c37" gracePeriod=45
Jul 28 22:32:04.977563 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:04.977541    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:32:05.154475 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.154449    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-model-cache\") pod \"7c468f68-eaea-4698-afd0-c55788fd7083\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") "
Jul 28 22:32:05.154627 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.154507    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-tmp-dir\") pod \"7c468f68-eaea-4698-afd0-c55788fd7083\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") "
Jul 28 22:32:05.154627 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.154551    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzcq7\" (UniqueName: \"kubernetes.io/projected/7c468f68-eaea-4698-afd0-c55788fd7083-kube-api-access-nzcq7\") pod \"7c468f68-eaea-4698-afd0-c55788fd7083\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") "
Jul 28 22:32:05.154627 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.154584    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-dshm\") pod \"7c468f68-eaea-4698-afd0-c55788fd7083\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") "
Jul 28 22:32:05.154748 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.154684    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c468f68-eaea-4698-afd0-c55788fd7083-tls-certs\") pod \"7c468f68-eaea-4698-afd0-c55788fd7083\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") "
Jul 28 22:32:05.154788 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.154743    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-home\") pod \"7c468f68-eaea-4698-afd0-c55788fd7083\" (UID: \"7c468f68-eaea-4698-afd0-c55788fd7083\") "
Jul 28 22:32:05.154788 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.154770    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-model-cache" (OuterVolumeSpecName: "model-cache") pod "7c468f68-eaea-4698-afd0-c55788fd7083" (UID: "7c468f68-eaea-4698-afd0-c55788fd7083"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:32:05.154924 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.154823    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c468f68-eaea-4698-afd0-c55788fd7083" (UID: "7c468f68-eaea-4698-afd0-c55788fd7083"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:32:05.155042 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.155022    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-home" (OuterVolumeSpecName: "home") pod "7c468f68-eaea-4698-afd0-c55788fd7083" (UID: "7c468f68-eaea-4698-afd0-c55788fd7083"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:32:05.155113 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.155041    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-tmp-dir\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:32:05.155113 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.155056    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-model-cache\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:32:05.156667 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.156645    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c468f68-eaea-4698-afd0-c55788fd7083-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c468f68-eaea-4698-afd0-c55788fd7083" (UID: "7c468f68-eaea-4698-afd0-c55788fd7083"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:32:05.157128 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.157109    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-dshm" (OuterVolumeSpecName: "dshm") pod "7c468f68-eaea-4698-afd0-c55788fd7083" (UID: "7c468f68-eaea-4698-afd0-c55788fd7083"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:32:05.157199 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.157131    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c468f68-eaea-4698-afd0-c55788fd7083-kube-api-access-nzcq7" (OuterVolumeSpecName: "kube-api-access-nzcq7") pod "7c468f68-eaea-4698-afd0-c55788fd7083" (UID: "7c468f68-eaea-4698-afd0-c55788fd7083"). InnerVolumeSpecName "kube-api-access-nzcq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:32:05.237555 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.237531    2564 generic.go:356] "Generic (PLEG): container finished" podID="7c468f68-eaea-4698-afd0-c55788fd7083" containerID="51a7e5b095477a10e2021e8c8948ca40c66253123fac093b7ec05829e2d02c37" exitCode=0
Jul 28 22:32:05.237680 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.237572    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"
Jul 28 22:32:05.237680 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.237604    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65" event={"ID":"7c468f68-eaea-4698-afd0-c55788fd7083","Type":"ContainerDied","Data":"51a7e5b095477a10e2021e8c8948ca40c66253123fac093b7ec05829e2d02c37"}
Jul 28 22:32:05.237680 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.237642    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65" event={"ID":"7c468f68-eaea-4698-afd0-c55788fd7083","Type":"ContainerDied","Data":"d3ddd89e000af5081c6af17adccb19200f418e42f5e836f49d6b2a8c61ef3917"}
Jul 28 22:32:05.237680 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.237660    2564 scope.go:117] "RemoveContainer" containerID="51a7e5b095477a10e2021e8c8948ca40c66253123fac093b7ec05829e2d02c37"
Jul 28 22:32:05.246363 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.246347    2564 scope.go:117] "RemoveContainer" containerID="51a7e5b095477a10e2021e8c8948ca40c66253123fac093b7ec05829e2d02c37"
Jul 28 22:32:05.246587 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:32:05.246572    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51a7e5b095477a10e2021e8c8948ca40c66253123fac093b7ec05829e2d02c37\": container with ID starting with 51a7e5b095477a10e2021e8c8948ca40c66253123fac093b7ec05829e2d02c37 not found: ID does not exist" containerID="51a7e5b095477a10e2021e8c8948ca40c66253123fac093b7ec05829e2d02c37"
Jul 28 22:32:05.246632 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.246593    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51a7e5b095477a10e2021e8c8948ca40c66253123fac093b7ec05829e2d02c37"} err="failed to get container status \"51a7e5b095477a10e2021e8c8948ca40c66253123fac093b7ec05829e2d02c37\": rpc error: code = NotFound desc = could not find container \"51a7e5b095477a10e2021e8c8948ca40c66253123fac093b7ec05829e2d02c37\": container with ID starting with 51a7e5b095477a10e2021e8c8948ca40c66253123fac093b7ec05829e2d02c37 not found: ID does not exist"
Jul 28 22:32:05.255513 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.255459    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-dshm\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:32:05.255593 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.255515    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c468f68-eaea-4698-afd0-c55788fd7083-tls-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:32:05.255593 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.255525    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c468f68-eaea-4698-afd0-c55788fd7083-home\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:32:05.255593 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.255533    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzcq7\" (UniqueName: \"kubernetes.io/projected/7c468f68-eaea-4698-afd0-c55788fd7083-kube-api-access-nzcq7\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:32:05.256875 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.256857    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"]
Jul 28 22:32:05.260977 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.260958    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-cc9cd1b9-kserve-c6499d9b7-mjz65"]
Jul 28 22:32:05.392875 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.392847    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:32:05.508105 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.508041    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c468f68-eaea-4698-afd0-c55788fd7083" path="/var/lib/kubelet/pods/7c468f68-eaea-4698-afd0-c55788fd7083/volumes"
Jul 28 22:32:05.508465 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:05.508448    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="951d395b-cfeb-4378-b7b6-b423905a3664" path="/var/lib/kubelet/pods/951d395b-cfeb-4378-b7b6-b423905a3664/volumes"
Jul 28 22:32:14.990119 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:14.990091    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:32:27.695048 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:27.695019    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:32:42.292851 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:42.292794    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:32:51.687343 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:32:51.687307    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:33:04.696224 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:33:04.696192    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:33:13.892283 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:33:13.892246    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:33:27.797745 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:33:27.797708    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:33:36.901802 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:33:36.901768    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:33:46.791969 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:33:46.791936    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:33:56.133283 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:33:56.133249    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:34:08.592707 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:34:08.592672    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:34:17.790890 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:34:17.790852    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:34:29.290070 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:34:29.290034    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:34:53.891140 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:34:53.891065    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:34:59.523068 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:34:59.523043    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:34:59.545616 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:34:59.545575    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:35:03.391058 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:03.391023    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:35:16.591728 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:16.591693    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:35:26.092145 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:26.092113    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:35:36.096472 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.096434    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:35:36.616471 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.616441    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"]
Jul 28 22:35:36.616885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.616818    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c468f68-eaea-4698-afd0-c55788fd7083" containerName="main"
Jul 28 22:35:36.616885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.616849    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c468f68-eaea-4698-afd0-c55788fd7083" containerName="main"
Jul 28 22:35:36.616885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.616867    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951d395b-cfeb-4378-b7b6-b423905a3664" containerName="main"
Jul 28 22:35:36.616885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.616872    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="951d395b-cfeb-4378-b7b6-b423905a3664" containerName="main"
Jul 28 22:35:36.617068 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.616925    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c468f68-eaea-4698-afd0-c55788fd7083" containerName="main"
Jul 28 22:35:36.617068 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.616938    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="951d395b-cfeb-4378-b7b6-b423905a3664" containerName="main"
Jul 28 22:35:36.619982 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.619966    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.622514 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.622493    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7833e2f6-openshift-default-dockercfg-2sq89\""
Jul 28 22:35:36.650509 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.650483    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"]
Jul 28 22:35:36.709890 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.709855    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-workload-certs\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.710065 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.709918    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-podinfo\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.710065 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.710012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-workload-socket\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.710065 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.710047    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzvp4\" (UniqueName: \"kubernetes.io/projected/710498e3-d0f8-4d1a-a130-24b62e677ea5-kube-api-access-dzvp4\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.710208 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.710082    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-credential-socket\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.710208 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.710108    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/710498e3-d0f8-4d1a-a130-24b62e677ea5-istiod-ca-cert\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.710208 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.710156    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-data\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.710347 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.710265    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-token\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.710347 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.710291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-envoy\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.811127 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.811091    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-token\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.811127 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.811130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-envoy\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.811366 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.811171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-workload-certs\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.811366 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.811198    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-podinfo\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.811366 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.811231    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-workload-socket\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.811366 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.811253    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzvp4\" (UniqueName: \"kubernetes.io/projected/710498e3-d0f8-4d1a-a130-24b62e677ea5-kube-api-access-dzvp4\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.811366 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.811284    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-credential-socket\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.811366 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.811307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/710498e3-d0f8-4d1a-a130-24b62e677ea5-istiod-ca-cert\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.811366 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.811352    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-data\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.811723 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.811672    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-workload-certs\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.811991 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.811945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-workload-socket\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.811991 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.811974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-credential-socket\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.812291 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.812267    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-data\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.812404 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.812316    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/710498e3-d0f8-4d1a-a130-24b62e677ea5-istiod-ca-cert\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.813726 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.813709    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-podinfo\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.813950 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.813932    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-envoy\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.818977 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.818958    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzvp4\" (UniqueName: \"kubernetes.io/projected/710498e3-d0f8-4d1a-a130-24b62e677ea5-kube-api-access-dzvp4\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.819998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.819975    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-token\") pod \"e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") " pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:36.931655 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:36.931584    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:37.076884 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:37.076859    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"]
Jul 28 22:35:37.078803 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:35:37.078777    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod710498e3_d0f8_4d1a_a130_24b62e677ea5.slice/crio-e10de0a248d5dcd9e4921b1f99e0e34b29ab0b2f7234aca6e3aa37837a825b98 WatchSource:0}: Error finding container e10de0a248d5dcd9e4921b1f99e0e34b29ab0b2f7234aca6e3aa37837a825b98: Status 404 returned error can't find the container with id e10de0a248d5dcd9e4921b1f99e0e34b29ab0b2f7234aca6e3aa37837a825b98
Jul 28 22:35:37.081194 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:37.081154    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:35:37.081308 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:37.081247    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:35:37.081308 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:37.081297    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:35:37.166586 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:37.166554    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8" event={"ID":"710498e3-d0f8-4d1a-a130-24b62e677ea5","Type":"ContainerStarted","Data":"67cc00a3c0fc033375cd4106b5c99d87ddfd141ee4f5e4ed708a7f51acfc88ac"}
Jul 28 22:35:37.167058 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:37.166614    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8" event={"ID":"710498e3-d0f8-4d1a-a130-24b62e677ea5","Type":"ContainerStarted","Data":"e10de0a248d5dcd9e4921b1f99e0e34b29ab0b2f7234aca6e3aa37837a825b98"}
Jul 28 22:35:37.191259 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:37.191173    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8" podStartSLOduration=1.191156582 podStartE2EDuration="1.191156582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:35:37.190399466 +0000 UTC m=+1838.185988050" watchObservedRunningTime="2026-07-28 22:35:37.191156582 +0000 UTC m=+1838.186745167"
Jul 28 22:35:37.932567 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:37.932535    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:38.937121 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:38.937087    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:39.175752 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:39.175719    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:39.176900 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:39.176880    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:44.795140 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:44.795107    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:35:53.243736 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:53.243698    2564 generic.go:356] "Generic (PLEG): container finished" podID="710498e3-d0f8-4d1a-a130-24b62e677ea5" containerID="67cc00a3c0fc033375cd4106b5c99d87ddfd141ee4f5e4ed708a7f51acfc88ac" exitCode=0
Jul 28 22:35:53.244195 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:53.243772    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8" event={"ID":"710498e3-d0f8-4d1a-a130-24b62e677ea5","Type":"ContainerDied","Data":"67cc00a3c0fc033375cd4106b5c99d87ddfd141ee4f5e4ed708a7f51acfc88ac"}
Jul 28 22:35:53.244240 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:53.244193    2564 scope.go:117] "RemoveContainer" containerID="67cc00a3c0fc033375cd4106b5c99d87ddfd141ee4f5e4ed708a7f51acfc88ac"
Jul 28 22:35:53.245204 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:53.245169    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:35:53.245348 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:53.245256    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:35:53.245348 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:53.245305    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:35:54.176167 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:54.176133    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:54.250911 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:54.250873    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8" event={"ID":"710498e3-d0f8-4d1a-a130-24b62e677ea5","Type":"ContainerStarted","Data":"c535bdb2c783175e6b0d3835ee210a627023825cb1226703f9478144787cd4d3"}
Jul 28 22:35:54.933856 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:54.933803    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:54.934065 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:54.933942    2564 patch_prober.go:28] interesting pod/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 28 22:35:54.934065 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:54.934012    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8" podUID="710498e3-d0f8-4d1a-a130-24b62e677ea5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 28 22:35:55.932272 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:55.932229    2564 patch_prober.go:28] interesting pod/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 28 22:35:55.932904 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:55.932864    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8" podUID="710498e3-d0f8-4d1a-a130-24b62e677ea5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 28 22:35:56.932113 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:56.932075    2564 patch_prober.go:28] interesting pod/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 28 22:35:56.932461 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:56.932145    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8" podUID="710498e3-d0f8-4d1a-a130-24b62e677ea5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 28 22:35:57.932912 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:57.932872    2564 patch_prober.go:28] interesting pod/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 28 22:35:57.933303 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:57.932931    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8" podUID="710498e3-d0f8-4d1a-a130-24b62e677ea5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 28 22:35:58.935946 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:58.935916    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:58.936325 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:58.936277    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:35:58.937064 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:35:58.937047    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:36:09.742032 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:09.741999    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"]
Jul 28 22:36:09.742440 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:09.742271    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8" podUID="710498e3-d0f8-4d1a-a130-24b62e677ea5" containerName="istio-proxy" containerID="cri-o://c535bdb2c783175e6b0d3835ee210a627023825cb1226703f9478144787cd4d3" gracePeriod=30
Jul 28 22:36:10.806450 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:10.806416    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"]
Jul 28 22:36:10.809919 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:10.809899    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:10.811877 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:10.811853    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-72a5477c-gw-openshift-default-dockercfg-z4pjn\""
Jul 28 22:36:10.825843 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:10.825802    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"]
Jul 28 22:36:10.931983 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:10.931948    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-podinfo\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:10.932174 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:10.932000    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-credential-socket\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:10.932174 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:10.932037    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-token\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:10.932174 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:10.932059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-envoy\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:10.932174 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:10.932085    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/308c188b-15ad-45ef-aa0a-1ce773e8637a-istiod-ca-cert\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:10.932174 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:10.932160    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-workload-socket\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:10.932448 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:10.932188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-data\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:10.932448 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:10.932228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jclmt\" (UniqueName: \"kubernetes.io/projected/308c188b-15ad-45ef-aa0a-1ce773e8637a-kube-api-access-jclmt\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:10.932448 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:10.932252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-workload-certs\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.032989 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.032955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-workload-socket\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.032989 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.032989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-data\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.033220 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.033027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jclmt\" (UniqueName: \"kubernetes.io/projected/308c188b-15ad-45ef-aa0a-1ce773e8637a-kube-api-access-jclmt\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.033220 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.033047    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-workload-certs\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.033220 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.033094    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-podinfo\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.033436 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.033242    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-credential-socket\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.033436 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.033290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-token\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.033436 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.033322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-envoy\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.033436 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.033366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/308c188b-15ad-45ef-aa0a-1ce773e8637a-istiod-ca-cert\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.033436 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.033396    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-workload-socket\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.033689 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.033438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-data\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.033689 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.033476    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-workload-certs\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.033792 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.033773    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-credential-socket\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.034056 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.034039    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/308c188b-15ad-45ef-aa0a-1ce773e8637a-istiod-ca-cert\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.035464 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.035446    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-envoy\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.035688 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.035667    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-podinfo\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.040447 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.040426    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jclmt\" (UniqueName: \"kubernetes.io/projected/308c188b-15ad-45ef-aa0a-1ce773e8637a-kube-api-access-jclmt\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.040564 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.040543    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-token\") pod \"e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") " pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.120217 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.120184    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:11.256269 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.256245    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"]
Jul 28 22:36:11.258683 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:36:11.258651    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308c188b_15ad_45ef_aa0a_1ce773e8637a.slice/crio-41e92f4c55e37f2e92bb860f94713bd7943ebb3f93fbc1af8161810eb3ce9b3a WatchSource:0}: Error finding container 41e92f4c55e37f2e92bb860f94713bd7943ebb3f93fbc1af8161810eb3ce9b3a: Status 404 returned error can't find the container with id 41e92f4c55e37f2e92bb860f94713bd7943ebb3f93fbc1af8161810eb3ce9b3a
Jul 28 22:36:11.260957 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.260929    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:36:11.261048 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.261008    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:36:11.261105 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.261045    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:36:11.333768 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.333743    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9" event={"ID":"308c188b-15ad-45ef-aa0a-1ce773e8637a","Type":"ContainerStarted","Data":"41f0c2983efea6bff07d5510cfabf5e243e9c992e5aac0a6568e4a378a82bd96"}
Jul 28 22:36:11.333877 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.333791    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9" event={"ID":"308c188b-15ad-45ef-aa0a-1ce773e8637a","Type":"ContainerStarted","Data":"41e92f4c55e37f2e92bb860f94713bd7943ebb3f93fbc1af8161810eb3ce9b3a"}
Jul 28 22:36:11.358400 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:11.358343    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9" podStartSLOduration=1.358321241 podStartE2EDuration="1.358321241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:36:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:36:11.356749141 +0000 UTC m=+1872.352337727" watchObservedRunningTime="2026-07-28 22:36:11.358321241 +0000 UTC m=+1872.353909805"
Jul 28 22:36:12.120565 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:12.120528    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:12.125117 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:12.125093    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:12.338678 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:12.338650    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:12.339616 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:12.339593    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:13.601882 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:13.601851    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:36:13.938859 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:13.938763    2564 patch_prober.go:28] interesting pod/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 22:36:13.939007 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:13.938854    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8" podUID="710498e3-d0f8-4d1a-a130-24b62e677ea5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 22:36:14.993932 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:14.993909    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:36:15.074938 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.074862    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzvp4\" (UniqueName: \"kubernetes.io/projected/710498e3-d0f8-4d1a-a130-24b62e677ea5-kube-api-access-dzvp4\") pod \"710498e3-d0f8-4d1a-a130-24b62e677ea5\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") "
Jul 28 22:36:15.074938 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.074929    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-envoy\") pod \"710498e3-d0f8-4d1a-a130-24b62e677ea5\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") "
Jul 28 22:36:15.075131 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.074989    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/710498e3-d0f8-4d1a-a130-24b62e677ea5-istiod-ca-cert\") pod \"710498e3-d0f8-4d1a-a130-24b62e677ea5\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") "
Jul 28 22:36:15.075131 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.075016    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-credential-socket\") pod \"710498e3-d0f8-4d1a-a130-24b62e677ea5\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") "
Jul 28 22:36:15.075131 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.075044    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-podinfo\") pod \"710498e3-d0f8-4d1a-a130-24b62e677ea5\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") "
Jul 28 22:36:15.075131 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.075070    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-workload-socket\") pod \"710498e3-d0f8-4d1a-a130-24b62e677ea5\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") "
Jul 28 22:36:15.075131 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.075094    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-token\") pod \"710498e3-d0f8-4d1a-a130-24b62e677ea5\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") "
Jul 28 22:36:15.075361 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.075136    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-data\") pod \"710498e3-d0f8-4d1a-a130-24b62e677ea5\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") "
Jul 28 22:36:15.075361 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.075189    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-workload-certs\") pod \"710498e3-d0f8-4d1a-a130-24b62e677ea5\" (UID: \"710498e3-d0f8-4d1a-a130-24b62e677ea5\") "
Jul 28 22:36:15.075468 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.075347    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "710498e3-d0f8-4d1a-a130-24b62e677ea5" (UID: "710498e3-d0f8-4d1a-a130-24b62e677ea5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:36:15.075468 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.075407    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/710498e3-d0f8-4d1a-a130-24b62e677ea5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "710498e3-d0f8-4d1a-a130-24b62e677ea5" (UID: "710498e3-d0f8-4d1a-a130-24b62e677ea5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:36:15.075595 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.075568    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "710498e3-d0f8-4d1a-a130-24b62e677ea5" (UID: "710498e3-d0f8-4d1a-a130-24b62e677ea5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:36:15.075595 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.075587    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/710498e3-d0f8-4d1a-a130-24b62e677ea5-istiod-ca-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:15.075711 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.075608    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-workload-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:15.075773 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.075753    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "710498e3-d0f8-4d1a-a130-24b62e677ea5" (UID: "710498e3-d0f8-4d1a-a130-24b62e677ea5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:36:15.076349 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.076322    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-data" (OuterVolumeSpecName: "istio-data") pod "710498e3-d0f8-4d1a-a130-24b62e677ea5" (UID: "710498e3-d0f8-4d1a-a130-24b62e677ea5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:36:15.077255 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.077229    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "710498e3-d0f8-4d1a-a130-24b62e677ea5" (UID: "710498e3-d0f8-4d1a-a130-24b62e677ea5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 22:36:15.077353 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.077278    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-token" (OuterVolumeSpecName: "istio-token") pod "710498e3-d0f8-4d1a-a130-24b62e677ea5" (UID: "710498e3-d0f8-4d1a-a130-24b62e677ea5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:36:15.077353 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.077289    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/710498e3-d0f8-4d1a-a130-24b62e677ea5-kube-api-access-dzvp4" (OuterVolumeSpecName: "kube-api-access-dzvp4") pod "710498e3-d0f8-4d1a-a130-24b62e677ea5" (UID: "710498e3-d0f8-4d1a-a130-24b62e677ea5"). InnerVolumeSpecName "kube-api-access-dzvp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:36:15.077436 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.077388    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "710498e3-d0f8-4d1a-a130-24b62e677ea5" (UID: "710498e3-d0f8-4d1a-a130-24b62e677ea5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:36:15.176194 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.176169    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-credential-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:15.176194 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.176193    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-podinfo\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:15.176341 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.176202    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-token\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:15.176341 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.176211    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-data\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:15.176341 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.176220    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-workload-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:15.176341 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.176228    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzvp4\" (UniqueName: \"kubernetes.io/projected/710498e3-d0f8-4d1a-a130-24b62e677ea5-kube-api-access-dzvp4\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:15.176341 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.176237    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/710498e3-d0f8-4d1a-a130-24b62e677ea5-istio-envoy\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:15.355314 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.355279    2564 generic.go:356] "Generic (PLEG): container finished" podID="710498e3-d0f8-4d1a-a130-24b62e677ea5" containerID="c535bdb2c783175e6b0d3835ee210a627023825cb1226703f9478144787cd4d3" exitCode=0
Jul 28 22:36:15.355480 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.355327    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"
Jul 28 22:36:15.355480 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.355334    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8" event={"ID":"710498e3-d0f8-4d1a-a130-24b62e677ea5","Type":"ContainerDied","Data":"c535bdb2c783175e6b0d3835ee210a627023825cb1226703f9478144787cd4d3"}
Jul 28 22:36:15.355480 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.355387    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8" event={"ID":"710498e3-d0f8-4d1a-a130-24b62e677ea5","Type":"ContainerDied","Data":"e10de0a248d5dcd9e4921b1f99e0e34b29ab0b2f7234aca6e3aa37837a825b98"}
Jul 28 22:36:15.355480 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.355417    2564 scope.go:117] "RemoveContainer" containerID="c535bdb2c783175e6b0d3835ee210a627023825cb1226703f9478144787cd4d3"
Jul 28 22:36:15.365576 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.365558    2564 scope.go:117] "RemoveContainer" containerID="67cc00a3c0fc033375cd4106b5c99d87ddfd141ee4f5e4ed708a7f51acfc88ac"
Jul 28 22:36:15.373285 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.373264    2564 scope.go:117] "RemoveContainer" containerID="c535bdb2c783175e6b0d3835ee210a627023825cb1226703f9478144787cd4d3"
Jul 28 22:36:15.373554 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:36:15.373536    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c535bdb2c783175e6b0d3835ee210a627023825cb1226703f9478144787cd4d3\": container with ID starting with c535bdb2c783175e6b0d3835ee210a627023825cb1226703f9478144787cd4d3 not found: ID does not exist" containerID="c535bdb2c783175e6b0d3835ee210a627023825cb1226703f9478144787cd4d3"
Jul 28 22:36:15.373611 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.373563    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c535bdb2c783175e6b0d3835ee210a627023825cb1226703f9478144787cd4d3"} err="failed to get container status \"c535bdb2c783175e6b0d3835ee210a627023825cb1226703f9478144787cd4d3\": rpc error: code = NotFound desc = could not find container \"c535bdb2c783175e6b0d3835ee210a627023825cb1226703f9478144787cd4d3\": container with ID starting with c535bdb2c783175e6b0d3835ee210a627023825cb1226703f9478144787cd4d3 not found: ID does not exist"
Jul 28 22:36:15.373611 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.373581    2564 scope.go:117] "RemoveContainer" containerID="67cc00a3c0fc033375cd4106b5c99d87ddfd141ee4f5e4ed708a7f51acfc88ac"
Jul 28 22:36:15.373852 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:36:15.373812    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67cc00a3c0fc033375cd4106b5c99d87ddfd141ee4f5e4ed708a7f51acfc88ac\": container with ID starting with 67cc00a3c0fc033375cd4106b5c99d87ddfd141ee4f5e4ed708a7f51acfc88ac not found: ID does not exist" containerID="67cc00a3c0fc033375cd4106b5c99d87ddfd141ee4f5e4ed708a7f51acfc88ac"
Jul 28 22:36:15.373921 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.373860    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67cc00a3c0fc033375cd4106b5c99d87ddfd141ee4f5e4ed708a7f51acfc88ac"} err="failed to get container status \"67cc00a3c0fc033375cd4106b5c99d87ddfd141ee4f5e4ed708a7f51acfc88ac\": rpc error: code = NotFound desc = could not find container \"67cc00a3c0fc033375cd4106b5c99d87ddfd141ee4f5e4ed708a7f51acfc88ac\": container with ID starting with 67cc00a3c0fc033375cd4106b5c99d87ddfd141ee4f5e4ed708a7f51acfc88ac not found: ID does not exist"
Jul 28 22:36:15.386152 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.386131    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"]
Jul 28 22:36:15.393263 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.393244    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7833e2f6-openshift-default-68799dc6d4-tvbs8"]
Jul 28 22:36:15.508811 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:15.508784    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="710498e3-d0f8-4d1a-a130-24b62e677ea5" path="/var/lib/kubelet/pods/710498e3-d0f8-4d1a-a130-24b62e677ea5/volumes"
Jul 28 22:36:24.087113 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:24.087025    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:36:27.340430 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:27.340400    2564 patch_prober.go:28] interesting pod/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 28 22:36:27.340756 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:27.340478    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9" podUID="308c188b-15ad-45ef-aa0a-1ce773e8637a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 28 22:36:27.414807 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:27.414780    2564 generic.go:356] "Generic (PLEG): container finished" podID="308c188b-15ad-45ef-aa0a-1ce773e8637a" containerID="41f0c2983efea6bff07d5510cfabf5e243e9c992e5aac0a6568e4a378a82bd96" exitCode=0
Jul 28 22:36:27.414963 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:27.414845    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9" event={"ID":"308c188b-15ad-45ef-aa0a-1ce773e8637a","Type":"ContainerDied","Data":"41f0c2983efea6bff07d5510cfabf5e243e9c992e5aac0a6568e4a378a82bd96"}
Jul 28 22:36:27.415237 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:27.415221    2564 scope.go:117] "RemoveContainer" containerID="41f0c2983efea6bff07d5510cfabf5e243e9c992e5aac0a6568e4a378a82bd96"
Jul 28 22:36:27.416190 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:27.416161    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:36:27.416283 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:27.416246    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:36:27.416342 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:27.416296    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:36:28.421586 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:28.421550    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9" event={"ID":"308c188b-15ad-45ef-aa0a-1ce773e8637a","Type":"ContainerStarted","Data":"b43f0a4e712ca5a0500d9ee98180de6a73432ddae5be5af8d81660ec20d61a6f"}
Jul 28 22:36:29.120741 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:29.120639    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:29.121425 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:29.121397    2564 patch_prober.go:28] interesting pod/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 28 22:36:29.121633 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:29.121606    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9" podUID="308c188b-15ad-45ef-aa0a-1ce773e8637a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 28 22:36:30.121002 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:30.120964    2564 patch_prober.go:28] interesting pod/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 28 22:36:30.121578 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:30.121542    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9" podUID="308c188b-15ad-45ef-aa0a-1ce773e8637a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 28 22:36:31.121232 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:31.120776    2564 patch_prober.go:28] interesting pod/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 28 22:36:31.121232 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:31.120862    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9" podUID="308c188b-15ad-45ef-aa0a-1ce773e8637a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 28 22:36:32.121683 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:32.121638    2564 patch_prober.go:28] interesting pod/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 28 22:36:32.122323 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:32.122288    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9" podUID="308c188b-15ad-45ef-aa0a-1ce773e8637a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 28 22:36:33.124812 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:33.124782    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:33.125296 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:33.125210    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:33.125921 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:33.125900    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:37.979636 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:37.979605    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx"]
Jul 28 22:36:37.980056 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:37.979941    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="710498e3-d0f8-4d1a-a130-24b62e677ea5" containerName="istio-proxy"
Jul 28 22:36:37.980056 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:37.979952    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="710498e3-d0f8-4d1a-a130-24b62e677ea5" containerName="istio-proxy"
Jul 28 22:36:37.980056 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:37.980022    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="710498e3-d0f8-4d1a-a130-24b62e677ea5" containerName="istio-proxy"
Jul 28 22:36:37.980056 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:37.980030    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="710498e3-d0f8-4d1a-a130-24b62e677ea5" containerName="istio-proxy"
Jul 28 22:36:37.983005 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:37.982987    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx"
Jul 28 22:36:37.984810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:37.984791    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 22:36:37.984810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:37.984799    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 22:36:37.989141 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:37.989119    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx"]
Jul 28 22:36:38.084234 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:38.084200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d46358b-5945-4ffd-aa6a-4a54326ecdb6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx\" (UID: \"5d46358b-5945-4ffd-aa6a-4a54326ecdb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx"
Jul 28 22:36:38.185616 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:38.185586    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d46358b-5945-4ffd-aa6a-4a54326ecdb6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx\" (UID: \"5d46358b-5945-4ffd-aa6a-4a54326ecdb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx"
Jul 28 22:36:38.186185 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:38.186167    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d46358b-5945-4ffd-aa6a-4a54326ecdb6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx\" (UID: \"5d46358b-5945-4ffd-aa6a-4a54326ecdb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx"
Jul 28 22:36:38.294239 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:38.294181    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx"
Jul 28 22:36:38.420945 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:38.420914    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx"]
Jul 28 22:36:38.423947 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:36:38.423922    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d46358b_5945_4ffd_aa6a_4a54326ecdb6.slice/crio-6b3c4e31d6c5ae5e28565404490906d1ff73cd2fa86842582008af2cd072fcbf WatchSource:0}: Error finding container 6b3c4e31d6c5ae5e28565404490906d1ff73cd2fa86842582008af2cd072fcbf: Status 404 returned error can't find the container with id 6b3c4e31d6c5ae5e28565404490906d1ff73cd2fa86842582008af2cd072fcbf
Jul 28 22:36:38.425771 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:38.425754    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 22:36:38.477303 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:38.477273    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx" event={"ID":"5d46358b-5945-4ffd-aa6a-4a54326ecdb6","Type":"ContainerStarted","Data":"6b3c4e31d6c5ae5e28565404490906d1ff73cd2fa86842582008af2cd072fcbf"}
Jul 28 22:36:41.494066 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:41.493975    2564 generic.go:356] "Generic (PLEG): container finished" podID="5d46358b-5945-4ffd-aa6a-4a54326ecdb6" containerID="3400eb824c7330ba0cb3e2e618aabb5beddf765a9c621e39f3ddd896e8fdf5d7" exitCode=0
Jul 28 22:36:41.494066 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:41.494024    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx" event={"ID":"5d46358b-5945-4ffd-aa6a-4a54326ecdb6","Type":"ContainerDied","Data":"3400eb824c7330ba0cb3e2e618aabb5beddf765a9c621e39f3ddd896e8fdf5d7"}
Jul 28 22:36:42.626457 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:42.626435    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx"
Jul 28 22:36:42.724367 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:42.724342    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d46358b-5945-4ffd-aa6a-4a54326ecdb6-maas-api-service-ca\") pod \"5d46358b-5945-4ffd-aa6a-4a54326ecdb6\" (UID: \"5d46358b-5945-4ffd-aa6a-4a54326ecdb6\") "
Jul 28 22:36:42.724674 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:42.724652    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d46358b-5945-4ffd-aa6a-4a54326ecdb6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5d46358b-5945-4ffd-aa6a-4a54326ecdb6" (UID: "5d46358b-5945-4ffd-aa6a-4a54326ecdb6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:36:42.825671 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:42.825607    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d46358b-5945-4ffd-aa6a-4a54326ecdb6-maas-api-service-ca\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:43.506364 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:43.506337    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx"
Jul 28 22:36:43.508613 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:43.508583    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx" event={"ID":"5d46358b-5945-4ffd-aa6a-4a54326ecdb6","Type":"ContainerDied","Data":"6b3c4e31d6c5ae5e28565404490906d1ff73cd2fa86842582008af2cd072fcbf"}
Jul 28 22:36:43.508749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:43.508629    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b3c4e31d6c5ae5e28565404490906d1ff73cd2fa86842582008af2cd072fcbf"
Jul 28 22:36:44.768202 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:44.768168    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx"]
Jul 28 22:36:44.770562 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:44.770539    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-72a5477c-wvrhx"]
Jul 28 22:36:44.918731 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:44.918698    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"]
Jul 28 22:36:44.919069 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:44.919018    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9" podUID="308c188b-15ad-45ef-aa0a-1ce773e8637a" containerName="istio-proxy" containerID="cri-o://b43f0a4e712ca5a0500d9ee98180de6a73432ddae5be5af8d81660ec20d61a6f" gracePeriod=30
Jul 28 22:36:45.508185 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.508152    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d46358b-5945-4ffd-aa6a-4a54326ecdb6" path="/var/lib/kubelet/pods/5d46358b-5945-4ffd-aa6a-4a54326ecdb6/volumes"
Jul 28 22:36:45.680879 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.680849    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"]
Jul 28 22:36:45.681221 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.681207    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d46358b-5945-4ffd-aa6a-4a54326ecdb6" containerName="revoke-keys"
Jul 28 22:36:45.681221 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.681222    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d46358b-5945-4ffd-aa6a-4a54326ecdb6" containerName="revoke-keys"
Jul 28 22:36:45.681364 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.681235    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="710498e3-d0f8-4d1a-a130-24b62e677ea5" containerName="istio-proxy"
Jul 28 22:36:45.681364 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.681244    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="710498e3-d0f8-4d1a-a130-24b62e677ea5" containerName="istio-proxy"
Jul 28 22:36:45.681364 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.681294    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d46358b-5945-4ffd-aa6a-4a54326ecdb6" containerName="revoke-keys"
Jul 28 22:36:45.684679 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.684656    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.686626 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.686604    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b99011fa-openshift-default-dockercfg-2jhz2\""
Jul 28 22:36:45.696966 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.696943    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"]
Jul 28 22:36:45.850111 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.850079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-workload-certs\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.850503 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.850121    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-token\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.850503 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.850148    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-podinfo\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.850503 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.850188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlrr5\" (UniqueName: \"kubernetes.io/projected/68029c41-91d4-4cb1-8724-fcf4c1202379-kube-api-access-xlrr5\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.850503 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.850263    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-workload-socket\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.850503 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.850303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-data\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.850503 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.850326    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-credential-socket\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.850503 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.850372    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-envoy\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.850503 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.850449    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68029c41-91d4-4cb1-8724-fcf4c1202379-istiod-ca-cert\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.951190 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.951157    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-workload-certs\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.951353 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.951195    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-token\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.951353 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.951227    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-podinfo\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.951353 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.951251    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlrr5\" (UniqueName: \"kubernetes.io/projected/68029c41-91d4-4cb1-8724-fcf4c1202379-kube-api-access-xlrr5\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.951353 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.951281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-workload-socket\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.951353 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.951321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-data\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.951353 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.951347    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-credential-socket\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.951654 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.951399    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-envoy\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.951654 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.951448    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68029c41-91d4-4cb1-8724-fcf4c1202379-istiod-ca-cert\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.951654 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.951593    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-workload-certs\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.951814 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.951673    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-data\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.951814 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.951715    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-workload-socket\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.951946 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.951879    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-credential-socket\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.952149 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.952128    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68029c41-91d4-4cb1-8724-fcf4c1202379-istiod-ca-cert\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.953674 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.953653    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-envoy\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.953726 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.953705    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-podinfo\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.961591 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.961572    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-token\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.961797 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.961778    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlrr5\" (UniqueName: \"kubernetes.io/projected/68029c41-91d4-4cb1-8724-fcf4c1202379-kube-api-access-xlrr5\") pod \"e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") " pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:45.994613 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:45.994592    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:46.141734 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:46.141711    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"]
Jul 28 22:36:46.143519 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:36:46.143493    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68029c41_91d4_4cb1_8724_fcf4c1202379.slice/crio-7485a8c9c74a43be1eeed973e836b9e4ed7276546d0fc687bb7b29e6bf493a30 WatchSource:0}: Error finding container 7485a8c9c74a43be1eeed973e836b9e4ed7276546d0fc687bb7b29e6bf493a30: Status 404 returned error can't find the container with id 7485a8c9c74a43be1eeed973e836b9e4ed7276546d0fc687bb7b29e6bf493a30
Jul 28 22:36:46.145748 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:46.145723    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:36:46.145818 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:46.145805    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:36:46.145885 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:46.145871    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:36:46.522558 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:46.522475    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf" event={"ID":"68029c41-91d4-4cb1-8724-fcf4c1202379","Type":"ContainerStarted","Data":"aa17e0dd3e031c53500baa5510ebda10efc6c29ca2549f30132f3e2ada81b8b1"}
Jul 28 22:36:46.522558 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:46.522535    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf" event={"ID":"68029c41-91d4-4cb1-8724-fcf4c1202379","Type":"ContainerStarted","Data":"7485a8c9c74a43be1eeed973e836b9e4ed7276546d0fc687bb7b29e6bf493a30"}
Jul 28 22:36:46.544647 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:46.544600    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf" podStartSLOduration=1.544580955 podStartE2EDuration="1.544580955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:36:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:36:46.542926802 +0000 UTC m=+1907.538515384" watchObservedRunningTime="2026-07-28 22:36:46.544580955 +0000 UTC m=+1907.540169536"
Jul 28 22:36:46.994811 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:46.994784    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:48.000176 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:48.000144    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:48.127222 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:48.127187    2564 patch_prober.go:28] interesting pod/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 22:36:48.127383 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:48.127249    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9" podUID="308c188b-15ad-45ef-aa0a-1ce773e8637a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 22:36:48.531346 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:48.531316    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:48.532176 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:48.532158    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:36:48.602641 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:48.602603    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:36:50.169163 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.169143    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:50.292300 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.292231    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-data\") pod \"308c188b-15ad-45ef-aa0a-1ce773e8637a\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") "
Jul 28 22:36:50.292300 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.292274    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jclmt\" (UniqueName: \"kubernetes.io/projected/308c188b-15ad-45ef-aa0a-1ce773e8637a-kube-api-access-jclmt\") pod \"308c188b-15ad-45ef-aa0a-1ce773e8637a\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") "
Jul 28 22:36:50.292498 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.292301    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-podinfo\") pod \"308c188b-15ad-45ef-aa0a-1ce773e8637a\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") "
Jul 28 22:36:50.292498 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.292323    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-credential-socket\") pod \"308c188b-15ad-45ef-aa0a-1ce773e8637a\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") "
Jul 28 22:36:50.292498 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.292349    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-token\") pod \"308c188b-15ad-45ef-aa0a-1ce773e8637a\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") "
Jul 28 22:36:50.292498 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.292384    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/308c188b-15ad-45ef-aa0a-1ce773e8637a-istiod-ca-cert\") pod \"308c188b-15ad-45ef-aa0a-1ce773e8637a\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") "
Jul 28 22:36:50.292498 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.292407    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-envoy\") pod \"308c188b-15ad-45ef-aa0a-1ce773e8637a\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") "
Jul 28 22:36:50.292498 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.292443    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-workload-certs\") pod \"308c188b-15ad-45ef-aa0a-1ce773e8637a\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") "
Jul 28 22:36:50.292776 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.292537    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-workload-socket\") pod \"308c188b-15ad-45ef-aa0a-1ce773e8637a\" (UID: \"308c188b-15ad-45ef-aa0a-1ce773e8637a\") "
Jul 28 22:36:50.292776 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.292705    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "308c188b-15ad-45ef-aa0a-1ce773e8637a" (UID: "308c188b-15ad-45ef-aa0a-1ce773e8637a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:36:50.292919 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.292797    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/308c188b-15ad-45ef-aa0a-1ce773e8637a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "308c188b-15ad-45ef-aa0a-1ce773e8637a" (UID: "308c188b-15ad-45ef-aa0a-1ce773e8637a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:36:50.292919 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.292876    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-credential-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:50.293039 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.292944    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "308c188b-15ad-45ef-aa0a-1ce773e8637a" (UID: "308c188b-15ad-45ef-aa0a-1ce773e8637a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:36:50.293093 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.293082    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "308c188b-15ad-45ef-aa0a-1ce773e8637a" (UID: "308c188b-15ad-45ef-aa0a-1ce773e8637a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:36:50.293146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.293126    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-data" (OuterVolumeSpecName: "istio-data") pod "308c188b-15ad-45ef-aa0a-1ce773e8637a" (UID: "308c188b-15ad-45ef-aa0a-1ce773e8637a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:36:50.294604 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.294577    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "308c188b-15ad-45ef-aa0a-1ce773e8637a" (UID: "308c188b-15ad-45ef-aa0a-1ce773e8637a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:36:50.294722 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.294650    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "308c188b-15ad-45ef-aa0a-1ce773e8637a" (UID: "308c188b-15ad-45ef-aa0a-1ce773e8637a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 22:36:50.294963 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.294942    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/308c188b-15ad-45ef-aa0a-1ce773e8637a-kube-api-access-jclmt" (OuterVolumeSpecName: "kube-api-access-jclmt") pod "308c188b-15ad-45ef-aa0a-1ce773e8637a" (UID: "308c188b-15ad-45ef-aa0a-1ce773e8637a"). InnerVolumeSpecName "kube-api-access-jclmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:36:50.295026 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.294970    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-token" (OuterVolumeSpecName: "istio-token") pod "308c188b-15ad-45ef-aa0a-1ce773e8637a" (UID: "308c188b-15ad-45ef-aa0a-1ce773e8637a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:36:50.393871 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.393845    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-workload-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:50.393871 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.393868    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-data\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:50.393871 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.393877    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jclmt\" (UniqueName: \"kubernetes.io/projected/308c188b-15ad-45ef-aa0a-1ce773e8637a-kube-api-access-jclmt\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:50.394067 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.393886    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-podinfo\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:50.394067 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.393894    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-token\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:50.394067 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.393904    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/308c188b-15ad-45ef-aa0a-1ce773e8637a-istiod-ca-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:50.394067 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.393912    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-istio-envoy\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:50.394067 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.393919    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/308c188b-15ad-45ef-aa0a-1ce773e8637a-workload-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:36:50.541979 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.541948    2564 generic.go:356] "Generic (PLEG): container finished" podID="308c188b-15ad-45ef-aa0a-1ce773e8637a" containerID="b43f0a4e712ca5a0500d9ee98180de6a73432ddae5be5af8d81660ec20d61a6f" exitCode=0
Jul 28 22:36:50.542121 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.541989    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"
Jul 28 22:36:50.542121 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.542024    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9" event={"ID":"308c188b-15ad-45ef-aa0a-1ce773e8637a","Type":"ContainerDied","Data":"b43f0a4e712ca5a0500d9ee98180de6a73432ddae5be5af8d81660ec20d61a6f"}
Jul 28 22:36:50.542121 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.542070    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9" event={"ID":"308c188b-15ad-45ef-aa0a-1ce773e8637a","Type":"ContainerDied","Data":"41e92f4c55e37f2e92bb860f94713bd7943ebb3f93fbc1af8161810eb3ce9b3a"}
Jul 28 22:36:50.542121 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.542094    2564 scope.go:117] "RemoveContainer" containerID="b43f0a4e712ca5a0500d9ee98180de6a73432ddae5be5af8d81660ec20d61a6f"
Jul 28 22:36:50.550943 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.550925    2564 scope.go:117] "RemoveContainer" containerID="41f0c2983efea6bff07d5510cfabf5e243e9c992e5aac0a6568e4a378a82bd96"
Jul 28 22:36:50.558584 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.558568    2564 scope.go:117] "RemoveContainer" containerID="b43f0a4e712ca5a0500d9ee98180de6a73432ddae5be5af8d81660ec20d61a6f"
Jul 28 22:36:50.558842 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:36:50.558809    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b43f0a4e712ca5a0500d9ee98180de6a73432ddae5be5af8d81660ec20d61a6f\": container with ID starting with b43f0a4e712ca5a0500d9ee98180de6a73432ddae5be5af8d81660ec20d61a6f not found: ID does not exist" containerID="b43f0a4e712ca5a0500d9ee98180de6a73432ddae5be5af8d81660ec20d61a6f"
Jul 28 22:36:50.558922 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.558905    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43f0a4e712ca5a0500d9ee98180de6a73432ddae5be5af8d81660ec20d61a6f"} err="failed to get container status \"b43f0a4e712ca5a0500d9ee98180de6a73432ddae5be5af8d81660ec20d61a6f\": rpc error: code = NotFound desc = could not find container \"b43f0a4e712ca5a0500d9ee98180de6a73432ddae5be5af8d81660ec20d61a6f\": container with ID starting with b43f0a4e712ca5a0500d9ee98180de6a73432ddae5be5af8d81660ec20d61a6f not found: ID does not exist"
Jul 28 22:36:50.558978 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.558925    2564 scope.go:117] "RemoveContainer" containerID="41f0c2983efea6bff07d5510cfabf5e243e9c992e5aac0a6568e4a378a82bd96"
Jul 28 22:36:50.559149 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:36:50.559132    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41f0c2983efea6bff07d5510cfabf5e243e9c992e5aac0a6568e4a378a82bd96\": container with ID starting with 41f0c2983efea6bff07d5510cfabf5e243e9c992e5aac0a6568e4a378a82bd96 not found: ID does not exist" containerID="41f0c2983efea6bff07d5510cfabf5e243e9c992e5aac0a6568e4a378a82bd96"
Jul 28 22:36:50.559199 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.559153    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f0c2983efea6bff07d5510cfabf5e243e9c992e5aac0a6568e4a378a82bd96"} err="failed to get container status \"41f0c2983efea6bff07d5510cfabf5e243e9c992e5aac0a6568e4a378a82bd96\": rpc error: code = NotFound desc = could not find container \"41f0c2983efea6bff07d5510cfabf5e243e9c992e5aac0a6568e4a378a82bd96\": container with ID starting with 41f0c2983efea6bff07d5510cfabf5e243e9c992e5aac0a6568e4a378a82bd96 not found: ID does not exist"
Jul 28 22:36:50.562694 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.562671    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"]
Jul 28 22:36:50.566877 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:50.566859    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-72a5477c-gw-openshift-default-5fb64c5f6d-tvjx9"]
Jul 28 22:36:51.508137 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:51.508109    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="308c188b-15ad-45ef-aa0a-1ce773e8637a" path="/var/lib/kubelet/pods/308c188b-15ad-45ef-aa0a-1ce773e8637a/volumes"
Jul 28 22:36:58.800864 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:36:58.800813    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:37:02.598753 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:02.598718    2564 generic.go:356] "Generic (PLEG): container finished" podID="68029c41-91d4-4cb1-8724-fcf4c1202379" containerID="aa17e0dd3e031c53500baa5510ebda10efc6c29ca2549f30132f3e2ada81b8b1" exitCode=0
Jul 28 22:37:02.599292 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:02.598759    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf" event={"ID":"68029c41-91d4-4cb1-8724-fcf4c1202379","Type":"ContainerDied","Data":"aa17e0dd3e031c53500baa5510ebda10efc6c29ca2549f30132f3e2ada81b8b1"}
Jul 28 22:37:02.599292 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:02.599259    2564 scope.go:117] "RemoveContainer" containerID="aa17e0dd3e031c53500baa5510ebda10efc6c29ca2549f30132f3e2ada81b8b1"
Jul 28 22:37:02.600336 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:02.600306    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:37:02.600447 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:02.600376    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:37:02.600447 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:02.600408    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:37:03.531631 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:03.531582    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:37:03.605273 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:03.605236    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf" event={"ID":"68029c41-91d4-4cb1-8724-fcf4c1202379","Type":"ContainerStarted","Data":"69d4320a84f835b0764f617dce1a485fdd5da413e9c11a84b962e95cca96ffb7"}
Jul 28 22:37:03.995274 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:03.995238    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:37:03.996356 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:03.996335    2564 patch_prober.go:28] interesting pod/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 28 22:37:03.996420 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:03.996381    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf" podUID="68029c41-91d4-4cb1-8724-fcf4c1202379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 28 22:37:04.995723 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:04.995684    2564 patch_prober.go:28] interesting pod/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 28 22:37:04.996140 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:04.995744    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf" podUID="68029c41-91d4-4cb1-8724-fcf4c1202379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 28 22:37:05.995823 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:05.995787    2564 patch_prober.go:28] interesting pod/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 28 22:37:05.996227 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:05.995869    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf" podUID="68029c41-91d4-4cb1-8724-fcf4c1202379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 28 22:37:06.994999 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:06.994959    2564 patch_prober.go:28] interesting pod/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Jul 28 22:37:06.995187 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:06.995017    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf" podUID="68029c41-91d4-4cb1-8724-fcf4c1202379" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Jul 28 22:37:07.998805 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:07.998775    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:37:07.999190 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:07.999165    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:37:07.999938 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:07.999917    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:37:20.192339 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:20.192309    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"]
Jul 28 22:37:20.192756 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:20.192508    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf" podUID="68029c41-91d4-4cb1-8724-fcf4c1202379" containerName="istio-proxy" containerID="cri-o://69d4320a84f835b0764f617dce1a485fdd5da413e9c11a84b962e95cca96ffb7" gracePeriod=30
Jul 28 22:37:20.932795 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:20.932764    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"]
Jul 28 22:37:20.933171 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:20.933157    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308c188b-15ad-45ef-aa0a-1ce773e8637a" containerName="istio-proxy"
Jul 28 22:37:20.933218 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:20.933173    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="308c188b-15ad-45ef-aa0a-1ce773e8637a" containerName="istio-proxy"
Jul 28 22:37:20.933260 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:20.933250    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="308c188b-15ad-45ef-aa0a-1ce773e8637a" containerName="istio-proxy"
Jul 28 22:37:20.933294 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:20.933262    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="308c188b-15ad-45ef-aa0a-1ce773e8637a" containerName="istio-proxy"
Jul 28 22:37:20.939983 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:20.939962    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:20.941999 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:20.941981    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-3db5e9ba-openshift-default-dockercfg-678hx\""
Jul 28 22:37:20.948401 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:20.948381    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"]
Jul 28 22:37:21.054636 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.054595    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-envoy\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.054807 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.054658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-workload-certs\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.054807 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.054682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-data\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.054807 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.054708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvvch\" (UniqueName: \"kubernetes.io/projected/393772fe-cd84-4622-bfbe-6a60a7d72790-kube-api-access-gvvch\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.054972 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.054817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/393772fe-cd84-4622-bfbe-6a60a7d72790-istiod-ca-cert\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.054972 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.054901    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-token\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.054972 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.054929    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-workload-socket\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.054972 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.054967    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-podinfo\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.055097 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.055029    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-credential-socket\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.155772 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.155742    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/393772fe-cd84-4622-bfbe-6a60a7d72790-istiod-ca-cert\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.155950 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.155783    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-token\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.155950 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.155804    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-workload-socket\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.155950 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.155859    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-podinfo\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.155950 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.155892    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-credential-socket\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.155950 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.155916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-envoy\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.156200 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.155957    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-workload-certs\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.156200 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.155981    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-data\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.156200 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.156005    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvvch\" (UniqueName: \"kubernetes.io/projected/393772fe-cd84-4622-bfbe-6a60a7d72790-kube-api-access-gvvch\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.156362 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.156257    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-workload-socket\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.156362 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.156315    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-credential-socket\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.156509 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.156485    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/393772fe-cd84-4622-bfbe-6a60a7d72790-istiod-ca-cert\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.156562 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.156522    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-workload-certs\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.156562 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.156526    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-data\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.158325 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.158302    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-envoy\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.158432 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.158388    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-podinfo\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.162699 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.162674    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-token\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.162855 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.162817    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvvch\" (UniqueName: \"kubernetes.io/projected/393772fe-cd84-4622-bfbe-6a60a7d72790-kube-api-access-gvvch\") pod \"e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") " pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.250359 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.250285    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:21.391172 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.391145    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"]
Jul 28 22:37:21.393498 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:37:21.393472    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod393772fe_cd84_4622_bfbe_6a60a7d72790.slice/crio-71a86ab29b564d1c3ac46196476d1f9a5298cc0c62ab73cc6ebcef50046accbe WatchSource:0}: Error finding container 71a86ab29b564d1c3ac46196476d1f9a5298cc0c62ab73cc6ebcef50046accbe: Status 404 returned error can't find the container with id 71a86ab29b564d1c3ac46196476d1f9a5298cc0c62ab73cc6ebcef50046accbe
Jul 28 22:37:21.395746 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.395716    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:37:21.395865 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.395790    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:37:21.395865 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.395856    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:37:21.693845 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.693807    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc" event={"ID":"393772fe-cd84-4622-bfbe-6a60a7d72790","Type":"ContainerStarted","Data":"1dcbdb8010c5aeb2f042619db6026a6ee60b5b1885888708761cf0467d31e51b"}
Jul 28 22:37:21.694038 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.693872    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc" event={"ID":"393772fe-cd84-4622-bfbe-6a60a7d72790","Type":"ContainerStarted","Data":"71a86ab29b564d1c3ac46196476d1f9a5298cc0c62ab73cc6ebcef50046accbe"}
Jul 28 22:37:21.713877 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:21.713694    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc" podStartSLOduration=1.7136760340000001 podStartE2EDuration="1.713676034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:37:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:37:21.712878324 +0000 UTC m=+1942.708466905" watchObservedRunningTime="2026-07-28 22:37:21.713676034 +0000 UTC m=+1942.709264619"
Jul 28 22:37:22.251310 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:22.251274    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:22.256325 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:22.256297    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:22.699372 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:22.699341    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:22.700507 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:22.700484    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:22.792189 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:22.792157    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:37:23.001727 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:23.001645    2564 patch_prober.go:28] interesting pod/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 22:37:23.001727 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:23.001706    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf" podUID="68029c41-91d4-4cb1-8724-fcf4c1202379" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 22:37:25.450605 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.450582    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:37:25.495558 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.495494    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68029c41-91d4-4cb1-8724-fcf4c1202379-istiod-ca-cert\") pod \"68029c41-91d4-4cb1-8724-fcf4c1202379\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") "
Jul 28 22:37:25.495558 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.495553    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-workload-socket\") pod \"68029c41-91d4-4cb1-8724-fcf4c1202379\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") "
Jul 28 22:37:25.495752 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.495570    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-credential-socket\") pod \"68029c41-91d4-4cb1-8724-fcf4c1202379\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") "
Jul 28 22:37:25.495752 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.495589    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-podinfo\") pod \"68029c41-91d4-4cb1-8724-fcf4c1202379\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") "
Jul 28 22:37:25.495752 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.495612    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-data\") pod \"68029c41-91d4-4cb1-8724-fcf4c1202379\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") "
Jul 28 22:37:25.495752 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.495676    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-envoy\") pod \"68029c41-91d4-4cb1-8724-fcf4c1202379\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") "
Jul 28 22:37:25.495752 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.495703    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-workload-certs\") pod \"68029c41-91d4-4cb1-8724-fcf4c1202379\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") "
Jul 28 22:37:25.495752 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.495723    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-token\") pod \"68029c41-91d4-4cb1-8724-fcf4c1202379\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") "
Jul 28 22:37:25.496073 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.495757    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlrr5\" (UniqueName: \"kubernetes.io/projected/68029c41-91d4-4cb1-8724-fcf4c1202379-kube-api-access-xlrr5\") pod \"68029c41-91d4-4cb1-8724-fcf4c1202379\" (UID: \"68029c41-91d4-4cb1-8724-fcf4c1202379\") "
Jul 28 22:37:25.496073 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.495820    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68029c41-91d4-4cb1-8724-fcf4c1202379-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "68029c41-91d4-4cb1-8724-fcf4c1202379" (UID: "68029c41-91d4-4cb1-8724-fcf4c1202379"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:37:25.496073 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.495911    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "68029c41-91d4-4cb1-8724-fcf4c1202379" (UID: "68029c41-91d4-4cb1-8724-fcf4c1202379"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:37:25.496073 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.495938    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "68029c41-91d4-4cb1-8724-fcf4c1202379" (UID: "68029c41-91d4-4cb1-8724-fcf4c1202379"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:37:25.496272 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.496151    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68029c41-91d4-4cb1-8724-fcf4c1202379-istiod-ca-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:25.496272 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.496173    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-workload-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:25.496272 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.496188    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-credential-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:25.496272 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.496187    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "68029c41-91d4-4cb1-8724-fcf4c1202379" (UID: "68029c41-91d4-4cb1-8724-fcf4c1202379"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:37:25.496556 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.496535    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-data" (OuterVolumeSpecName: "istio-data") pod "68029c41-91d4-4cb1-8724-fcf4c1202379" (UID: "68029c41-91d4-4cb1-8724-fcf4c1202379"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:37:25.497794 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.497767    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "68029c41-91d4-4cb1-8724-fcf4c1202379" (UID: "68029c41-91d4-4cb1-8724-fcf4c1202379"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 22:37:25.497933 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.497898    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-token" (OuterVolumeSpecName: "istio-token") pod "68029c41-91d4-4cb1-8724-fcf4c1202379" (UID: "68029c41-91d4-4cb1-8724-fcf4c1202379"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:37:25.498228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.498209    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68029c41-91d4-4cb1-8724-fcf4c1202379-kube-api-access-xlrr5" (OuterVolumeSpecName: "kube-api-access-xlrr5") pod "68029c41-91d4-4cb1-8724-fcf4c1202379" (UID: "68029c41-91d4-4cb1-8724-fcf4c1202379"). InnerVolumeSpecName "kube-api-access-xlrr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:37:25.498300 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.498211    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "68029c41-91d4-4cb1-8724-fcf4c1202379" (UID: "68029c41-91d4-4cb1-8724-fcf4c1202379"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:37:25.597037 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.597011    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-workload-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:25.597037 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.597034    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-token\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:25.597037 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.597042    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlrr5\" (UniqueName: \"kubernetes.io/projected/68029c41-91d4-4cb1-8724-fcf4c1202379-kube-api-access-xlrr5\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:25.597037 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.597052    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-podinfo\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:25.597368 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.597062    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-data\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:25.597368 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.597071    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68029c41-91d4-4cb1-8724-fcf4c1202379-istio-envoy\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:25.713622 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.713587    2564 generic.go:356] "Generic (PLEG): container finished" podID="68029c41-91d4-4cb1-8724-fcf4c1202379" containerID="69d4320a84f835b0764f617dce1a485fdd5da413e9c11a84b962e95cca96ffb7" exitCode=0
Jul 28 22:37:25.713782 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.713640    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"
Jul 28 22:37:25.713782 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.713639    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf" event={"ID":"68029c41-91d4-4cb1-8724-fcf4c1202379","Type":"ContainerDied","Data":"69d4320a84f835b0764f617dce1a485fdd5da413e9c11a84b962e95cca96ffb7"}
Jul 28 22:37:25.713782 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.713754    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf" event={"ID":"68029c41-91d4-4cb1-8724-fcf4c1202379","Type":"ContainerDied","Data":"7485a8c9c74a43be1eeed973e836b9e4ed7276546d0fc687bb7b29e6bf493a30"}
Jul 28 22:37:25.713933 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.713783    2564 scope.go:117] "RemoveContainer" containerID="69d4320a84f835b0764f617dce1a485fdd5da413e9c11a84b962e95cca96ffb7"
Jul 28 22:37:25.721986 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.721970    2564 scope.go:117] "RemoveContainer" containerID="aa17e0dd3e031c53500baa5510ebda10efc6c29ca2549f30132f3e2ada81b8b1"
Jul 28 22:37:25.729629 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.729610    2564 scope.go:117] "RemoveContainer" containerID="69d4320a84f835b0764f617dce1a485fdd5da413e9c11a84b962e95cca96ffb7"
Jul 28 22:37:25.729979 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:37:25.729959    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69d4320a84f835b0764f617dce1a485fdd5da413e9c11a84b962e95cca96ffb7\": container with ID starting with 69d4320a84f835b0764f617dce1a485fdd5da413e9c11a84b962e95cca96ffb7 not found: ID does not exist" containerID="69d4320a84f835b0764f617dce1a485fdd5da413e9c11a84b962e95cca96ffb7"
Jul 28 22:37:25.730147 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.729987    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d4320a84f835b0764f617dce1a485fdd5da413e9c11a84b962e95cca96ffb7"} err="failed to get container status \"69d4320a84f835b0764f617dce1a485fdd5da413e9c11a84b962e95cca96ffb7\": rpc error: code = NotFound desc = could not find container \"69d4320a84f835b0764f617dce1a485fdd5da413e9c11a84b962e95cca96ffb7\": container with ID starting with 69d4320a84f835b0764f617dce1a485fdd5da413e9c11a84b962e95cca96ffb7 not found: ID does not exist"
Jul 28 22:37:25.730147 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.730004    2564 scope.go:117] "RemoveContainer" containerID="aa17e0dd3e031c53500baa5510ebda10efc6c29ca2549f30132f3e2ada81b8b1"
Jul 28 22:37:25.730260 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:37:25.730249    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa17e0dd3e031c53500baa5510ebda10efc6c29ca2549f30132f3e2ada81b8b1\": container with ID starting with aa17e0dd3e031c53500baa5510ebda10efc6c29ca2549f30132f3e2ada81b8b1 not found: ID does not exist" containerID="aa17e0dd3e031c53500baa5510ebda10efc6c29ca2549f30132f3e2ada81b8b1"
Jul 28 22:37:25.730317 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.730265    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa17e0dd3e031c53500baa5510ebda10efc6c29ca2549f30132f3e2ada81b8b1"} err="failed to get container status \"aa17e0dd3e031c53500baa5510ebda10efc6c29ca2549f30132f3e2ada81b8b1\": rpc error: code = NotFound desc = could not find container \"aa17e0dd3e031c53500baa5510ebda10efc6c29ca2549f30132f3e2ada81b8b1\": container with ID starting with aa17e0dd3e031c53500baa5510ebda10efc6c29ca2549f30132f3e2ada81b8b1 not found: ID does not exist"
Jul 28 22:37:25.731360 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.731342    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"]
Jul 28 22:37:25.734825 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:25.734807    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b99011fa-openshift-default-76cfb4f9b6-gx9hf"]
Jul 28 22:37:27.507653 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:27.507620    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68029c41-91d4-4cb1-8724-fcf4c1202379" path="/var/lib/kubelet/pods/68029c41-91d4-4cb1-8724-fcf4c1202379/volumes"
Jul 28 22:37:33.288844 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:33.288795    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:37:36.769297 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:36.769196    2564 generic.go:356] "Generic (PLEG): container finished" podID="393772fe-cd84-4622-bfbe-6a60a7d72790" containerID="1dcbdb8010c5aeb2f042619db6026a6ee60b5b1885888708761cf0467d31e51b" exitCode=0
Jul 28 22:37:36.769297 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:36.769260    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc" event={"ID":"393772fe-cd84-4622-bfbe-6a60a7d72790","Type":"ContainerDied","Data":"1dcbdb8010c5aeb2f042619db6026a6ee60b5b1885888708761cf0467d31e51b"}
Jul 28 22:37:36.769780 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:36.769666    2564 scope.go:117] "RemoveContainer" containerID="1dcbdb8010c5aeb2f042619db6026a6ee60b5b1885888708761cf0467d31e51b"
Jul 28 22:37:36.770735 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:36.770705    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:37:36.770810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:36.770792    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:37:36.770886 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:36.770871    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:37:37.693391 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.693360    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl"]
Jul 28 22:37:37.693706 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.693693    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308c188b-15ad-45ef-aa0a-1ce773e8637a" containerName="istio-proxy"
Jul 28 22:37:37.693758 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.693707    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="308c188b-15ad-45ef-aa0a-1ce773e8637a" containerName="istio-proxy"
Jul 28 22:37:37.693758 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.693714    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68029c41-91d4-4cb1-8724-fcf4c1202379" containerName="istio-proxy"
Jul 28 22:37:37.693758 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.693720    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="68029c41-91d4-4cb1-8724-fcf4c1202379" containerName="istio-proxy"
Jul 28 22:37:37.693758 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.693742    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68029c41-91d4-4cb1-8724-fcf4c1202379" containerName="istio-proxy"
Jul 28 22:37:37.693758 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.693748    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="68029c41-91d4-4cb1-8724-fcf4c1202379" containerName="istio-proxy"
Jul 28 22:37:37.693970 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.693800    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="68029c41-91d4-4cb1-8724-fcf4c1202379" containerName="istio-proxy"
Jul 28 22:37:37.695715 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.695699    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl"
Jul 28 22:37:37.698042 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.698022    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 22:37:37.698153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.698022    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gzvns\""
Jul 28 22:37:37.699374 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.699355    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:37.705016 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.704986    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl"]
Jul 28 22:37:37.775871 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.775815    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc" event={"ID":"393772fe-cd84-4622-bfbe-6a60a7d72790","Type":"ContainerStarted","Data":"69ac1c464064517f844ce4a24b4c2d3bfe2310e49f210337b4e3a091b8495a8d"}
Jul 28 22:37:37.838243 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.838201    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9412992-fc92-44a7-95a7-378bc647f145-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl\" (UID: \"e9412992-fc92-44a7-95a7-378bc647f145\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl"
Jul 28 22:37:37.938925 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.938876    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9412992-fc92-44a7-95a7-378bc647f145-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl\" (UID: \"e9412992-fc92-44a7-95a7-378bc647f145\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl"
Jul 28 22:37:37.939525 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:37.939505    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9412992-fc92-44a7-95a7-378bc647f145-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl\" (UID: \"e9412992-fc92-44a7-95a7-378bc647f145\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl"
Jul 28 22:37:38.006764 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:38.006691    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl"
Jul 28 22:37:38.179949 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:38.179918    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl"]
Jul 28 22:37:38.183006 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:37:38.182981    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9412992_fc92_44a7_95a7_378bc647f145.slice/crio-589ec87fc4b810471e33adad8242f2708444b774b8159f7aa823a5ae764f6b0e WatchSource:0}: Error finding container 589ec87fc4b810471e33adad8242f2708444b774b8159f7aa823a5ae764f6b0e: Status 404 returned error can't find the container with id 589ec87fc4b810471e33adad8242f2708444b774b8159f7aa823a5ae764f6b0e
Jul 28 22:37:38.251456 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:38.251420    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:38.252656 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:38.252630    2564 patch_prober.go:28] interesting pod/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 28 22:37:38.252797 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:38.252686    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc" podUID="393772fe-cd84-4622-bfbe-6a60a7d72790" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 28 22:37:38.782138 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:38.782048    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl" event={"ID":"e9412992-fc92-44a7-95a7-378bc647f145","Type":"ContainerStarted","Data":"da2d4cce2945382bdb129348ab8084532b13f598b8154a74e4733ff4a3e7bbdc"}
Jul 28 22:37:38.782138 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:38.782107    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl" event={"ID":"e9412992-fc92-44a7-95a7-378bc647f145","Type":"ContainerStarted","Data":"589ec87fc4b810471e33adad8242f2708444b774b8159f7aa823a5ae764f6b0e"}
Jul 28 22:37:38.797457 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:38.797417    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl" podStartSLOduration=1.797402143 podStartE2EDuration="1.797402143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:37:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:37:38.796055233 +0000 UTC m=+1959.791643815" watchObservedRunningTime="2026-07-28 22:37:38.797402143 +0000 UTC m=+1959.792990724"
Jul 28 22:37:39.250889 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:39.250850    2564 patch_prober.go:28] interesting pod/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 28 22:37:39.251070 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:39.250906    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc" podUID="393772fe-cd84-4622-bfbe-6a60a7d72790" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 28 22:37:39.788351 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:39.788313    2564 generic.go:356] "Generic (PLEG): container finished" podID="e9412992-fc92-44a7-95a7-378bc647f145" containerID="da2d4cce2945382bdb129348ab8084532b13f598b8154a74e4733ff4a3e7bbdc" exitCode=0
Jul 28 22:37:39.788714 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:39.788401    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl" event={"ID":"e9412992-fc92-44a7-95a7-378bc647f145","Type":"ContainerDied","Data":"da2d4cce2945382bdb129348ab8084532b13f598b8154a74e4733ff4a3e7bbdc"}
Jul 28 22:37:40.251328 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:40.251294    2564 patch_prober.go:28] interesting pod/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 28 22:37:40.251514 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:40.251346    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc" podUID="393772fe-cd84-4622-bfbe-6a60a7d72790" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 28 22:37:40.958734 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:40.958710    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl"
Jul 28 22:37:40.966168 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:40.966146    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9412992-fc92-44a7-95a7-378bc647f145-maas-api-service-ca\") pod \"e9412992-fc92-44a7-95a7-378bc647f145\" (UID: \"e9412992-fc92-44a7-95a7-378bc647f145\") "
Jul 28 22:37:40.966462 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:40.966439    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9412992-fc92-44a7-95a7-378bc647f145-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9412992-fc92-44a7-95a7-378bc647f145" (UID: "e9412992-fc92-44a7-95a7-378bc647f145"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:37:41.067063 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:41.066987    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9412992-fc92-44a7-95a7-378bc647f145-maas-api-service-ca\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:41.251700 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:41.251662    2564 patch_prober.go:28] interesting pod/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 28 22:37:41.251919 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:41.251716    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc" podUID="393772fe-cd84-4622-bfbe-6a60a7d72790" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 28 22:37:41.799234 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:41.799149    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl"
Jul 28 22:37:41.799396 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:41.799148    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl" event={"ID":"e9412992-fc92-44a7-95a7-378bc647f145","Type":"ContainerDied","Data":"589ec87fc4b810471e33adad8242f2708444b774b8159f7aa823a5ae764f6b0e"}
Jul 28 22:37:41.799396 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:41.799298    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="589ec87fc4b810471e33adad8242f2708444b774b8159f7aa823a5ae764f6b0e"
Jul 28 22:37:42.254696 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:42.254661    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:42.255142 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:42.255074    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:42.255689 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:42.255672    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:44.035057 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:44.035029    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl"]
Jul 28 22:37:44.036974 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:44.036943    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-3db5e9ba-7tdgl"]
Jul 28 22:37:44.173506 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:44.173475    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"]
Jul 28 22:37:44.812720 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:44.812657    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc" podUID="393772fe-cd84-4622-bfbe-6a60a7d72790" containerName="istio-proxy" containerID="cri-o://69ac1c464064517f844ce4a24b4c2d3bfe2310e49f210337b4e3a091b8495a8d" gracePeriod=30
Jul 28 22:37:45.507753 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:45.507709    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9412992-fc92-44a7-95a7-378bc647f145" path="/var/lib/kubelet/pods/e9412992-fc92-44a7-95a7-378bc647f145/volumes"
Jul 28 22:37:48.007749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:48.007716    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:37:50.065726 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.065703    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:50.151958 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.151927    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-credential-socket\") pod \"393772fe-cd84-4622-bfbe-6a60a7d72790\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") "
Jul 28 22:37:50.152142 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.151968    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-data\") pod \"393772fe-cd84-4622-bfbe-6a60a7d72790\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") "
Jul 28 22:37:50.152142 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.152027    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvvch\" (UniqueName: \"kubernetes.io/projected/393772fe-cd84-4622-bfbe-6a60a7d72790-kube-api-access-gvvch\") pod \"393772fe-cd84-4622-bfbe-6a60a7d72790\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") "
Jul 28 22:37:50.152142 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.152054    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-workload-certs\") pod \"393772fe-cd84-4622-bfbe-6a60a7d72790\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") "
Jul 28 22:37:50.152142 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.152079    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-workload-socket\") pod \"393772fe-cd84-4622-bfbe-6a60a7d72790\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") "
Jul 28 22:37:50.152142 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.152104    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/393772fe-cd84-4622-bfbe-6a60a7d72790-istiod-ca-cert\") pod \"393772fe-cd84-4622-bfbe-6a60a7d72790\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") "
Jul 28 22:37:50.152142 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.152125    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-token\") pod \"393772fe-cd84-4622-bfbe-6a60a7d72790\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") "
Jul 28 22:37:50.152465 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.152169    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-envoy\") pod \"393772fe-cd84-4622-bfbe-6a60a7d72790\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") "
Jul 28 22:37:50.152465 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.152225    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-podinfo\") pod \"393772fe-cd84-4622-bfbe-6a60a7d72790\" (UID: \"393772fe-cd84-4622-bfbe-6a60a7d72790\") "
Jul 28 22:37:50.152465 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.152225    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "393772fe-cd84-4622-bfbe-6a60a7d72790" (UID: "393772fe-cd84-4622-bfbe-6a60a7d72790"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:37:50.152465 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.152350    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "393772fe-cd84-4622-bfbe-6a60a7d72790" (UID: "393772fe-cd84-4622-bfbe-6a60a7d72790"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:37:50.152697 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.152563    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-credential-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:50.152697 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.152584    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-workload-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:50.152697 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.152583    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/393772fe-cd84-4622-bfbe-6a60a7d72790-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "393772fe-cd84-4622-bfbe-6a60a7d72790" (UID: "393772fe-cd84-4622-bfbe-6a60a7d72790"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:37:50.152697 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.152645    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "393772fe-cd84-4622-bfbe-6a60a7d72790" (UID: "393772fe-cd84-4622-bfbe-6a60a7d72790"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:37:50.153129 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.153099    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-data" (OuterVolumeSpecName: "istio-data") pod "393772fe-cd84-4622-bfbe-6a60a7d72790" (UID: "393772fe-cd84-4622-bfbe-6a60a7d72790"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:37:50.154340 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.154313    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "393772fe-cd84-4622-bfbe-6a60a7d72790" (UID: "393772fe-cd84-4622-bfbe-6a60a7d72790"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:37:50.154340 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.154322    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/393772fe-cd84-4622-bfbe-6a60a7d72790-kube-api-access-gvvch" (OuterVolumeSpecName: "kube-api-access-gvvch") pod "393772fe-cd84-4622-bfbe-6a60a7d72790" (UID: "393772fe-cd84-4622-bfbe-6a60a7d72790"). InnerVolumeSpecName "kube-api-access-gvvch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:37:50.154469 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.154364    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "393772fe-cd84-4622-bfbe-6a60a7d72790" (UID: "393772fe-cd84-4622-bfbe-6a60a7d72790"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 22:37:50.154469 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.154393    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-token" (OuterVolumeSpecName: "istio-token") pod "393772fe-cd84-4622-bfbe-6a60a7d72790" (UID: "393772fe-cd84-4622-bfbe-6a60a7d72790"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:37:50.253759 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.253728    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvvch\" (UniqueName: \"kubernetes.io/projected/393772fe-cd84-4622-bfbe-6a60a7d72790-kube-api-access-gvvch\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:50.253759 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.253756    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-workload-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:50.253759 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.253766    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/393772fe-cd84-4622-bfbe-6a60a7d72790-istiod-ca-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:50.253993 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.253778    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-token\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:50.253993 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.253789    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-envoy\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:50.253993 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.253798    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-podinfo\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:50.253993 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.253805    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/393772fe-cd84-4622-bfbe-6a60a7d72790-istio-data\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:37:50.847437 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.847400    2564 generic.go:356] "Generic (PLEG): container finished" podID="393772fe-cd84-4622-bfbe-6a60a7d72790" containerID="69ac1c464064517f844ce4a24b4c2d3bfe2310e49f210337b4e3a091b8495a8d" exitCode=0
Jul 28 22:37:50.847635 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.847456    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"
Jul 28 22:37:50.847635 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.847486    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc" event={"ID":"393772fe-cd84-4622-bfbe-6a60a7d72790","Type":"ContainerDied","Data":"69ac1c464064517f844ce4a24b4c2d3bfe2310e49f210337b4e3a091b8495a8d"}
Jul 28 22:37:50.847635 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.847558    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc" event={"ID":"393772fe-cd84-4622-bfbe-6a60a7d72790","Type":"ContainerDied","Data":"71a86ab29b564d1c3ac46196476d1f9a5298cc0c62ab73cc6ebcef50046accbe"}
Jul 28 22:37:50.847635 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.847579    2564 scope.go:117] "RemoveContainer" containerID="69ac1c464064517f844ce4a24b4c2d3bfe2310e49f210337b4e3a091b8495a8d"
Jul 28 22:37:50.856764 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.856744    2564 scope.go:117] "RemoveContainer" containerID="1dcbdb8010c5aeb2f042619db6026a6ee60b5b1885888708761cf0467d31e51b"
Jul 28 22:37:50.864203 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.864184    2564 scope.go:117] "RemoveContainer" containerID="69ac1c464064517f844ce4a24b4c2d3bfe2310e49f210337b4e3a091b8495a8d"
Jul 28 22:37:50.864434 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:37:50.864415    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69ac1c464064517f844ce4a24b4c2d3bfe2310e49f210337b4e3a091b8495a8d\": container with ID starting with 69ac1c464064517f844ce4a24b4c2d3bfe2310e49f210337b4e3a091b8495a8d not found: ID does not exist" containerID="69ac1c464064517f844ce4a24b4c2d3bfe2310e49f210337b4e3a091b8495a8d"
Jul 28 22:37:50.864491 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.864441    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69ac1c464064517f844ce4a24b4c2d3bfe2310e49f210337b4e3a091b8495a8d"} err="failed to get container status \"69ac1c464064517f844ce4a24b4c2d3bfe2310e49f210337b4e3a091b8495a8d\": rpc error: code = NotFound desc = could not find container \"69ac1c464064517f844ce4a24b4c2d3bfe2310e49f210337b4e3a091b8495a8d\": container with ID starting with 69ac1c464064517f844ce4a24b4c2d3bfe2310e49f210337b4e3a091b8495a8d not found: ID does not exist"
Jul 28 22:37:50.864491 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.864458    2564 scope.go:117] "RemoveContainer" containerID="1dcbdb8010c5aeb2f042619db6026a6ee60b5b1885888708761cf0467d31e51b"
Jul 28 22:37:50.864688 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:37:50.864674    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dcbdb8010c5aeb2f042619db6026a6ee60b5b1885888708761cf0467d31e51b\": container with ID starting with 1dcbdb8010c5aeb2f042619db6026a6ee60b5b1885888708761cf0467d31e51b not found: ID does not exist" containerID="1dcbdb8010c5aeb2f042619db6026a6ee60b5b1885888708761cf0467d31e51b"
Jul 28 22:37:50.864751 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.864690    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dcbdb8010c5aeb2f042619db6026a6ee60b5b1885888708761cf0467d31e51b"} err="failed to get container status \"1dcbdb8010c5aeb2f042619db6026a6ee60b5b1885888708761cf0467d31e51b\": rpc error: code = NotFound desc = could not find container \"1dcbdb8010c5aeb2f042619db6026a6ee60b5b1885888708761cf0467d31e51b\": container with ID starting with 1dcbdb8010c5aeb2f042619db6026a6ee60b5b1885888708761cf0467d31e51b not found: ID does not exist"
Jul 28 22:37:50.867543 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.867517    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"]
Jul 28 22:37:50.871269 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:50.871249    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-3db5e9ba-openshift-default-6489d48f4d-9vghc"]
Jul 28 22:37:51.508062 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:37:51.508030    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="393772fe-cd84-4622-bfbe-6a60a7d72790" path="/var/lib/kubelet/pods/393772fe-cd84-4622-bfbe-6a60a7d72790/volumes"
Jul 28 22:39:10.497247 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:10.497213    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:39:20.801422 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:20.801389    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:39:27.520452 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.520417    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"]
Jul 28 22:39:27.520963 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.520945    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="393772fe-cd84-4622-bfbe-6a60a7d72790" containerName="istio-proxy"
Jul 28 22:39:27.521032 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.520964    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="393772fe-cd84-4622-bfbe-6a60a7d72790" containerName="istio-proxy"
Jul 28 22:39:27.521032 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.520978    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="393772fe-cd84-4622-bfbe-6a60a7d72790" containerName="istio-proxy"
Jul 28 22:39:27.521032 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.520987    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="393772fe-cd84-4622-bfbe-6a60a7d72790" containerName="istio-proxy"
Jul 28 22:39:27.521032 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.521008    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9412992-fc92-44a7-95a7-378bc647f145" containerName="revoke-keys"
Jul 28 22:39:27.521032 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.521018    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9412992-fc92-44a7-95a7-378bc647f145" containerName="revoke-keys"
Jul 28 22:39:27.521290 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.521108    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="68029c41-91d4-4cb1-8724-fcf4c1202379" containerName="istio-proxy"
Jul 28 22:39:27.521290 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.521119    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="393772fe-cd84-4622-bfbe-6a60a7d72790" containerName="istio-proxy"
Jul 28 22:39:27.521290 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.521128    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9412992-fc92-44a7-95a7-378bc647f145" containerName="revoke-keys"
Jul 28 22:39:27.524294 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.524275    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.527314 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.527287    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-cc3d4e93-openshift-default-dockercfg-k5r9p\""
Jul 28 22:39:27.543409 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.543388    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"]
Jul 28 22:39:27.614137 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.614101    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-podinfo\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.614137 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.614140    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-envoy\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.614410 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.614179    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdc2h\" (UniqueName: \"kubernetes.io/projected/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-kube-api-access-xdc2h\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.614410 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.614221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-workload-socket\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.614410 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.614248    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-credential-socket\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.614410 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.614276    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istiod-ca-cert\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.614410 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.614323    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-workload-certs\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.614410 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.614352    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-data\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.614410 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.614381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-token\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.715632 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.715596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdc2h\" (UniqueName: \"kubernetes.io/projected/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-kube-api-access-xdc2h\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.715841 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.715651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-workload-socket\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.715841 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.715680    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-credential-socket\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.715841 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.715705    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istiod-ca-cert\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.715841 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.715817    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-workload-certs\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.716086 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.716004    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-data\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.716086 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.716064    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-token\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.716201 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.716132    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-podinfo\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.716201 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.716161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-envoy\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.716201 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.716167    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-workload-socket\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.716373 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.716196    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-credential-socket\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.716427 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.716364    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-workload-certs\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.716515 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.716488    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istiod-ca-cert\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.716704 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.716686    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-data\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.718472 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.718451    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-envoy\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.719900 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.719062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-podinfo\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.725402 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.725378    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-token\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.728349 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.728308    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdc2h\" (UniqueName: \"kubernetes.io/projected/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-kube-api-access-xdc2h\") pod \"e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") " pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.834390 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.834305    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:27.970788 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.970760    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"]
Jul 28 22:39:27.973583 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:39:27.973555    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57ebfe2_3ce0_4ddf_b7a7_b7f8e927ef73.slice/crio-f2b451f9469fe7825fc9ea7276bf6984b5220f12bca9ed78fdd2738304960aed WatchSource:0}: Error finding container f2b451f9469fe7825fc9ea7276bf6984b5220f12bca9ed78fdd2738304960aed: Status 404 returned error can't find the container with id f2b451f9469fe7825fc9ea7276bf6984b5220f12bca9ed78fdd2738304960aed
Jul 28 22:39:27.975662 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.975634    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:39:27.975737 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.975695    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:39:27.975737 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:27.975723    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:39:28.285319 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:28.285283    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v" event={"ID":"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73","Type":"ContainerStarted","Data":"ff95c871ae2ededfe3a416b33d764b381826d704821dc18e63aeaeba6a6b92db"}
Jul 28 22:39:28.285535 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:28.285347    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v" event={"ID":"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73","Type":"ContainerStarted","Data":"f2b451f9469fe7825fc9ea7276bf6984b5220f12bca9ed78fdd2738304960aed"}
Jul 28 22:39:28.305768 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:28.305718    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v" podStartSLOduration=1.305701394 podStartE2EDuration="1.305701394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:39:28.30381835 +0000 UTC m=+2069.299406931" watchObservedRunningTime="2026-07-28 22:39:28.305701394 +0000 UTC m=+2069.301290032"
Jul 28 22:39:28.834915 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:28.834884    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:29.839437 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:29.839410    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:30.294178 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:30.294147    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:30.294970 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:30.294948    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:32.502634 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:32.502604    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:39:41.361705 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:41.361667    2564 generic.go:356] "Generic (PLEG): container finished" podID="a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" containerID="ff95c871ae2ededfe3a416b33d764b381826d704821dc18e63aeaeba6a6b92db" exitCode=0
Jul 28 22:39:41.362342 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:41.361745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v" event={"ID":"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73","Type":"ContainerDied","Data":"ff95c871ae2ededfe3a416b33d764b381826d704821dc18e63aeaeba6a6b92db"}
Jul 28 22:39:41.362342 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:41.362185    2564 scope.go:117] "RemoveContainer" containerID="ff95c871ae2ededfe3a416b33d764b381826d704821dc18e63aeaeba6a6b92db"
Jul 28 22:39:41.363188 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:41.363160    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:39:41.363287 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:41.363243    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:39:41.363353 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:41.363290    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:39:42.368485 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:42.368452    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v" event={"ID":"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73","Type":"ContainerStarted","Data":"ca3ac24eac04174c5e9e8212d641504895af2604ddb76482cab951a91ad45b8b"}
Jul 28 22:39:42.834990 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:42.834897    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:42.836192 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:42.836162    2564 patch_prober.go:28] interesting pod/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 28 22:39:42.836321 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:42.836238    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v" podUID="a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 28 22:39:43.835709 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:43.835663    2564 patch_prober.go:28] interesting pod/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 28 22:39:43.836238 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:43.835725    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v" podUID="a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 28 22:39:44.835412 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:44.835369    2564 patch_prober.go:28] interesting pod/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 28 22:39:44.835625 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:44.835433    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v" podUID="a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 28 22:39:45.294341 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:45.294291    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:45.835606 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:45.835564    2564 patch_prober.go:28] interesting pod/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 28 22:39:45.835857 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:45.835633    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v" podUID="a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 28 22:39:46.838448 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:46.838374    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:46.839288 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:46.839268    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:39:59.549324 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:59.549296    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:39:59.574509 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:39:59.574484    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:40:15.796337 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:15.796303    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:40:19.516248 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:19.516216    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"]
Jul 28 22:40:19.516680 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:19.516418    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v" podUID="a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" containerName="istio-proxy" containerID="cri-o://ca3ac24eac04174c5e9e8212d641504895af2604ddb76482cab951a91ad45b8b" gracePeriod=30
Jul 28 22:40:24.775050 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.775025    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:40:24.926615 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.926587    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-token\") pod \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") "
Jul 28 22:40:24.926800 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.926658    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istiod-ca-cert\") pod \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") "
Jul 28 22:40:24.926913 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.926811    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdc2h\" (UniqueName: \"kubernetes.io/projected/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-kube-api-access-xdc2h\") pod \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") "
Jul 28 22:40:24.926913 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.926867    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-data\") pod \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") "
Jul 28 22:40:24.927037 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.926918    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-podinfo\") pod \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") "
Jul 28 22:40:24.927037 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.926949    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-credential-socket\") pod \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") "
Jul 28 22:40:24.927037 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.927021    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-workload-socket\") pod \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") "
Jul 28 22:40:24.927186 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.927050    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-workload-certs\") pod \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") "
Jul 28 22:40:24.927186 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.927075    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" (UID: "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:40:24.927186 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.927087    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-envoy\") pod \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\" (UID: \"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73\") "
Jul 28 22:40:24.927403 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.927360    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" (UID: "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:40:24.927403 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.927376    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" (UID: "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:40:24.927534 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.927408    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istiod-ca-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:40:24.927663 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.927636    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" (UID: "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:40:24.927878 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.927857    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-data" (OuterVolumeSpecName: "istio-data") pod "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" (UID: "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:40:24.928963 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.928935    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-kube-api-access-xdc2h" (OuterVolumeSpecName: "kube-api-access-xdc2h") pod "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" (UID: "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73"). InnerVolumeSpecName "kube-api-access-xdc2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:40:24.929238 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.929218    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-token" (OuterVolumeSpecName: "istio-token") pod "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" (UID: "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:40:24.929238 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.929223    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" (UID: "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 22:40:24.929374 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:24.929237    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" (UID: "a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:40:25.028461 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.028438    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdc2h\" (UniqueName: \"kubernetes.io/projected/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-kube-api-access-xdc2h\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:40:25.028461 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.028458    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-data\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:40:25.028584 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.028468    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-podinfo\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:40:25.028584 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.028476    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-credential-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:40:25.028584 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.028485    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-workload-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:40:25.028584 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.028494    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-workload-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:40:25.028584 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.028503    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-envoy\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:40:25.028584 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.028510    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73-istio-token\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:40:25.570102 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.570071    2564 generic.go:356] "Generic (PLEG): container finished" podID="a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" containerID="ca3ac24eac04174c5e9e8212d641504895af2604ddb76482cab951a91ad45b8b" exitCode=0
Jul 28 22:40:25.570235 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.570113    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"
Jul 28 22:40:25.570235 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.570119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v" event={"ID":"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73","Type":"ContainerDied","Data":"ca3ac24eac04174c5e9e8212d641504895af2604ddb76482cab951a91ad45b8b"}
Jul 28 22:40:25.570235 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.570164    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v" event={"ID":"a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73","Type":"ContainerDied","Data":"f2b451f9469fe7825fc9ea7276bf6984b5220f12bca9ed78fdd2738304960aed"}
Jul 28 22:40:25.570235 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.570188    2564 scope.go:117] "RemoveContainer" containerID="ca3ac24eac04174c5e9e8212d641504895af2604ddb76482cab951a91ad45b8b"
Jul 28 22:40:25.578635 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.578619    2564 scope.go:117] "RemoveContainer" containerID="ff95c871ae2ededfe3a416b33d764b381826d704821dc18e63aeaeba6a6b92db"
Jul 28 22:40:25.589412 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.586724    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"]
Jul 28 22:40:25.589412 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.587478    2564 scope.go:117] "RemoveContainer" containerID="ca3ac24eac04174c5e9e8212d641504895af2604ddb76482cab951a91ad45b8b"
Jul 28 22:40:25.589633 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:40:25.589456    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca3ac24eac04174c5e9e8212d641504895af2604ddb76482cab951a91ad45b8b\": container with ID starting with ca3ac24eac04174c5e9e8212d641504895af2604ddb76482cab951a91ad45b8b not found: ID does not exist" containerID="ca3ac24eac04174c5e9e8212d641504895af2604ddb76482cab951a91ad45b8b"
Jul 28 22:40:25.589633 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.589488    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca3ac24eac04174c5e9e8212d641504895af2604ddb76482cab951a91ad45b8b"} err="failed to get container status \"ca3ac24eac04174c5e9e8212d641504895af2604ddb76482cab951a91ad45b8b\": rpc error: code = NotFound desc = could not find container \"ca3ac24eac04174c5e9e8212d641504895af2604ddb76482cab951a91ad45b8b\": container with ID starting with ca3ac24eac04174c5e9e8212d641504895af2604ddb76482cab951a91ad45b8b not found: ID does not exist"
Jul 28 22:40:25.589633 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.589510    2564 scope.go:117] "RemoveContainer" containerID="ff95c871ae2ededfe3a416b33d764b381826d704821dc18e63aeaeba6a6b92db"
Jul 28 22:40:25.589905 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:40:25.589885    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff95c871ae2ededfe3a416b33d764b381826d704821dc18e63aeaeba6a6b92db\": container with ID starting with ff95c871ae2ededfe3a416b33d764b381826d704821dc18e63aeaeba6a6b92db not found: ID does not exist" containerID="ff95c871ae2ededfe3a416b33d764b381826d704821dc18e63aeaeba6a6b92db"
Jul 28 22:40:25.589971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.589913    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff95c871ae2ededfe3a416b33d764b381826d704821dc18e63aeaeba6a6b92db"} err="failed to get container status \"ff95c871ae2ededfe3a416b33d764b381826d704821dc18e63aeaeba6a6b92db\": rpc error: code = NotFound desc = could not find container \"ff95c871ae2ededfe3a416b33d764b381826d704821dc18e63aeaeba6a6b92db\": container with ID starting with ff95c871ae2ededfe3a416b33d764b381826d704821dc18e63aeaeba6a6b92db not found: ID does not exist"
Jul 28 22:40:25.591265 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:25.591246    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-cc3d4e93-openshift-default-5ffbbddc7b-b699v"]
Jul 28 22:40:27.508455 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:27.508422    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" path="/var/lib/kubelet/pods/a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73/volumes"
Jul 28 22:40:39.701869 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.701839    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"]
Jul 28 22:40:39.702274 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.702177    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" containerName="istio-proxy"
Jul 28 22:40:39.702274 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.702188    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" containerName="istio-proxy"
Jul 28 22:40:39.702274 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.702211    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" containerName="istio-proxy"
Jul 28 22:40:39.702274 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.702216    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" containerName="istio-proxy"
Jul 28 22:40:39.702274 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.702264    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" containerName="istio-proxy"
Jul 28 22:40:39.702274 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.702274    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="393772fe-cd84-4622-bfbe-6a60a7d72790" containerName="istio-proxy"
Jul 28 22:40:39.705209 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.705187    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.707259 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.707238    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-25c13375-openshift-default-dockercfg-d89xh\""
Jul 28 22:40:39.717285 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.717263    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"]
Jul 28 22:40:39.758954 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.758924    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-envoy\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.759097 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.758976    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-data\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.759097 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.759035    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4rnh\" (UniqueName: \"kubernetes.io/projected/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-kube-api-access-n4rnh\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.759097 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.759084    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istiod-ca-cert\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.759267 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.759154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-credential-socket\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.759267 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.759192    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-workload-certs\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.759267 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.759231    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-token\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.759393 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.759282    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-workload-socket\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.759393 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.759310    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-podinfo\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.860136 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.860108    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-envoy\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.860312 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.860156    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-data\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.860312 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.860176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4rnh\" (UniqueName: \"kubernetes.io/projected/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-kube-api-access-n4rnh\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.860312 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.860200    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istiod-ca-cert\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.860312 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.860234    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-credential-socket\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.860312 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.860248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-workload-certs\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.860312 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.860271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-token\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.860312 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.860291    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-workload-socket\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.860649 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.860315    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-podinfo\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.860649 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.860579    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-data\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.860737 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.860720    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-credential-socket\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.860781 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.860744    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-workload-certs\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.860922 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.860903    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-workload-socket\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.861174 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.861155    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istiod-ca-cert\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.862469 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.862442    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-envoy\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.862943 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.862920    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-podinfo\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.868664 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.868642    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-token\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:39.871281 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:39.871251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4rnh\" (UniqueName: \"kubernetes.io/projected/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-kube-api-access-n4rnh\") pod \"e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") " pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:40.016668 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:40.016606    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:40.148550 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:40.148521    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"]
Jul 28 22:40:40.151925 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:40:40.151902    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod902593c8_963a_4d9b_8e6b_3a4f17a3e9af.slice/crio-faacb8dd7dbf971a3d492999d884578052e09cbced2522114ad4432851834daa WatchSource:0}: Error finding container faacb8dd7dbf971a3d492999d884578052e09cbced2522114ad4432851834daa: Status 404 returned error can't find the container with id faacb8dd7dbf971a3d492999d884578052e09cbced2522114ad4432851834daa
Jul 28 22:40:40.153978 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:40.153950    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:40:40.154049 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:40.154011    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:40:40.154049 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:40.154038    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:40:40.636812 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:40.636782    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx" event={"ID":"902593c8-963a-4d9b-8e6b-3a4f17a3e9af","Type":"ContainerStarted","Data":"6ea2d3f851098b03b345a32a6213c2477264a2dc5fea38cc227fe05a315f2460"}
Jul 28 22:40:40.636983 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:40.636842    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx" event={"ID":"902593c8-963a-4d9b-8e6b-3a4f17a3e9af","Type":"ContainerStarted","Data":"faacb8dd7dbf971a3d492999d884578052e09cbced2522114ad4432851834daa"}
Jul 28 22:40:40.655653 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:40.655610    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx" podStartSLOduration=1.6555944089999999 podStartE2EDuration="1.655594409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:40:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:40:40.654068644 +0000 UTC m=+2141.649657237" watchObservedRunningTime="2026-07-28 22:40:40.655594409 +0000 UTC m=+2141.651182990"
Jul 28 22:40:41.017035 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:41.016960    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:41.021735 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:41.021711    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:41.641810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:41.641783    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:41.642768 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:41.642750    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:47.791843 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:47.791797    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:40:56.643458 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:56.643425    2564 patch_prober.go:28] interesting pod/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 28 22:40:56.643868 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:56.643489    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx" podUID="902593c8-963a-4d9b-8e6b-3a4f17a3e9af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 28 22:40:56.714058 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:56.714025    2564 generic.go:356] "Generic (PLEG): container finished" podID="902593c8-963a-4d9b-8e6b-3a4f17a3e9af" containerID="6ea2d3f851098b03b345a32a6213c2477264a2dc5fea38cc227fe05a315f2460" exitCode=0
Jul 28 22:40:56.714210 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:56.714100    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx" event={"ID":"902593c8-963a-4d9b-8e6b-3a4f17a3e9af","Type":"ContainerDied","Data":"6ea2d3f851098b03b345a32a6213c2477264a2dc5fea38cc227fe05a315f2460"}
Jul 28 22:40:56.714500 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:56.714482    2564 scope.go:117] "RemoveContainer" containerID="6ea2d3f851098b03b345a32a6213c2477264a2dc5fea38cc227fe05a315f2460"
Jul 28 22:40:56.715467 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:56.715438    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:40:56.715573 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:56.715506    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:40:56.715573 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:56.715541    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:40:57.723637 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:57.723604    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx" event={"ID":"902593c8-963a-4d9b-8e6b-3a4f17a3e9af","Type":"ContainerStarted","Data":"df6ad47cc0164ad65e98ca3d97f3865bcaf35add8856431d8588e31efca5e886"}
Jul 28 22:40:58.018201 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:58.018108    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:40:58.018799 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:58.018773    2564 patch_prober.go:28] interesting pod/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 28 22:40:58.019016 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:58.018987    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx" podUID="902593c8-963a-4d9b-8e6b-3a4f17a3e9af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 28 22:40:59.017582 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:59.017537    2564 patch_prober.go:28] interesting pod/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 28 22:40:59.018091 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:40:59.017603    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx" podUID="902593c8-963a-4d9b-8e6b-3a4f17a3e9af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 28 22:41:00.018149 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:00.018061    2564 patch_prober.go:28] interesting pod/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 28 22:41:00.018686 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:00.018654    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx" podUID="902593c8-963a-4d9b-8e6b-3a4f17a3e9af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 28 22:41:01.017461 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:01.017415    2564 patch_prober.go:28] interesting pod/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 28 22:41:01.017681 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:01.017503    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx" podUID="902593c8-963a-4d9b-8e6b-3a4f17a3e9af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 28 22:41:02.021507 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:02.021478    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:41:02.021958 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:02.021759    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:41:02.022320 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:02.022302    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:41:20.052752 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.052723    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"]
Jul 28 22:41:20.053258 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.053140    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a57ebfe2-3ce0-4ddf-b7a7-b7f8e927ef73" containerName="istio-proxy"
Jul 28 22:41:20.056144 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.056129    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.058844 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.058792    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-25c13375\"/\"openshift-service-ca.crt\""
Jul 28 22:41:20.058844 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.058804    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-25c13375\"/\"e2e-lifecycle-model-25c13375-kserve-self-signed-certs\""
Jul 28 22:41:20.058844 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.058821    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-25c13375\"/\"kube-root-ca.crt\""
Jul 28 22:41:20.059111 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.058846    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-25c13375\"/\"default-dockercfg-dvh4r\""
Jul 28 22:41:20.064292 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.064272    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"]
Jul 28 22:41:20.201940 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.201905    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f228619-2178-4ed3-bf38-5b09dd192358-tls-certs\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.201940 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.201945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-tmp-dir\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.202154 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.202005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-home\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.202154 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.202047    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpbpq\" (UniqueName: \"kubernetes.io/projected/9f228619-2178-4ed3-bf38-5b09dd192358-kube-api-access-cpbpq\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.202154 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.202122    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-dshm\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.202256 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.202178    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-model-cache\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.303524 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.303446    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-home\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.303524 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.303487    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbpq\" (UniqueName: \"kubernetes.io/projected/9f228619-2178-4ed3-bf38-5b09dd192358-kube-api-access-cpbpq\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.303716 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.303541    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-dshm\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.303716 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.303605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-model-cache\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.303716 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.303641    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f228619-2178-4ed3-bf38-5b09dd192358-tls-certs\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.303716 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.303675    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-tmp-dir\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.303975 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.303898    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-home\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.304040 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.303987    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-model-cache\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.304040 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.304017    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-tmp-dir\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.305897 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.305875    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-dshm\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.306025 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.306003    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f228619-2178-4ed3-bf38-5b09dd192358-tls-certs\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.311163 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.311134    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpbpq\" (UniqueName: \"kubernetes.io/projected/9f228619-2178-4ed3-bf38-5b09dd192358-kube-api-access-cpbpq\") pod \"e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") " pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.366709 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.366684    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:20.498423 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.498358    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"]
Jul 28 22:41:20.500591 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:41:20.500565    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f228619_2178_4ed3_bf38_5b09dd192358.slice/crio-c42434a0c5045bee245f8eef8d73bc699871b7016c982772edcbb410e4920827 WatchSource:0}: Error finding container c42434a0c5045bee245f8eef8d73bc699871b7016c982772edcbb410e4920827: Status 404 returned error can't find the container with id c42434a0c5045bee245f8eef8d73bc699871b7016c982772edcbb410e4920827
Jul 28 22:41:20.833049 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.833004    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc" event={"ID":"9f228619-2178-4ed3-bf38-5b09dd192358","Type":"ContainerStarted","Data":"400db52ef71e123a0ac34b118c1a7ee02cc735f98fdec74210e682319c0173c3"}
Jul 28 22:41:20.833218 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.833054    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc" event={"ID":"9f228619-2178-4ed3-bf38-5b09dd192358","Type":"ContainerStarted","Data":"c42434a0c5045bee245f8eef8d73bc699871b7016c982772edcbb410e4920827"}
Jul 28 22:41:20.848455 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:20.848408    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc" podStartSLOduration=0.848392057 podStartE2EDuration="848.392057ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:41:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:41:20.847174564 +0000 UTC m=+2181.842763146" watchObservedRunningTime="2026-07-28 22:41:20.848392057 +0000 UTC m=+2181.843980639"
Jul 28 22:41:23.489933 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:23.489903    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:41:30.367394 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:30.367364    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:30.367800 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:30.367411    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:30.379714 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:30.379690    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:30.892541 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:30.892515    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:41:37.298355 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:37.298316    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:41:55.586457 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:41:55.586423    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:42:05.816729 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:05.816693    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:42:05.872355 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:05.872331    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"]
Jul 28 22:42:20.890939 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:20.890804    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc" podUID="9f228619-2178-4ed3-bf38-5b09dd192358" containerName="main" containerID="cri-o://400db52ef71e123a0ac34b118c1a7ee02cc735f98fdec74210e682319c0173c3" gracePeriod=45
Jul 28 22:42:20.894583 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:20.894549    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc" podUID="9f228619-2178-4ed3-bf38-5b09dd192358" containerName="main" probeResult="failure" output="Get \"https://10.133.0.39:8000/ready\": read tcp 10.133.0.2:50154->10.133.0.39:8000: read: connection reset by peer"
Jul 28 22:42:21.112304 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.112274    2564 generic.go:356] "Generic (PLEG): container finished" podID="9f228619-2178-4ed3-bf38-5b09dd192358" containerID="400db52ef71e123a0ac34b118c1a7ee02cc735f98fdec74210e682319c0173c3" exitCode=0
Jul 28 22:42:21.112457 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.112345    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc" event={"ID":"9f228619-2178-4ed3-bf38-5b09dd192358","Type":"ContainerDied","Data":"400db52ef71e123a0ac34b118c1a7ee02cc735f98fdec74210e682319c0173c3"}
Jul 28 22:42:21.144130 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.144075    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:42:21.228783 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.228751    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-home\") pod \"9f228619-2178-4ed3-bf38-5b09dd192358\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") "
Jul 28 22:42:21.228961 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.228801    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-dshm\") pod \"9f228619-2178-4ed3-bf38-5b09dd192358\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") "
Jul 28 22:42:21.228961 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.228856    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-model-cache\") pod \"9f228619-2178-4ed3-bf38-5b09dd192358\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") "
Jul 28 22:42:21.228961 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.228926    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-tmp-dir\") pod \"9f228619-2178-4ed3-bf38-5b09dd192358\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") "
Jul 28 22:42:21.229125 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.228964    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f228619-2178-4ed3-bf38-5b09dd192358-tls-certs\") pod \"9f228619-2178-4ed3-bf38-5b09dd192358\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") "
Jul 28 22:42:21.229125 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.228988    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpbpq\" (UniqueName: \"kubernetes.io/projected/9f228619-2178-4ed3-bf38-5b09dd192358-kube-api-access-cpbpq\") pod \"9f228619-2178-4ed3-bf38-5b09dd192358\" (UID: \"9f228619-2178-4ed3-bf38-5b09dd192358\") "
Jul 28 22:42:21.229125 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.229009    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-home" (OuterVolumeSpecName: "home") pod "9f228619-2178-4ed3-bf38-5b09dd192358" (UID: "9f228619-2178-4ed3-bf38-5b09dd192358"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:42:21.229125 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.229110    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-model-cache" (OuterVolumeSpecName: "model-cache") pod "9f228619-2178-4ed3-bf38-5b09dd192358" (UID: "9f228619-2178-4ed3-bf38-5b09dd192358"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:42:21.229286 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.229150    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9f228619-2178-4ed3-bf38-5b09dd192358" (UID: "9f228619-2178-4ed3-bf38-5b09dd192358"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:42:21.229286 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.229269    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-tmp-dir\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:42:21.229286 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.229282    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-home\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:42:21.229400 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.229295    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-model-cache\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:42:21.231021 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.230992    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f228619-2178-4ed3-bf38-5b09dd192358-kube-api-access-cpbpq" (OuterVolumeSpecName: "kube-api-access-cpbpq") pod "9f228619-2178-4ed3-bf38-5b09dd192358" (UID: "9f228619-2178-4ed3-bf38-5b09dd192358"). InnerVolumeSpecName "kube-api-access-cpbpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:42:21.231123 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.231029    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f228619-2178-4ed3-bf38-5b09dd192358-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9f228619-2178-4ed3-bf38-5b09dd192358" (UID: "9f228619-2178-4ed3-bf38-5b09dd192358"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:42:21.231123 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.231065    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-dshm" (OuterVolumeSpecName: "dshm") pod "9f228619-2178-4ed3-bf38-5b09dd192358" (UID: "9f228619-2178-4ed3-bf38-5b09dd192358"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:42:21.330418 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.330394    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f228619-2178-4ed3-bf38-5b09dd192358-tls-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:42:21.330530 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.330426    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpbpq\" (UniqueName: \"kubernetes.io/projected/9f228619-2178-4ed3-bf38-5b09dd192358-kube-api-access-cpbpq\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:42:21.330530 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:21.330437    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f228619-2178-4ed3-bf38-5b09dd192358-dshm\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:42:22.118068 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:22.118039    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"
Jul 28 22:42:22.118510 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:22.118038    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc" event={"ID":"9f228619-2178-4ed3-bf38-5b09dd192358","Type":"ContainerDied","Data":"c42434a0c5045bee245f8eef8d73bc699871b7016c982772edcbb410e4920827"}
Jul 28 22:42:22.118510 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:22.118174    2564 scope.go:117] "RemoveContainer" containerID="400db52ef71e123a0ac34b118c1a7ee02cc735f98fdec74210e682319c0173c3"
Jul 28 22:42:22.135348 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:22.135323    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"]
Jul 28 22:42:22.140884 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:22.140861    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-25c13375/e2e-lifecycle-model-25c13375-kserve-66557b9979-7wtvc"]
Jul 28 22:42:23.507341 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:23.507309    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f228619-2178-4ed3-bf38-5b09dd192358" path="/var/lib/kubelet/pods/9f228619-2178-4ed3-bf38-5b09dd192358/volumes"
Jul 28 22:42:59.625635 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:42:59.625605    2564 scope.go:117] "RemoveContainer" containerID="3400eb824c7330ba0cb3e2e618aabb5beddf765a9c621e39f3ddd896e8fdf5d7"
Jul 28 22:43:03.171088 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:03.171056    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"]
Jul 28 22:43:03.171460 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:03.171255    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx" podUID="902593c8-963a-4d9b-8e6b-3a4f17a3e9af" containerName="istio-proxy" containerID="cri-o://df6ad47cc0164ad65e98ca3d97f3865bcaf35add8856431d8588e31efca5e886" gracePeriod=30
Jul 28 22:43:06.818421 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:06.818391    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:43:08.336545 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.336508    2564 generic.go:356] "Generic (PLEG): container finished" podID="902593c8-963a-4d9b-8e6b-3a4f17a3e9af" containerID="df6ad47cc0164ad65e98ca3d97f3865bcaf35add8856431d8588e31efca5e886" exitCode=0
Jul 28 22:43:08.337004 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.336577    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx" event={"ID":"902593c8-963a-4d9b-8e6b-3a4f17a3e9af","Type":"ContainerDied","Data":"df6ad47cc0164ad65e98ca3d97f3865bcaf35add8856431d8588e31efca5e886"}
Jul 28 22:43:08.337004 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.336637    2564 scope.go:117] "RemoveContainer" containerID="6ea2d3f851098b03b345a32a6213c2477264a2dc5fea38cc227fe05a315f2460"
Jul 28 22:43:08.430240 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.430178    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:43:08.516931 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.516905    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4rnh\" (UniqueName: \"kubernetes.io/projected/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-kube-api-access-n4rnh\") pod \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") "
Jul 28 22:43:08.517062 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.516973    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-credential-socket\") pod \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") "
Jul 28 22:43:08.517062 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517029    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-workload-certs\") pod \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") "
Jul 28 22:43:08.517146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517064    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-data\") pod \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") "
Jul 28 22:43:08.517146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517107    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-workload-socket\") pod \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") "
Jul 28 22:43:08.517146 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517136    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-envoy\") pod \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") "
Jul 28 22:43:08.517356 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517313    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "902593c8-963a-4d9b-8e6b-3a4f17a3e9af" (UID: "902593c8-963a-4d9b-8e6b-3a4f17a3e9af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:43:08.517430 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517299    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "902593c8-963a-4d9b-8e6b-3a4f17a3e9af" (UID: "902593c8-963a-4d9b-8e6b-3a4f17a3e9af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:43:08.517430 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517367    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "902593c8-963a-4d9b-8e6b-3a4f17a3e9af" (UID: "902593c8-963a-4d9b-8e6b-3a4f17a3e9af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:43:08.517430 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517402    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istiod-ca-cert\") pod \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") "
Jul 28 22:43:08.517430 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517418    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-token\") pod \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") "
Jul 28 22:43:08.517649 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517512    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-podinfo\") pod \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\" (UID: \"902593c8-963a-4d9b-8e6b-3a4f17a3e9af\") "
Jul 28 22:43:08.517726 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517703    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "902593c8-963a-4d9b-8e6b-3a4f17a3e9af" (UID: "902593c8-963a-4d9b-8e6b-3a4f17a3e9af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:43:08.517847 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517816    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-workload-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:43:08.517968 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517852    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-workload-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:43:08.517968 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517868    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istiod-ca-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:43:08.517968 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517883    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-credential-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:43:08.517968 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.517935    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-data" (OuterVolumeSpecName: "istio-data") pod "902593c8-963a-4d9b-8e6b-3a4f17a3e9af" (UID: "902593c8-963a-4d9b-8e6b-3a4f17a3e9af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:43:08.519117 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.519091    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-kube-api-access-n4rnh" (OuterVolumeSpecName: "kube-api-access-n4rnh") pod "902593c8-963a-4d9b-8e6b-3a4f17a3e9af" (UID: "902593c8-963a-4d9b-8e6b-3a4f17a3e9af"). InnerVolumeSpecName "kube-api-access-n4rnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:43:08.519423 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.519404    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-token" (OuterVolumeSpecName: "istio-token") pod "902593c8-963a-4d9b-8e6b-3a4f17a3e9af" (UID: "902593c8-963a-4d9b-8e6b-3a4f17a3e9af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:43:08.519695 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.519680    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "902593c8-963a-4d9b-8e6b-3a4f17a3e9af" (UID: "902593c8-963a-4d9b-8e6b-3a4f17a3e9af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:43:08.519695 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.519685    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "902593c8-963a-4d9b-8e6b-3a4f17a3e9af" (UID: "902593c8-963a-4d9b-8e6b-3a4f17a3e9af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 22:43:08.619104 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.619079    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-podinfo\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:43:08.619104 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.619101    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4rnh\" (UniqueName: \"kubernetes.io/projected/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-kube-api-access-n4rnh\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:43:08.619227 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.619112    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-data\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:43:08.619227 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.619122    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-envoy\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:43:08.619227 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:08.619130    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/902593c8-963a-4d9b-8e6b-3a4f17a3e9af-istio-token\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:43:09.343913 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:09.343882    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"
Jul 28 22:43:09.344318 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:09.343908    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx" event={"ID":"902593c8-963a-4d9b-8e6b-3a4f17a3e9af","Type":"ContainerDied","Data":"faacb8dd7dbf971a3d492999d884578052e09cbced2522114ad4432851834daa"}
Jul 28 22:43:09.344318 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:09.343969    2564 scope.go:117] "RemoveContainer" containerID="df6ad47cc0164ad65e98ca3d97f3865bcaf35add8856431d8588e31efca5e886"
Jul 28 22:43:09.364735 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:09.364699    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"]
Jul 28 22:43:09.369772 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:09.369748    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-25c13375-openshift-default-584c88ccdd-74ltx"]
Jul 28 22:43:09.508127 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:09.508094    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="902593c8-963a-4d9b-8e6b-3a4f17a3e9af" path="/var/lib/kubelet/pods/902593c8-963a-4d9b-8e6b-3a4f17a3e9af/volumes"
Jul 28 22:43:18.693907 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:18.693868    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:43:58.184233 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.184162    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"]
Jul 28 22:43:58.184677 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.184544    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f228619-2178-4ed3-bf38-5b09dd192358" containerName="main"
Jul 28 22:43:58.184677 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.184559    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f228619-2178-4ed3-bf38-5b09dd192358" containerName="main"
Jul 28 22:43:58.184677 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.184572    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="902593c8-963a-4d9b-8e6b-3a4f17a3e9af" containerName="istio-proxy"
Jul 28 22:43:58.184677 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.184578    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="902593c8-963a-4d9b-8e6b-3a4f17a3e9af" containerName="istio-proxy"
Jul 28 22:43:58.184677 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.184644    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f228619-2178-4ed3-bf38-5b09dd192358" containerName="main"
Jul 28 22:43:58.184677 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.184652    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="902593c8-963a-4d9b-8e6b-3a4f17a3e9af" containerName="istio-proxy"
Jul 28 22:43:58.184677 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.184659    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="902593c8-963a-4d9b-8e6b-3a4f17a3e9af" containerName="istio-proxy"
Jul 28 22:43:58.187478 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.187462    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.189647 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.189626    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-9216b7-openshift-default-dockercfg-zbw8m\""
Jul 28 22:43:58.201199 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.201179    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"]
Jul 28 22:43:58.252377 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.252347    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-credential-socket\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.252551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.252381    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfzrp\" (UniqueName: \"kubernetes.io/projected/ab1e225c-5491-40be-9adf-a15debc1d8ac-kube-api-access-zfzrp\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.252551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.252410    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-data\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.252551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.252441    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-podinfo\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.252551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.252472    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab1e225c-5491-40be-9adf-a15debc1d8ac-istiod-ca-cert\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.252551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.252488    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-envoy\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.252551 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.252502    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-token\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.252816 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.252563    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-workload-certs\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.252816 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.252642    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-workload-socket\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.354018 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.353966    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-podinfo\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.354230 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.354119    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab1e225c-5491-40be-9adf-a15debc1d8ac-istiod-ca-cert\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.354230 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.354149    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-envoy\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.354230 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.354174    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-token\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.354230 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.354216    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-workload-certs\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.354460 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.354259    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-workload-socket\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.354460 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.354323    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-credential-socket\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.354460 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.354354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfzrp\" (UniqueName: \"kubernetes.io/projected/ab1e225c-5491-40be-9adf-a15debc1d8ac-kube-api-access-zfzrp\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.354460 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.354393    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-data\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.354664 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.354632    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-workload-certs\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.354767 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.354746    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-data\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.354890 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.354857    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-credential-socket\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.355023 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.354910    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-workload-socket\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.355023 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.354965    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab1e225c-5491-40be-9adf-a15debc1d8ac-istiod-ca-cert\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.356525 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.356504    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-envoy\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.356620 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.356604    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-podinfo\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.361919 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.361899    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-token\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.362364 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.362346    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfzrp\" (UniqueName: \"kubernetes.io/projected/ab1e225c-5491-40be-9adf-a15debc1d8ac-kube-api-access-zfzrp\") pod \"e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") " pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.497417 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.497341    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:43:58.634718 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.634612    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"]
Jul 28 22:43:58.637514 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:43:58.637486    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1e225c_5491_40be_9adf_a15debc1d8ac.slice/crio-69b6f642494e9c0ab1b0f0e6a2dea8a2fc0c15c81b13db9d20364024cf29ffa0 WatchSource:0}: Error finding container 69b6f642494e9c0ab1b0f0e6a2dea8a2fc0c15c81b13db9d20364024cf29ffa0: Status 404 returned error can't find the container with id 69b6f642494e9c0ab1b0f0e6a2dea8a2fc0c15c81b13db9d20364024cf29ffa0
Jul 28 22:43:58.639784 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.639746    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:43:58.639892 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.639849    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:43:58.639935 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:58.639894    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:43:59.569197 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:59.569154    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs" event={"ID":"ab1e225c-5491-40be-9adf-a15debc1d8ac","Type":"ContainerStarted","Data":"6d91e9a6c06e218426254386c73ab3f5ff89cccea2ef1f0d07aff5016fbf3d11"}
Jul 28 22:43:59.569635 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:59.569220    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs" event={"ID":"ab1e225c-5491-40be-9adf-a15debc1d8ac","Type":"ContainerStarted","Data":"69b6f642494e9c0ab1b0f0e6a2dea8a2fc0c15c81b13db9d20364024cf29ffa0"}
Jul 28 22:43:59.588121 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:59.588079    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs" podStartSLOduration=1.588065371 podStartE2EDuration="1.588065371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:43:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:43:59.587104219 +0000 UTC m=+2340.582692801" watchObservedRunningTime="2026-07-28 22:43:59.588065371 +0000 UTC m=+2340.583653953"
Jul 28 22:43:59.646997 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:43:59.646967    2564 scope.go:117] "RemoveContainer" containerID="da2d4cce2945382bdb129348ab8084532b13f598b8154a74e4733ff4a3e7bbdc"
Jul 28 22:44:00.497983 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:00.497950    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:44:00.502934 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:00.502906    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:44:00.574094 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:00.574060    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:44:00.574946 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:00.574918    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:44:06.899842 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:06.899798    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:44:14.650853 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:14.650799    2564 generic.go:356] "Generic (PLEG): container finished" podID="ab1e225c-5491-40be-9adf-a15debc1d8ac" containerID="6d91e9a6c06e218426254386c73ab3f5ff89cccea2ef1f0d07aff5016fbf3d11" exitCode=0
Jul 28 22:44:14.651255 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:14.650874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs" event={"ID":"ab1e225c-5491-40be-9adf-a15debc1d8ac","Type":"ContainerDied","Data":"6d91e9a6c06e218426254386c73ab3f5ff89cccea2ef1f0d07aff5016fbf3d11"}
Jul 28 22:44:14.651255 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:14.651231    2564 scope.go:117] "RemoveContainer" containerID="6d91e9a6c06e218426254386c73ab3f5ff89cccea2ef1f0d07aff5016fbf3d11"
Jul 28 22:44:14.652219 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:14.652192    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:44:14.652305 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:14.652256    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:44:14.652305 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:14.652288    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:44:15.574933 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:15.574900    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:44:15.657479 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:15.657442    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs" event={"ID":"ab1e225c-5491-40be-9adf-a15debc1d8ac","Type":"ContainerStarted","Data":"3da3d09a0cf316f0b0351be0c342548e0ccb01c764f6bdbae045079dce18d469"}
Jul 28 22:44:16.497911 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:16.497877    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:44:16.498975 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:16.498943    2564 patch_prober.go:28] interesting pod/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 28 22:44:16.499088 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:16.499002    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs" podUID="ab1e225c-5491-40be-9adf-a15debc1d8ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 28 22:44:17.498253 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:17.498221    2564 patch_prober.go:28] interesting pod/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 28 22:44:17.498749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:17.498275    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs" podUID="ab1e225c-5491-40be-9adf-a15debc1d8ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 28 22:44:18.498402 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:18.498362    2564 patch_prober.go:28] interesting pod/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 28 22:44:18.498869 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:18.498421    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs" podUID="ab1e225c-5491-40be-9adf-a15debc1d8ac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 28 22:44:19.501795 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:19.501764    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:44:19.507355 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:19.507332    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:44:19.507484 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:19.507392    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:44:27.166768 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.166739    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"]
Jul 28 22:44:27.167314 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.167294    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="902593c8-963a-4d9b-8e6b-3a4f17a3e9af" containerName="istio-proxy"
Jul 28 22:44:27.167399 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.167317    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="902593c8-963a-4d9b-8e6b-3a4f17a3e9af" containerName="istio-proxy"
Jul 28 22:44:27.170277 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.170255    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.172451 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.172423    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-dd9c88-openshift-default-dockercfg-s4mgd\""
Jul 28 22:44:27.182349 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.182322    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"]
Jul 28 22:44:27.318925 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.318890    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-data\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.319081 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.318942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-workload-certs\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.319081 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.318967    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q946\" (UniqueName: \"kubernetes.io/projected/05d0f3d1-3703-4550-8bc6-37427c57aa9d-kube-api-access-7q946\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.319179 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.319085    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-token\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.319179 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.319130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istiod-ca-cert\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.319245 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.319188    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-envoy\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.319245 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.319221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-podinfo\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.319310 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.319267    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-credential-socket\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.319344 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.319337    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-workload-socket\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.420461 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.420379    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-token\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.420461 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.420414    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istiod-ca-cert\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.420461 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.420440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-envoy\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.420742 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.420538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-podinfo\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.420742 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.420591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-credential-socket\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.420742 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.420626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-workload-socket\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.420742 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.420698    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-data\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.420986 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.420751    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-workload-certs\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.420986 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.420784    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q946\" (UniqueName: \"kubernetes.io/projected/05d0f3d1-3703-4550-8bc6-37427c57aa9d-kube-api-access-7q946\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.421097 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.421042    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-credential-socket\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.421137 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.421106    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-data\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.421294 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.421271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-workload-socket\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.421384 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.421364    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-workload-certs\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.421717 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.421698    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istiod-ca-cert\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.422865 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.422839    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-envoy\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.423108 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.423087    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-podinfo\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.427461 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.427434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-token\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.427589 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.427572    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q946\" (UniqueName: \"kubernetes.io/projected/05d0f3d1-3703-4550-8bc6-37427c57aa9d-kube-api-access-7q946\") pod \"e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") " pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.481617 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.481592    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:27.618227 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.618198    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"]
Jul 28 22:44:27.619771 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:44:27.619725    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d0f3d1_3703_4550_8bc6_37427c57aa9d.slice/crio-28963ea2c0eb6e1f4e556246befffa75607004ba541789e9e16b4782b73f9696 WatchSource:0}: Error finding container 28963ea2c0eb6e1f4e556246befffa75607004ba541789e9e16b4782b73f9696: Status 404 returned error can't find the container with id 28963ea2c0eb6e1f4e556246befffa75607004ba541789e9e16b4782b73f9696
Jul 28 22:44:27.622064 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.622027    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:44:27.622190 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.622112    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:44:27.622190 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.622151    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:44:27.715785 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.715753    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq" event={"ID":"05d0f3d1-3703-4550-8bc6-37427c57aa9d","Type":"ContainerStarted","Data":"b46b96567323aa4fd694a5e21a0283c4c67ecf83bc55ec564d961f921681961c"}
Jul 28 22:44:27.715987 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.715812    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq" event={"ID":"05d0f3d1-3703-4550-8bc6-37427c57aa9d","Type":"ContainerStarted","Data":"28963ea2c0eb6e1f4e556246befffa75607004ba541789e9e16b4782b73f9696"}
Jul 28 22:44:27.752042 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:27.751986    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq" podStartSLOduration=0.751964279 podStartE2EDuration="751.964279ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:44:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:44:27.750516073 +0000 UTC m=+2368.746104673" watchObservedRunningTime="2026-07-28 22:44:27.751964279 +0000 UTC m=+2368.747552861"
Jul 28 22:44:28.482262 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:28.482229    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:28.486937 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:28.486908    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:28.720170 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:28.720144    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:28.720919 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:28.720900    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:38.388355 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:38.388319    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:44:44.763013 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:44.762965    2564 patch_prober.go:28] interesting pod/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 22:44:44.763462 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:44.763038    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq" podUID="05d0f3d1-3703-4550-8bc6-37427c57aa9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 22:44:46.804605 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:46.804572    2564 generic.go:356] "Generic (PLEG): container finished" podID="05d0f3d1-3703-4550-8bc6-37427c57aa9d" containerID="b46b96567323aa4fd694a5e21a0283c4c67ecf83bc55ec564d961f921681961c" exitCode=0
Jul 28 22:44:46.805008 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:46.804646    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq" event={"ID":"05d0f3d1-3703-4550-8bc6-37427c57aa9d","Type":"ContainerDied","Data":"b46b96567323aa4fd694a5e21a0283c4c67ecf83bc55ec564d961f921681961c"}
Jul 28 22:44:46.805074 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:46.805058    2564 scope.go:117] "RemoveContainer" containerID="b46b96567323aa4fd694a5e21a0283c4c67ecf83bc55ec564d961f921681961c"
Jul 28 22:44:46.806074 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:46.806046    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:44:46.806198 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:46.806127    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:44:46.806198 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:46.806176    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:44:47.812191 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:47.812143    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq" event={"ID":"05d0f3d1-3703-4550-8bc6-37427c57aa9d","Type":"ContainerStarted","Data":"463418f05f5177c7235e7f20bb20b1716639129e15251985664faccbecd1421a"}
Jul 28 22:44:48.481979 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:48.481939    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:48.482175 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:48.482159    2564 patch_prober.go:28] interesting pod/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 22:44:48.482239 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:48.482219    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq" podUID="05d0f3d1-3703-4550-8bc6-37427c57aa9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 22:44:49.482078 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:49.482043    2564 patch_prober.go:28] interesting pod/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 22:44:49.482460 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:49.482115    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq" podUID="05d0f3d1-3703-4550-8bc6-37427c57aa9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 22:44:50.482026 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:50.481994    2564 patch_prober.go:28] interesting pod/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 22:44:50.482205 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:50.482046    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq" podUID="05d0f3d1-3703-4550-8bc6-37427c57aa9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 22:44:51.482968 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:51.482925    2564 patch_prober.go:28] interesting pod/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 22:44:51.483446 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:51.482988    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq" podUID="05d0f3d1-3703-4550-8bc6-37427c57aa9d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 22:44:52.486259 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:52.486222    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:52.486658 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:52.486490    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:52.487229 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:52.487206    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:44:59.575821 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:59.575790    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:44:59.606036 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:44:59.606012    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:45:07.154117 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.154082    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"]
Jul 28 22:45:07.157905 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.157882    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.160510 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.160468    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9216b7\"/\"kube-root-ca.crt\""
Jul 28 22:45:07.160649 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.160510    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9216b7\"/\"test-model-9216b7-kserve-self-signed-certs\""
Jul 28 22:45:07.160649 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.160536    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9216b7\"/\"openshift-service-ca.crt\""
Jul 28 22:45:07.160649 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.160590    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9216b7\"/\"default-dockercfg-982b8\""
Jul 28 22:45:07.167248 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.167228    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"]
Jul 28 22:45:07.272581 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.272549    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-model-cache\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.272736 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.272602    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-dshm\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.272736 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.272637    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-tls-certs\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.272736 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.272703    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-tmp-dir\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.272868 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.272816    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck9dp\" (UniqueName: \"kubernetes.io/projected/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-kube-api-access-ck9dp\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.272913 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.272873    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-home\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.374110 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.374075    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck9dp\" (UniqueName: \"kubernetes.io/projected/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-kube-api-access-ck9dp\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.374110 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.374112    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-home\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.374362 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.374135    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-model-cache\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.374362 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.374171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-dshm\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.374362 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.374187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-tls-certs\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.374362 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.374210    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-tmp-dir\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.374569 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.374550    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-home\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.374632 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.374570    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-tmp-dir\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.374632 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.374599    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-model-cache\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.376609 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.376580    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-dshm\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.376813 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.376799    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-tls-certs\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.381763 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.381740    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck9dp\" (UniqueName: \"kubernetes.io/projected/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-kube-api-access-ck9dp\") pod \"test-model-9216b7-kserve-5cf78f87b7-v89nx\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") " pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.469517 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.469431    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:07.597267 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.597194    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"]
Jul 28 22:45:07.599666 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:45:07.599636    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b2e94dc_b26d_4aed_9c12_2f44c67af0db.slice/crio-e7bd394934b1091474ffba4e01ec54783be358ea3d456947c1cfcfb8ffd7eaa7 WatchSource:0}: Error finding container e7bd394934b1091474ffba4e01ec54783be358ea3d456947c1cfcfb8ffd7eaa7: Status 404 returned error can't find the container with id e7bd394934b1091474ffba4e01ec54783be358ea3d456947c1cfcfb8ffd7eaa7
Jul 28 22:45:07.909318 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.909284    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx" event={"ID":"7b2e94dc-b26d-4aed-9c12-2f44c67af0db","Type":"ContainerStarted","Data":"7251795ef5e6bcc75d917e5d35fef0b6856261f76224f86cce6b2646bbcf9eee"}
Jul 28 22:45:07.909497 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.909330    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx" event={"ID":"7b2e94dc-b26d-4aed-9c12-2f44c67af0db","Type":"ContainerStarted","Data":"e7bd394934b1091474ffba4e01ec54783be358ea3d456947c1cfcfb8ffd7eaa7"}
Jul 28 22:45:07.926999 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:07.926951    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx" podStartSLOduration=0.926935907 podStartE2EDuration="926.935907ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:45:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:45:07.925608678 +0000 UTC m=+2408.921197259" watchObservedRunningTime="2026-07-28 22:45:07.926935907 +0000 UTC m=+2408.922524523"
Jul 28 22:45:10.199357 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:10.199318    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:45:17.469935 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:17.469902    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:17.470409 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:17.469950    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:17.482619 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:17.482589    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:17.963789 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:17.963764    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:45:20.290688 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:20.290654    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:45:39.871035 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:39.870951    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"]
Jul 28 22:45:39.874312 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:39.874291    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:39.876126 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:39.876101    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-dd9c88\"/\"kube-root-ca.crt\""
Jul 28 22:45:39.876285 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:39.876220    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-dd9c88\"/\"test-model-dd9c88-kserve-self-signed-certs\""
Jul 28 22:45:39.876650 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:39.876632    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-dd9c88\"/\"openshift-service-ca.crt\""
Jul 28 22:45:39.876726 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:39.876654    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-dd9c88\"/\"default-dockercfg-mtphg\""
Jul 28 22:45:39.884369 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:39.884349    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"]
Jul 28 22:45:39.960154 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:39.960125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wxsn\" (UniqueName: \"kubernetes.io/projected/5a85605c-7a96-4e52-932d-ce23c2b708ec-kube-api-access-4wxsn\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:39.960318 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:39.960158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-home\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:39.960318 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:39.960177    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a85605c-7a96-4e52-932d-ce23c2b708ec-tls-certs\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:39.960318 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:39.960193    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-dshm\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:39.960318 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:39.960212    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-tmp-dir\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:39.960507 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:39.960392    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-model-cache\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:40.061203 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:40.061154    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-model-cache\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:40.061401 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:40.061245    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wxsn\" (UniqueName: \"kubernetes.io/projected/5a85605c-7a96-4e52-932d-ce23c2b708ec-kube-api-access-4wxsn\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:40.061401 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:40.061271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-home\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:40.061401 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:40.061287    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a85605c-7a96-4e52-932d-ce23c2b708ec-tls-certs\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:40.061401 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:40.061307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-dshm\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:40.061401 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:40.061334    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-tmp-dir\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:40.061691 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:40.061528    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-model-cache\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:40.061691 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:40.061606    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-home\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:40.061792 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:40.061747    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-tmp-dir\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:40.063622 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:40.063600    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-dshm\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:40.063778 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:40.063760    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a85605c-7a96-4e52-932d-ce23c2b708ec-tls-certs\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:40.068536 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:40.068506    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wxsn\" (UniqueName: \"kubernetes.io/projected/5a85605c-7a96-4e52-932d-ce23c2b708ec-kube-api-access-4wxsn\") pod \"test-model-dd9c88-kserve-57ccbd46f-nr9kn\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") " pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:40.185043 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:40.184965    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:40.312876 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:40.312844    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"]
Jul 28 22:45:40.314414 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:45:40.314389    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a85605c_7a96_4e52_932d_ce23c2b708ec.slice/crio-c802d44bd5a7b7630493d00333f9c57797c16a88ce1ce89e077b40dc393349dc WatchSource:0}: Error finding container c802d44bd5a7b7630493d00333f9c57797c16a88ce1ce89e077b40dc393349dc: Status 404 returned error can't find the container with id c802d44bd5a7b7630493d00333f9c57797c16a88ce1ce89e077b40dc393349dc
Jul 28 22:45:41.065099 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:41.065067    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn" event={"ID":"5a85605c-7a96-4e52-932d-ce23c2b708ec","Type":"ContainerStarted","Data":"5f9e8d19ddf5819f85e2dcb1d50e346b7b8cef5e5a5d9460cf43e5deabe5ddcb"}
Jul 28 22:45:41.065561 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:41.065108    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn" event={"ID":"5a85605c-7a96-4e52-932d-ce23c2b708ec","Type":"ContainerStarted","Data":"c802d44bd5a7b7630493d00333f9c57797c16a88ce1ce89e077b40dc393349dc"}
Jul 28 22:45:41.080814 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:41.080771    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn" podStartSLOduration=2.080755974 podStartE2EDuration="2.080755974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:45:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:45:41.080474041 +0000 UTC m=+2442.076062623" watchObservedRunningTime="2026-07-28 22:45:41.080755974 +0000 UTC m=+2442.076344556"
Jul 28 22:45:44.655640 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:44.655602    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:45:50.185926 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:50.185890    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:50.186392 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:50.185941    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:50.198212 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:50.198190    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:51.122233 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:51.122207    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:45:57.792408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:45:57.792375    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:46:19.680295 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:19.680260    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"]
Jul 28 22:46:20.577022 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:20.576993    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"]
Jul 28 22:46:24.793165 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:24.793130    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:46:34.699966 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:34.699926    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx" podUID="7b2e94dc-b26d-4aed-9c12-2f44c67af0db" containerName="main" containerID="cri-o://7251795ef5e6bcc75d917e5d35fef0b6856261f76224f86cce6b2646bbcf9eee" gracePeriod=45
Jul 28 22:46:34.953214 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:34.953156    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:46:35.065106 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.065071    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-tmp-dir\") pod \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") "
Jul 28 22:46:35.065309 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.065127    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck9dp\" (UniqueName: \"kubernetes.io/projected/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-kube-api-access-ck9dp\") pod \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") "
Jul 28 22:46:35.065309 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.065176    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-dshm\") pod \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") "
Jul 28 22:46:35.065309 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.065203    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-tls-certs\") pod \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") "
Jul 28 22:46:35.065309 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.065218    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-home\") pod \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") "
Jul 28 22:46:35.065309 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.065265    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-model-cache\") pod \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\" (UID: \"7b2e94dc-b26d-4aed-9c12-2f44c67af0db\") "
Jul 28 22:46:35.065564 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.065399    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7b2e94dc-b26d-4aed-9c12-2f44c67af0db" (UID: "7b2e94dc-b26d-4aed-9c12-2f44c67af0db"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:46:35.065564 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.065498    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-home" (OuterVolumeSpecName: "home") pod "7b2e94dc-b26d-4aed-9c12-2f44c67af0db" (UID: "7b2e94dc-b26d-4aed-9c12-2f44c67af0db"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:46:35.065661 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.065561    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-model-cache" (OuterVolumeSpecName: "model-cache") pod "7b2e94dc-b26d-4aed-9c12-2f44c67af0db" (UID: "7b2e94dc-b26d-4aed-9c12-2f44c67af0db"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:46:35.065661 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.065576    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-tmp-dir\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:35.067478 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.067451    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-dshm" (OuterVolumeSpecName: "dshm") pod "7b2e94dc-b26d-4aed-9c12-2f44c67af0db" (UID: "7b2e94dc-b26d-4aed-9c12-2f44c67af0db"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:46:35.067596 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.067480    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7b2e94dc-b26d-4aed-9c12-2f44c67af0db" (UID: "7b2e94dc-b26d-4aed-9c12-2f44c67af0db"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:46:35.067596 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.067517    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-kube-api-access-ck9dp" (OuterVolumeSpecName: "kube-api-access-ck9dp") pod "7b2e94dc-b26d-4aed-9c12-2f44c67af0db" (UID: "7b2e94dc-b26d-4aed-9c12-2f44c67af0db"). InnerVolumeSpecName "kube-api-access-ck9dp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:46:35.166099 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.166068    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck9dp\" (UniqueName: \"kubernetes.io/projected/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-kube-api-access-ck9dp\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:35.166099 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.166093    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-dshm\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:35.166099 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.166104    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-tls-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:35.166319 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.166113    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-home\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:35.166319 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.166121    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b2e94dc-b26d-4aed-9c12-2f44c67af0db-model-cache\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:35.315556 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.315469    2564 generic.go:356] "Generic (PLEG): container finished" podID="7b2e94dc-b26d-4aed-9c12-2f44c67af0db" containerID="7251795ef5e6bcc75d917e5d35fef0b6856261f76224f86cce6b2646bbcf9eee" exitCode=0
Jul 28 22:46:35.315556 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.315506    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"
Jul 28 22:46:35.315556 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.315537    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx" event={"ID":"7b2e94dc-b26d-4aed-9c12-2f44c67af0db","Type":"ContainerDied","Data":"7251795ef5e6bcc75d917e5d35fef0b6856261f76224f86cce6b2646bbcf9eee"}
Jul 28 22:46:35.315776 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.315576    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx" event={"ID":"7b2e94dc-b26d-4aed-9c12-2f44c67af0db","Type":"ContainerDied","Data":"e7bd394934b1091474ffba4e01ec54783be358ea3d456947c1cfcfb8ffd7eaa7"}
Jul 28 22:46:35.315776 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.315597    2564 scope.go:117] "RemoveContainer" containerID="7251795ef5e6bcc75d917e5d35fef0b6856261f76224f86cce6b2646bbcf9eee"
Jul 28 22:46:35.324855 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.324839    2564 scope.go:117] "RemoveContainer" containerID="7251795ef5e6bcc75d917e5d35fef0b6856261f76224f86cce6b2646bbcf9eee"
Jul 28 22:46:35.325160 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:46:35.325138    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7251795ef5e6bcc75d917e5d35fef0b6856261f76224f86cce6b2646bbcf9eee\": container with ID starting with 7251795ef5e6bcc75d917e5d35fef0b6856261f76224f86cce6b2646bbcf9eee not found: ID does not exist" containerID="7251795ef5e6bcc75d917e5d35fef0b6856261f76224f86cce6b2646bbcf9eee"
Jul 28 22:46:35.325240 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.325167    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7251795ef5e6bcc75d917e5d35fef0b6856261f76224f86cce6b2646bbcf9eee"} err="failed to get container status \"7251795ef5e6bcc75d917e5d35fef0b6856261f76224f86cce6b2646bbcf9eee\": rpc error: code = NotFound desc = could not find container \"7251795ef5e6bcc75d917e5d35fef0b6856261f76224f86cce6b2646bbcf9eee\": container with ID starting with 7251795ef5e6bcc75d917e5d35fef0b6856261f76224f86cce6b2646bbcf9eee not found: ID does not exist"
Jul 28 22:46:35.335822 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.335800    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"]
Jul 28 22:46:35.339372 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.339354    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-9216b7/test-model-9216b7-kserve-5cf78f87b7-v89nx"]
Jul 28 22:46:35.508193 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.508160    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b2e94dc-b26d-4aed-9c12-2f44c67af0db" path="/var/lib/kubelet/pods/7b2e94dc-b26d-4aed-9c12-2f44c67af0db/volumes"
Jul 28 22:46:35.596320 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.596215    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn" podUID="5a85605c-7a96-4e52-932d-ce23c2b708ec" containerName="main" containerID="cri-o://5f9e8d19ddf5819f85e2dcb1d50e346b7b8cef5e5a5d9460cf43e5deabe5ddcb" gracePeriod=45
Jul 28 22:46:35.842118 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.842095    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:46:35.972323 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.972291    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a85605c-7a96-4e52-932d-ce23c2b708ec-tls-certs\") pod \"5a85605c-7a96-4e52-932d-ce23c2b708ec\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") "
Jul 28 22:46:35.972323 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.972327    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-model-cache\") pod \"5a85605c-7a96-4e52-932d-ce23c2b708ec\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") "
Jul 28 22:46:35.972573 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.972382    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-home\") pod \"5a85605c-7a96-4e52-932d-ce23c2b708ec\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") "
Jul 28 22:46:35.972573 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.972411    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-tmp-dir\") pod \"5a85605c-7a96-4e52-932d-ce23c2b708ec\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") "
Jul 28 22:46:35.972573 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.972457    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-dshm\") pod \"5a85605c-7a96-4e52-932d-ce23c2b708ec\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") "
Jul 28 22:46:35.972573 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.972493    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wxsn\" (UniqueName: \"kubernetes.io/projected/5a85605c-7a96-4e52-932d-ce23c2b708ec-kube-api-access-4wxsn\") pod \"5a85605c-7a96-4e52-932d-ce23c2b708ec\" (UID: \"5a85605c-7a96-4e52-932d-ce23c2b708ec\") "
Jul 28 22:46:35.972787 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.972674    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-home" (OuterVolumeSpecName: "home") pod "5a85605c-7a96-4e52-932d-ce23c2b708ec" (UID: "5a85605c-7a96-4e52-932d-ce23c2b708ec"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:46:35.972787 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.972706    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5a85605c-7a96-4e52-932d-ce23c2b708ec" (UID: "5a85605c-7a96-4e52-932d-ce23c2b708ec"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:46:35.972787 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.972677    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-model-cache" (OuterVolumeSpecName: "model-cache") pod "5a85605c-7a96-4e52-932d-ce23c2b708ec" (UID: "5a85605c-7a96-4e52-932d-ce23c2b708ec"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:46:35.972972 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.972808    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-model-cache\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:35.972972 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.972821    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-home\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:35.972972 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.972852    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-tmp-dir\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:35.980868 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.974773    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-dshm" (OuterVolumeSpecName: "dshm") pod "5a85605c-7a96-4e52-932d-ce23c2b708ec" (UID: "5a85605c-7a96-4e52-932d-ce23c2b708ec"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:46:35.980868 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.975023    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a85605c-7a96-4e52-932d-ce23c2b708ec-kube-api-access-4wxsn" (OuterVolumeSpecName: "kube-api-access-4wxsn") pod "5a85605c-7a96-4e52-932d-ce23c2b708ec" (UID: "5a85605c-7a96-4e52-932d-ce23c2b708ec"). InnerVolumeSpecName "kube-api-access-4wxsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:46:35.980868 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:35.974603    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a85605c-7a96-4e52-932d-ce23c2b708ec-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5a85605c-7a96-4e52-932d-ce23c2b708ec" (UID: "5a85605c-7a96-4e52-932d-ce23c2b708ec"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:46:36.074039 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:36.073995    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a85605c-7a96-4e52-932d-ce23c2b708ec-dshm\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:36.074039 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:36.074033    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wxsn\" (UniqueName: \"kubernetes.io/projected/5a85605c-7a96-4e52-932d-ce23c2b708ec-kube-api-access-4wxsn\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:36.074039 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:36.074047    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a85605c-7a96-4e52-932d-ce23c2b708ec-tls-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:36.321974 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:36.321881    2564 generic.go:356] "Generic (PLEG): container finished" podID="5a85605c-7a96-4e52-932d-ce23c2b708ec" containerID="5f9e8d19ddf5819f85e2dcb1d50e346b7b8cef5e5a5d9460cf43e5deabe5ddcb" exitCode=0
Jul 28 22:46:36.321974 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:36.321920    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn" event={"ID":"5a85605c-7a96-4e52-932d-ce23c2b708ec","Type":"ContainerDied","Data":"5f9e8d19ddf5819f85e2dcb1d50e346b7b8cef5e5a5d9460cf43e5deabe5ddcb"}
Jul 28 22:46:36.321974 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:36.321940    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"
Jul 28 22:46:36.321974 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:36.321954    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn" event={"ID":"5a85605c-7a96-4e52-932d-ce23c2b708ec","Type":"ContainerDied","Data":"c802d44bd5a7b7630493d00333f9c57797c16a88ce1ce89e077b40dc393349dc"}
Jul 28 22:46:36.321974 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:36.321975    2564 scope.go:117] "RemoveContainer" containerID="5f9e8d19ddf5819f85e2dcb1d50e346b7b8cef5e5a5d9460cf43e5deabe5ddcb"
Jul 28 22:46:36.333371 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:36.333353    2564 scope.go:117] "RemoveContainer" containerID="5f9e8d19ddf5819f85e2dcb1d50e346b7b8cef5e5a5d9460cf43e5deabe5ddcb"
Jul 28 22:46:36.333666 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:46:36.333645    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f9e8d19ddf5819f85e2dcb1d50e346b7b8cef5e5a5d9460cf43e5deabe5ddcb\": container with ID starting with 5f9e8d19ddf5819f85e2dcb1d50e346b7b8cef5e5a5d9460cf43e5deabe5ddcb not found: ID does not exist" containerID="5f9e8d19ddf5819f85e2dcb1d50e346b7b8cef5e5a5d9460cf43e5deabe5ddcb"
Jul 28 22:46:36.333717 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:36.333674    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f9e8d19ddf5819f85e2dcb1d50e346b7b8cef5e5a5d9460cf43e5deabe5ddcb"} err="failed to get container status \"5f9e8d19ddf5819f85e2dcb1d50e346b7b8cef5e5a5d9460cf43e5deabe5ddcb\": rpc error: code = NotFound desc = could not find container \"5f9e8d19ddf5819f85e2dcb1d50e346b7b8cef5e5a5d9460cf43e5deabe5ddcb\": container with ID starting with 5f9e8d19ddf5819f85e2dcb1d50e346b7b8cef5e5a5d9460cf43e5deabe5ddcb not found: ID does not exist"
Jul 28 22:46:36.342065 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:36.342041    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"]
Jul 28 22:46:36.345312 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:36.345291    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-dd9c88/test-model-dd9c88-kserve-57ccbd46f-nr9kn"]
Jul 28 22:46:37.507819 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:37.507788    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a85605c-7a96-4e52-932d-ce23c2b708ec" path="/var/lib/kubelet/pods/5a85605c-7a96-4e52-932d-ce23c2b708ec/volumes"
Jul 28 22:46:37.717914 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:37.717881    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"]
Jul 28 22:46:37.718133 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:37.718108    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs" podUID="ab1e225c-5491-40be-9adf-a15debc1d8ac" containerName="istio-proxy" containerID="cri-o://3da3d09a0cf316f0b0351be0c342548e0ccb01c764f6bdbae045079dce18d469" gracePeriod=30
Jul 28 22:46:40.705306 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:40.705276    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:46:42.971941 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:42.971917    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:46:43.138389 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.138365    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfzrp\" (UniqueName: \"kubernetes.io/projected/ab1e225c-5491-40be-9adf-a15debc1d8ac-kube-api-access-zfzrp\") pod \"ab1e225c-5491-40be-9adf-a15debc1d8ac\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") "
Jul 28 22:46:43.138543 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.138395    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-token\") pod \"ab1e225c-5491-40be-9adf-a15debc1d8ac\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") "
Jul 28 22:46:43.138543 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.138418    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab1e225c-5491-40be-9adf-a15debc1d8ac-istiod-ca-cert\") pod \"ab1e225c-5491-40be-9adf-a15debc1d8ac\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") "
Jul 28 22:46:43.138543 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.138456    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-credential-socket\") pod \"ab1e225c-5491-40be-9adf-a15debc1d8ac\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") "
Jul 28 22:46:43.138543 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.138534    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-data\") pod \"ab1e225c-5491-40be-9adf-a15debc1d8ac\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") "
Jul 28 22:46:43.138749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.138561    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-workload-socket\") pod \"ab1e225c-5491-40be-9adf-a15debc1d8ac\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") "
Jul 28 22:46:43.138749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.138600    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-workload-certs\") pod \"ab1e225c-5491-40be-9adf-a15debc1d8ac\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") "
Jul 28 22:46:43.138749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.138644    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-envoy\") pod \"ab1e225c-5491-40be-9adf-a15debc1d8ac\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") "
Jul 28 22:46:43.138749 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.138689    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-podinfo\") pod \"ab1e225c-5491-40be-9adf-a15debc1d8ac\" (UID: \"ab1e225c-5491-40be-9adf-a15debc1d8ac\") "
Jul 28 22:46:43.138990 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.138786    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ab1e225c-5491-40be-9adf-a15debc1d8ac" (UID: "ab1e225c-5491-40be-9adf-a15debc1d8ac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:46:43.138990 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.138932    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ab1e225c-5491-40be-9adf-a15debc1d8ac" (UID: "ab1e225c-5491-40be-9adf-a15debc1d8ac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:46:43.138990 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.138960    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ab1e225c-5491-40be-9adf-a15debc1d8ac" (UID: "ab1e225c-5491-40be-9adf-a15debc1d8ac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:46:43.138990 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.138957    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab1e225c-5491-40be-9adf-a15debc1d8ac-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ab1e225c-5491-40be-9adf-a15debc1d8ac" (UID: "ab1e225c-5491-40be-9adf-a15debc1d8ac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:46:43.139167 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.139084    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-workload-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:43.139167 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.139104    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-workload-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:43.139167 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.139115    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab1e225c-5491-40be-9adf-a15debc1d8ac-istiod-ca-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:43.139167 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.139128    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-credential-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:43.139597 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.139578    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-data" (OuterVolumeSpecName: "istio-data") pod "ab1e225c-5491-40be-9adf-a15debc1d8ac" (UID: "ab1e225c-5491-40be-9adf-a15debc1d8ac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:46:43.140586 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.140565    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab1e225c-5491-40be-9adf-a15debc1d8ac-kube-api-access-zfzrp" (OuterVolumeSpecName: "kube-api-access-zfzrp") pod "ab1e225c-5491-40be-9adf-a15debc1d8ac" (UID: "ab1e225c-5491-40be-9adf-a15debc1d8ac"). InnerVolumeSpecName "kube-api-access-zfzrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:46:43.140733 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.140719    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ab1e225c-5491-40be-9adf-a15debc1d8ac" (UID: "ab1e225c-5491-40be-9adf-a15debc1d8ac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:46:43.140989 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.140967    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-token" (OuterVolumeSpecName: "istio-token") pod "ab1e225c-5491-40be-9adf-a15debc1d8ac" (UID: "ab1e225c-5491-40be-9adf-a15debc1d8ac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:46:43.141077 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.141055    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ab1e225c-5491-40be-9adf-a15debc1d8ac" (UID: "ab1e225c-5491-40be-9adf-a15debc1d8ac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 22:46:43.239463 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.239440    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-data\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:43.239463 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.239459    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-envoy\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:43.239463 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.239467    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-podinfo\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:43.239626 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.239476    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfzrp\" (UniqueName: \"kubernetes.io/projected/ab1e225c-5491-40be-9adf-a15debc1d8ac-kube-api-access-zfzrp\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:43.239626 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.239485    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab1e225c-5491-40be-9adf-a15debc1d8ac-istio-token\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:46:43.356437 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.356403    2564 generic.go:356] "Generic (PLEG): container finished" podID="ab1e225c-5491-40be-9adf-a15debc1d8ac" containerID="3da3d09a0cf316f0b0351be0c342548e0ccb01c764f6bdbae045079dce18d469" exitCode=0
Jul 28 22:46:43.356554 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.356459    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"
Jul 28 22:46:43.356554 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.356489    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs" event={"ID":"ab1e225c-5491-40be-9adf-a15debc1d8ac","Type":"ContainerDied","Data":"3da3d09a0cf316f0b0351be0c342548e0ccb01c764f6bdbae045079dce18d469"}
Jul 28 22:46:43.356554 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.356541    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs" event={"ID":"ab1e225c-5491-40be-9adf-a15debc1d8ac","Type":"ContainerDied","Data":"69b6f642494e9c0ab1b0f0e6a2dea8a2fc0c15c81b13db9d20364024cf29ffa0"}
Jul 28 22:46:43.356667 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.356565    2564 scope.go:117] "RemoveContainer" containerID="3da3d09a0cf316f0b0351be0c342548e0ccb01c764f6bdbae045079dce18d469"
Jul 28 22:46:43.365516 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.365501    2564 scope.go:117] "RemoveContainer" containerID="6d91e9a6c06e218426254386c73ab3f5ff89cccea2ef1f0d07aff5016fbf3d11"
Jul 28 22:46:43.373117 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.373097    2564 scope.go:117] "RemoveContainer" containerID="3da3d09a0cf316f0b0351be0c342548e0ccb01c764f6bdbae045079dce18d469"
Jul 28 22:46:43.373372 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:46:43.373350    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3da3d09a0cf316f0b0351be0c342548e0ccb01c764f6bdbae045079dce18d469\": container with ID starting with 3da3d09a0cf316f0b0351be0c342548e0ccb01c764f6bdbae045079dce18d469 not found: ID does not exist" containerID="3da3d09a0cf316f0b0351be0c342548e0ccb01c764f6bdbae045079dce18d469"
Jul 28 22:46:43.373444 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.373380    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da3d09a0cf316f0b0351be0c342548e0ccb01c764f6bdbae045079dce18d469"} err="failed to get container status \"3da3d09a0cf316f0b0351be0c342548e0ccb01c764f6bdbae045079dce18d469\": rpc error: code = NotFound desc = could not find container \"3da3d09a0cf316f0b0351be0c342548e0ccb01c764f6bdbae045079dce18d469\": container with ID starting with 3da3d09a0cf316f0b0351be0c342548e0ccb01c764f6bdbae045079dce18d469 not found: ID does not exist"
Jul 28 22:46:43.373444 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.373398    2564 scope.go:117] "RemoveContainer" containerID="6d91e9a6c06e218426254386c73ab3f5ff89cccea2ef1f0d07aff5016fbf3d11"
Jul 28 22:46:43.373625 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:46:43.373606    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d91e9a6c06e218426254386c73ab3f5ff89cccea2ef1f0d07aff5016fbf3d11\": container with ID starting with 6d91e9a6c06e218426254386c73ab3f5ff89cccea2ef1f0d07aff5016fbf3d11 not found: ID does not exist" containerID="6d91e9a6c06e218426254386c73ab3f5ff89cccea2ef1f0d07aff5016fbf3d11"
Jul 28 22:46:43.373688 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.373632    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d91e9a6c06e218426254386c73ab3f5ff89cccea2ef1f0d07aff5016fbf3d11"} err="failed to get container status \"6d91e9a6c06e218426254386c73ab3f5ff89cccea2ef1f0d07aff5016fbf3d11\": rpc error: code = NotFound desc = could not find container \"6d91e9a6c06e218426254386c73ab3f5ff89cccea2ef1f0d07aff5016fbf3d11\": container with ID starting with 6d91e9a6c06e218426254386c73ab3f5ff89cccea2ef1f0d07aff5016fbf3d11 not found: ID does not exist"
Jul 28 22:46:43.377386 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.377361    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"]
Jul 28 22:46:43.382226 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.382208    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-9216b7-openshift-default-f67d8f44d-qkxzs"]
Jul 28 22:46:43.509154 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:43.509090    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab1e225c-5491-40be-9adf-a15debc1d8ac" path="/var/lib/kubelet/pods/ab1e225c-5491-40be-9adf-a15debc1d8ac/volumes"
Jul 28 22:46:51.603103 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:51.603017    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:46:55.484664 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:55.484630    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"]
Jul 28 22:46:55.485092 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:55.484919    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq" podUID="05d0f3d1-3703-4550-8bc6-37427c57aa9d" containerName="istio-proxy" containerID="cri-o://463418f05f5177c7235e7f20bb20b1716639129e15251985664faccbecd1421a" gracePeriod=30
Jul 28 22:46:56.458882 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.458847    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"]
Jul 28 22:46:56.459207 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.459192    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab1e225c-5491-40be-9adf-a15debc1d8ac" containerName="istio-proxy"
Jul 28 22:46:56.459278 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.459208    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab1e225c-5491-40be-9adf-a15debc1d8ac" containerName="istio-proxy"
Jul 28 22:46:56.459278 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.459221    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab1e225c-5491-40be-9adf-a15debc1d8ac" containerName="istio-proxy"
Jul 28 22:46:56.459278 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.459227    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab1e225c-5491-40be-9adf-a15debc1d8ac" containerName="istio-proxy"
Jul 28 22:46:56.459278 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.459245    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b2e94dc-b26d-4aed-9c12-2f44c67af0db" containerName="main"
Jul 28 22:46:56.459278 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.459251    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b2e94dc-b26d-4aed-9c12-2f44c67af0db" containerName="main"
Jul 28 22:46:56.459278 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.459257    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a85605c-7a96-4e52-932d-ce23c2b708ec" containerName="main"
Jul 28 22:46:56.459278 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.459262    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a85605c-7a96-4e52-932d-ce23c2b708ec" containerName="main"
Jul 28 22:46:56.459647 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.459314    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a85605c-7a96-4e52-932d-ce23c2b708ec" containerName="main"
Jul 28 22:46:56.459647 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.459324    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab1e225c-5491-40be-9adf-a15debc1d8ac" containerName="istio-proxy"
Jul 28 22:46:56.459647 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.459330    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b2e94dc-b26d-4aed-9c12-2f44c67af0db" containerName="main"
Jul 28 22:46:56.459647 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.459336    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab1e225c-5491-40be-9adf-a15debc1d8ac" containerName="istio-proxy"
Jul 28 22:46:56.463511 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.463488    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.465500 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.465480    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-26e94d-openshift-default-dockercfg-krvjb\""
Jul 28 22:46:56.475924 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.475899    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"]
Jul 28 22:46:56.546896 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.546856    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc59g\" (UniqueName: \"kubernetes.io/projected/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-kube-api-access-jc59g\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.547231 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.546917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-credential-socket\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.547231 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.546955    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-workload-socket\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.547231 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.546974    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istiod-ca-cert\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.547231 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.547004    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-workload-certs\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.547231 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.547032    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-token\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.547231 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.547050    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-podinfo\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.547231 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.547163    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-envoy\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.547231 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.547213    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-data\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.648167 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.648133    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-data\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.648369 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.648188    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc59g\" (UniqueName: \"kubernetes.io/projected/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-kube-api-access-jc59g\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.648369 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.648248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-credential-socket\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.648369 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.648279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-workload-socket\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.648369 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.648307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istiod-ca-cert\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.648369 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.648336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-workload-certs\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.648369 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.648368    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-token\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.648678 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.648399    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-podinfo\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.648678 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.648459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-envoy\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.648678 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.648580    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-data\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.648678 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.648591    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-credential-socket\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.648921 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.648897    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-workload-certs\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.649000 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.648968    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-workload-socket\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.649517 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.649493    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istiod-ca-cert\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.651026 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.651008    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-envoy\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.651424 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.651402    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-podinfo\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.655514 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.655491    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-token\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.656871 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.656817    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc59g\" (UniqueName: \"kubernetes.io/projected/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-kube-api-access-jc59g\") pod \"e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") " pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.773445 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.773383    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:56.905425 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.905398    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"]
Jul 28 22:46:56.907667 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:46:56.907643    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9cc4fc2_0b60_4f7c_80f3_52e53bcbede3.slice/crio-95c69d23d189ae705473feda84b065cd6688d56c4e4d6522712d3b78cd013af6 WatchSource:0}: Error finding container 95c69d23d189ae705473feda84b065cd6688d56c4e4d6522712d3b78cd013af6: Status 404 returned error can't find the container with id 95c69d23d189ae705473feda84b065cd6688d56c4e4d6522712d3b78cd013af6
Jul 28 22:46:56.910085 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.910051    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:46:56.910158 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.910132    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:46:56.910196 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:56.910174    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:46:57.419930 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:57.419891    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb" event={"ID":"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3","Type":"ContainerStarted","Data":"bb8ac7b98d35b36024cad51d1455e29bb154649650ce5daee743b70887946673"}
Jul 28 22:46:57.420093 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:57.419954    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb" event={"ID":"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3","Type":"ContainerStarted","Data":"95c69d23d189ae705473feda84b065cd6688d56c4e4d6522712d3b78cd013af6"}
Jul 28 22:46:57.438111 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:57.438064    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb" podStartSLOduration=1.4380482159999999 podStartE2EDuration="1.438048216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:46:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:46:57.437060825 +0000 UTC m=+2518.432649435" watchObservedRunningTime="2026-07-28 22:46:57.438048216 +0000 UTC m=+2518.433636798"
Jul 28 22:46:57.774462 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:57.774386    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:57.779583 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:57.779558    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:58.424891 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:58.424861    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:46:58.425890 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:46:58.425869    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:47:00.737128 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.737101    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:47:00.783621 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.783558    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-podinfo\") pod \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") "
Jul 28 22:47:00.783621 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.783609    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q946\" (UniqueName: \"kubernetes.io/projected/05d0f3d1-3703-4550-8bc6-37427c57aa9d-kube-api-access-7q946\") pod \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") "
Jul 28 22:47:00.783782 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.783640    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-credential-socket\") pod \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") "
Jul 28 22:47:00.783782 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.783673    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-token\") pod \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") "
Jul 28 22:47:00.783782 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.783693    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istiod-ca-cert\") pod \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") "
Jul 28 22:47:00.783782 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.783713    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-workload-socket\") pod \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") "
Jul 28 22:47:00.784021 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.783811    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-data\") pod \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") "
Jul 28 22:47:00.784021 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.783871    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-workload-certs\") pod \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") "
Jul 28 22:47:00.784021 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.783947    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-envoy\") pod \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\" (UID: \"05d0f3d1-3703-4550-8bc6-37427c57aa9d\") "
Jul 28 22:47:00.784021 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.783992    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05d0f3d1-3703-4550-8bc6-37427c57aa9d" (UID: "05d0f3d1-3703-4550-8bc6-37427c57aa9d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:47:00.784237 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.784189    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05d0f3d1-3703-4550-8bc6-37427c57aa9d" (UID: "05d0f3d1-3703-4550-8bc6-37427c57aa9d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:47:00.784237 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.784190    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05d0f3d1-3703-4550-8bc6-37427c57aa9d" (UID: "05d0f3d1-3703-4550-8bc6-37427c57aa9d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:47:00.784338 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.784286    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istiod-ca-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:47:00.784338 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.784304    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-workload-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:47:00.784338 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.784318    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-workload-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:47:00.784472 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.784454    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05d0f3d1-3703-4550-8bc6-37427c57aa9d" (UID: "05d0f3d1-3703-4550-8bc6-37427c57aa9d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:47:00.784949 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.784920    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-data" (OuterVolumeSpecName: "istio-data") pod "05d0f3d1-3703-4550-8bc6-37427c57aa9d" (UID: "05d0f3d1-3703-4550-8bc6-37427c57aa9d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:47:00.785904 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.785874    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-token" (OuterVolumeSpecName: "istio-token") pod "05d0f3d1-3703-4550-8bc6-37427c57aa9d" (UID: "05d0f3d1-3703-4550-8bc6-37427c57aa9d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:47:00.786143 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.786120    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05d0f3d1-3703-4550-8bc6-37427c57aa9d" (UID: "05d0f3d1-3703-4550-8bc6-37427c57aa9d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:47:00.786238 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.786222    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05d0f3d1-3703-4550-8bc6-37427c57aa9d" (UID: "05d0f3d1-3703-4550-8bc6-37427c57aa9d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 22:47:00.786285 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.786230    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05d0f3d1-3703-4550-8bc6-37427c57aa9d-kube-api-access-7q946" (OuterVolumeSpecName: "kube-api-access-7q946") pod "05d0f3d1-3703-4550-8bc6-37427c57aa9d" (UID: "05d0f3d1-3703-4550-8bc6-37427c57aa9d"). InnerVolumeSpecName "kube-api-access-7q946". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:47:00.885583 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.885550    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-data\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:47:00.885583 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.885577    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-envoy\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:47:00.885583 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.885588    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-podinfo\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:47:00.885785 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.885600    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q946\" (UniqueName: \"kubernetes.io/projected/05d0f3d1-3703-4550-8bc6-37427c57aa9d-kube-api-access-7q946\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:47:00.885785 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.885613    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05d0f3d1-3703-4550-8bc6-37427c57aa9d-credential-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:47:00.885785 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:00.885624    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05d0f3d1-3703-4550-8bc6-37427c57aa9d-istio-token\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:47:01.439528 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:01.439495    2564 generic.go:356] "Generic (PLEG): container finished" podID="05d0f3d1-3703-4550-8bc6-37427c57aa9d" containerID="463418f05f5177c7235e7f20bb20b1716639129e15251985664faccbecd1421a" exitCode=0
Jul 28 22:47:01.439706 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:01.439535    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq" event={"ID":"05d0f3d1-3703-4550-8bc6-37427c57aa9d","Type":"ContainerDied","Data":"463418f05f5177c7235e7f20bb20b1716639129e15251985664faccbecd1421a"}
Jul 28 22:47:01.439706 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:01.439543    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"
Jul 28 22:47:01.439706 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:01.439577    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq" event={"ID":"05d0f3d1-3703-4550-8bc6-37427c57aa9d","Type":"ContainerDied","Data":"28963ea2c0eb6e1f4e556246befffa75607004ba541789e9e16b4782b73f9696"}
Jul 28 22:47:01.439706 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:01.439599    2564 scope.go:117] "RemoveContainer" containerID="463418f05f5177c7235e7f20bb20b1716639129e15251985664faccbecd1421a"
Jul 28 22:47:01.448341 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:01.448323    2564 scope.go:117] "RemoveContainer" containerID="b46b96567323aa4fd694a5e21a0283c4c67ecf83bc55ec564d961f921681961c"
Jul 28 22:47:01.458040 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:01.458024    2564 scope.go:117] "RemoveContainer" containerID="463418f05f5177c7235e7f20bb20b1716639129e15251985664faccbecd1421a"
Jul 28 22:47:01.458284 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:47:01.458261    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"463418f05f5177c7235e7f20bb20b1716639129e15251985664faccbecd1421a\": container with ID starting with 463418f05f5177c7235e7f20bb20b1716639129e15251985664faccbecd1421a not found: ID does not exist" containerID="463418f05f5177c7235e7f20bb20b1716639129e15251985664faccbecd1421a"
Jul 28 22:47:01.458392 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:01.458291    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"463418f05f5177c7235e7f20bb20b1716639129e15251985664faccbecd1421a"} err="failed to get container status \"463418f05f5177c7235e7f20bb20b1716639129e15251985664faccbecd1421a\": rpc error: code = NotFound desc = could not find container \"463418f05f5177c7235e7f20bb20b1716639129e15251985664faccbecd1421a\": container with ID starting with 463418f05f5177c7235e7f20bb20b1716639129e15251985664faccbecd1421a not found: ID does not exist"
Jul 28 22:47:01.458392 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:01.458309    2564 scope.go:117] "RemoveContainer" containerID="b46b96567323aa4fd694a5e21a0283c4c67ecf83bc55ec564d961f921681961c"
Jul 28 22:47:01.458587 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:47:01.458570    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b46b96567323aa4fd694a5e21a0283c4c67ecf83bc55ec564d961f921681961c\": container with ID starting with b46b96567323aa4fd694a5e21a0283c4c67ecf83bc55ec564d961f921681961c not found: ID does not exist" containerID="b46b96567323aa4fd694a5e21a0283c4c67ecf83bc55ec564d961f921681961c"
Jul 28 22:47:01.458628 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:01.458595    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b46b96567323aa4fd694a5e21a0283c4c67ecf83bc55ec564d961f921681961c"} err="failed to get container status \"b46b96567323aa4fd694a5e21a0283c4c67ecf83bc55ec564d961f921681961c\": rpc error: code = NotFound desc = could not find container \"b46b96567323aa4fd694a5e21a0283c4c67ecf83bc55ec564d961f921681961c\": container with ID starting with b46b96567323aa4fd694a5e21a0283c4c67ecf83bc55ec564d961f921681961c not found: ID does not exist"
Jul 28 22:47:01.475259 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:01.475239    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"]
Jul 28 22:47:01.492638 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:01.492607    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-dd9c88-openshift-default-6587d8d8dd-8szlq"]
Jul 28 22:47:01.508929 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:01.508903    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05d0f3d1-3703-4550-8bc6-37427c57aa9d" path="/var/lib/kubelet/pods/05d0f3d1-3703-4550-8bc6-37427c57aa9d/volumes"
Jul 28 22:47:06.485712 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:06.485675    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:47:14.199822 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:14.199104    2564 patch_prober.go:28] interesting pod/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": read tcp 10.133.0.2:34082->10.133.0.44:15021: read: connection reset by peer" start-of-body=
Jul 28 22:47:14.199822 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:14.199191    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb" podUID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": read tcp 10.133.0.2:34082->10.133.0.44:15021: read: connection reset by peer"
Jul 28 22:47:14.501189 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:14.501101    2564 generic.go:356] "Generic (PLEG): container finished" podID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" containerID="bb8ac7b98d35b36024cad51d1455e29bb154649650ce5daee743b70887946673" exitCode=0
Jul 28 22:47:14.501189 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:14.501151    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb" event={"ID":"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3","Type":"ContainerDied","Data":"bb8ac7b98d35b36024cad51d1455e29bb154649650ce5daee743b70887946673"}
Jul 28 22:47:14.501546 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:14.501533    2564 scope.go:117] "RemoveContainer" containerID="bb8ac7b98d35b36024cad51d1455e29bb154649650ce5daee743b70887946673"
Jul 28 22:47:14.502478 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:14.502453    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:47:14.502543 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:14.502525    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:47:14.502579 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:14.502557    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:47:15.507583 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:15.507548    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb" event={"ID":"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3","Type":"ContainerStarted","Data":"48c893e7b909445eb90771cbbf09ef0beeb4d7bc1b1171e4079e6f02e60c2550"}
Jul 28 22:47:15.774177 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:15.774086    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:47:15.774355 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:15.774314    2564 patch_prober.go:28] interesting pod/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 28 22:47:15.774435 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:15.774369    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb" podUID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 28 22:47:16.774443 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:16.774408    2564 patch_prober.go:28] interesting pod/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 28 22:47:16.774875 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:16.774462    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb" podUID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 28 22:47:17.773966 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:17.773923    2564 patch_prober.go:28] interesting pod/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 28 22:47:17.774135 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:17.773991    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb" podUID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 28 22:47:18.774407 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:18.774366    2564 patch_prober.go:28] interesting pod/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 28 22:47:18.774911 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:18.774426    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb" podUID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 28 22:47:19.777134 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:19.777098    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:47:19.777556 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:19.777357    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:47:19.777943 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:19.777928    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:47:25.190560 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.190524    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"]
Jul 28 22:47:25.191082 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.191064    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05d0f3d1-3703-4550-8bc6-37427c57aa9d" containerName="istio-proxy"
Jul 28 22:47:25.191132 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.191086    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="05d0f3d1-3703-4550-8bc6-37427c57aa9d" containerName="istio-proxy"
Jul 28 22:47:25.191198 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.191187    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="05d0f3d1-3703-4550-8bc6-37427c57aa9d" containerName="istio-proxy"
Jul 28 22:47:25.194884 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.194853    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.196911 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.196882    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-9bcb6e-openshift-default-dockercfg-96ztn\""
Jul 28 22:47:25.204776 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.204752    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"]
Jul 28 22:47:25.311110 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.311071    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-data\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.311397 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.311379    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istiod-ca-cert\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.311560 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.311537    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-workload-certs\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.311725 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.311573    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxw2x\" (UniqueName: \"kubernetes.io/projected/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-kube-api-access-qxw2x\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.311725 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.311601    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-workload-socket\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.311725 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.311635    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-token\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.311725 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.311707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-podinfo\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.311983 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.311733    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-credential-socket\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.311983 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.311788    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-envoy\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.412823 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.412760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-podinfo\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.412823 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.412842    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-credential-socket\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.413110 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.412896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-envoy\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.413110 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.412961    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-data\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.413110 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.412987    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istiod-ca-cert\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.413110 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.413028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-workload-certs\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.413110 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.413055    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxw2x\" (UniqueName: \"kubernetes.io/projected/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-kube-api-access-qxw2x\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.413110 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.413081    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-workload-socket\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.413419 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.413114    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-token\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.413419 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.413313    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-credential-socket\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.413419 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.413374    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-data\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.413717 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.413693    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-workload-socket\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.413980 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.413954    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-workload-certs\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.414123 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.413963    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istiod-ca-cert\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.415593 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.415566    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-envoy\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.415696 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.415606    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-podinfo\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.421877 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.421852    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-token\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.421986 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.421964    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxw2x\" (UniqueName: \"kubernetes.io/projected/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-kube-api-access-qxw2x\") pod \"e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") " pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.507725 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.507632    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:25.638925 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.638897    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"]
Jul 28 22:47:25.641576 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:47:25.641549    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7a7b5d_08c7_4e4b_82cb_3b2e64188a9f.slice/crio-58209036263a6330d678ff13eab763dc73961b5e7d32ad8759fbfc167fb48be9 WatchSource:0}: Error finding container 58209036263a6330d678ff13eab763dc73961b5e7d32ad8759fbfc167fb48be9: Status 404 returned error can't find the container with id 58209036263a6330d678ff13eab763dc73961b5e7d32ad8759fbfc167fb48be9
Jul 28 22:47:25.643658 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.643631    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:47:25.643720 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.643693    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:47:25.643764 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:25.643721    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:47:26.562743 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:26.562705    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb" event={"ID":"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f","Type":"ContainerStarted","Data":"17fc75857df6d214be082cc8dc404fcee7bb0347341255e5d6c8f3ec26237568"}
Jul 28 22:47:26.563155 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:26.562791    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb" event={"ID":"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f","Type":"ContainerStarted","Data":"58209036263a6330d678ff13eab763dc73961b5e7d32ad8759fbfc167fb48be9"}
Jul 28 22:47:26.583737 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:26.583692    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb" podStartSLOduration=1.583678306 podStartE2EDuration="1.583678306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:47:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:47:26.581503935 +0000 UTC m=+2547.577092516" watchObservedRunningTime="2026-07-28 22:47:26.583678306 +0000 UTC m=+2547.579266888"
Jul 28 22:47:27.508605 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:27.508572    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:27.513590 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:27.513567    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:27.568470 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:27.568429    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:27.569418 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:27.569398    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:35.391767 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:35.391728    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:47:43.155383 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:43.154319    2564 patch_prober.go:28] interesting pod/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": read tcp 10.133.0.2:48160->10.133.0.45:15021: read: connection reset by peer" start-of-body=
Jul 28 22:47:43.155383 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:43.154383    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb" podUID="8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": read tcp 10.133.0.2:48160->10.133.0.45:15021: read: connection reset by peer"
Jul 28 22:47:43.651051 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:43.651018    2564 generic.go:356] "Generic (PLEG): container finished" podID="8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" containerID="17fc75857df6d214be082cc8dc404fcee7bb0347341255e5d6c8f3ec26237568" exitCode=0
Jul 28 22:47:43.651205 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:43.651089    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb" event={"ID":"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f","Type":"ContainerDied","Data":"17fc75857df6d214be082cc8dc404fcee7bb0347341255e5d6c8f3ec26237568"}
Jul 28 22:47:43.651436 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:43.651420    2564 scope.go:117] "RemoveContainer" containerID="17fc75857df6d214be082cc8dc404fcee7bb0347341255e5d6c8f3ec26237568"
Jul 28 22:47:43.652376 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:43.652351    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:47:43.652440 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:43.652428    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:47:43.652479 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:43.652461    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:47:44.658504 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:44.658469    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb" event={"ID":"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f","Type":"ContainerStarted","Data":"0d5813904ce636dc4ec88256e932b1bc89b510886395f659689a755a08d8749a"}
Jul 28 22:47:45.508069 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:45.508035    2564 patch_prober.go:28] interesting pod/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 28 22:47:45.508255 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:45.508096    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb" podUID="8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 28 22:47:45.508942 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:45.508916    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:46.508185 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:46.508149    2564 patch_prober.go:28] interesting pod/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 28 22:47:46.508614 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:46.508206    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb" podUID="8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 28 22:47:47.508436 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:47.508397    2564 patch_prober.go:28] interesting pod/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 28 22:47:47.508821 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:47.508461    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb" podUID="8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 28 22:47:48.508471 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:48.508429    2564 patch_prober.go:28] interesting pod/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 28 22:47:48.509000 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:48.508494    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb" podUID="8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 28 22:47:49.514122 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:49.514093    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:49.514554 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:49.514346    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:47:49.515081 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:47:49.515065    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:48:18.693277 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:18.693238    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:48:18.813405 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:18.813375    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"]
Jul 28 22:48:18.813619 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:18.813593    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb" podUID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" containerName="istio-proxy" containerID="cri-o://48c893e7b909445eb90771cbbf09ef0beeb4d7bc1b1171e4079e6f02e60c2550" gracePeriod=30
Jul 28 22:48:19.780244 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:19.780211    2564 patch_prober.go:28] interesting pod/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 22:48:19.780638 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:19.780265    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb" podUID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 22:48:24.071986 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.071962    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:48:24.161906 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.161880    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-data\") pod \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") "
Jul 28 22:48:24.162074 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.161913    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-credential-socket\") pod \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") "
Jul 28 22:48:24.162074 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.161931    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-workload-certs\") pod \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") "
Jul 28 22:48:24.162074 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.161948    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-envoy\") pod \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") "
Jul 28 22:48:24.162074 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.161975    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-token\") pod \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") "
Jul 28 22:48:24.162074 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.162004    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-workload-socket\") pod \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") "
Jul 28 22:48:24.162074 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.162028    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-podinfo\") pod \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") "
Jul 28 22:48:24.162074 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.162076    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istiod-ca-cert\") pod \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") "
Jul 28 22:48:24.162443 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.162142    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc59g\" (UniqueName: \"kubernetes.io/projected/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-kube-api-access-jc59g\") pod \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\" (UID: \"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3\") "
Jul 28 22:48:24.162443 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.162200    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" (UID: "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:48:24.162443 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.162224    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" (UID: "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:48:24.162604 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.162462    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-credential-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:24.162604 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.162483    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-workload-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:24.162604 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.162532    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" (UID: "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:48:24.162604 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.162565    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" (UID: "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:48:24.162807 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.162759    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-data" (OuterVolumeSpecName: "istio-data") pod "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" (UID: "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:48:24.164309 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.164278    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" (UID: "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 22:48:24.164419 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.164334    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-token" (OuterVolumeSpecName: "istio-token") pod "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" (UID: "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:48:24.164511 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.164494    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" (UID: "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:48:24.164572 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.164559    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-kube-api-access-jc59g" (OuterVolumeSpecName: "kube-api-access-jc59g") pod "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" (UID: "c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3"). InnerVolumeSpecName "kube-api-access-jc59g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:48:24.263187 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.263163    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istiod-ca-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:24.263187 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.263186    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc59g\" (UniqueName: \"kubernetes.io/projected/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-kube-api-access-jc59g\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:24.263320 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.263195    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-data\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:24.263320 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.263203    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-envoy\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:24.263320 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.263211    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-token\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:24.263320 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.263219    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-workload-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:24.263320 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.263226    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3-istio-podinfo\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:24.849043 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.849009    2564 generic.go:356] "Generic (PLEG): container finished" podID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" containerID="48c893e7b909445eb90771cbbf09ef0beeb4d7bc1b1171e4079e6f02e60c2550" exitCode=0
Jul 28 22:48:24.849262 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.849072    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"
Jul 28 22:48:24.849262 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.849077    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb" event={"ID":"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3","Type":"ContainerDied","Data":"48c893e7b909445eb90771cbbf09ef0beeb4d7bc1b1171e4079e6f02e60c2550"}
Jul 28 22:48:24.849262 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.849195    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb" event={"ID":"c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3","Type":"ContainerDied","Data":"95c69d23d189ae705473feda84b065cd6688d56c4e4d6522712d3b78cd013af6"}
Jul 28 22:48:24.849262 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.849219    2564 scope.go:117] "RemoveContainer" containerID="48c893e7b909445eb90771cbbf09ef0beeb4d7bc1b1171e4079e6f02e60c2550"
Jul 28 22:48:24.858300 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.858284    2564 scope.go:117] "RemoveContainer" containerID="bb8ac7b98d35b36024cad51d1455e29bb154649650ce5daee743b70887946673"
Jul 28 22:48:24.865769 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.865755    2564 scope.go:117] "RemoveContainer" containerID="48c893e7b909445eb90771cbbf09ef0beeb4d7bc1b1171e4079e6f02e60c2550"
Jul 28 22:48:24.866039 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:48:24.866019    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48c893e7b909445eb90771cbbf09ef0beeb4d7bc1b1171e4079e6f02e60c2550\": container with ID starting with 48c893e7b909445eb90771cbbf09ef0beeb4d7bc1b1171e4079e6f02e60c2550 not found: ID does not exist" containerID="48c893e7b909445eb90771cbbf09ef0beeb4d7bc1b1171e4079e6f02e60c2550"
Jul 28 22:48:24.866096 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.866046    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48c893e7b909445eb90771cbbf09ef0beeb4d7bc1b1171e4079e6f02e60c2550"} err="failed to get container status \"48c893e7b909445eb90771cbbf09ef0beeb4d7bc1b1171e4079e6f02e60c2550\": rpc error: code = NotFound desc = could not find container \"48c893e7b909445eb90771cbbf09ef0beeb4d7bc1b1171e4079e6f02e60c2550\": container with ID starting with 48c893e7b909445eb90771cbbf09ef0beeb4d7bc1b1171e4079e6f02e60c2550 not found: ID does not exist"
Jul 28 22:48:24.866096 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.866063    2564 scope.go:117] "RemoveContainer" containerID="bb8ac7b98d35b36024cad51d1455e29bb154649650ce5daee743b70887946673"
Jul 28 22:48:24.866306 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:48:24.866289    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb8ac7b98d35b36024cad51d1455e29bb154649650ce5daee743b70887946673\": container with ID starting with bb8ac7b98d35b36024cad51d1455e29bb154649650ce5daee743b70887946673 not found: ID does not exist" containerID="bb8ac7b98d35b36024cad51d1455e29bb154649650ce5daee743b70887946673"
Jul 28 22:48:24.866362 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.866310    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb8ac7b98d35b36024cad51d1455e29bb154649650ce5daee743b70887946673"} err="failed to get container status \"bb8ac7b98d35b36024cad51d1455e29bb154649650ce5daee743b70887946673\": rpc error: code = NotFound desc = could not find container \"bb8ac7b98d35b36024cad51d1455e29bb154649650ce5daee743b70887946673\": container with ID starting with bb8ac7b98d35b36024cad51d1455e29bb154649650ce5daee743b70887946673 not found: ID does not exist"
Jul 28 22:48:24.868838 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.868805    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"]
Jul 28 22:48:24.872421 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:24.872402    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-26e94d-openshift-default-7cf6968d4d-f7lsb"]
Jul 28 22:48:25.514122 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:25.514084    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" path="/var/lib/kubelet/pods/c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3/volumes"
Jul 28 22:48:39.883640 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:39.883608    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:48:41.179254 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:41.179213    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"]
Jul 28 22:48:41.179650 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:41.179502    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb" podUID="8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" containerName="istio-proxy" containerID="cri-o://0d5813904ce636dc4ec88256e932b1bc89b510886395f659689a755a08d8749a" gracePeriod=30
Jul 28 22:48:42.061129 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.061095    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"]
Jul 28 22:48:42.061771 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.061668    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" containerName="istio-proxy"
Jul 28 22:48:42.061771 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.061689    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" containerName="istio-proxy"
Jul 28 22:48:42.061771 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.061717    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05d0f3d1-3703-4550-8bc6-37427c57aa9d" containerName="istio-proxy"
Jul 28 22:48:42.061771 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.061726    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="05d0f3d1-3703-4550-8bc6-37427c57aa9d" containerName="istio-proxy"
Jul 28 22:48:42.062072 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.061802    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="05d0f3d1-3703-4550-8bc6-37427c57aa9d" containerName="istio-proxy"
Jul 28 22:48:42.062072 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.061979    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" containerName="istio-proxy"
Jul 28 22:48:42.065332 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.065314    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.067456 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.067431    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-3682ae-openshift-default-dockercfg-rqlg2\""
Jul 28 22:48:42.076403 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.076380    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"]
Jul 28 22:48:42.121937 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.121900    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-envoy\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.122083 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.121954    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istiod-ca-cert\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.122083 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.122022    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-podinfo\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.122083 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.122047    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-workload-socket\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.122199 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.122105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-workload-certs\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.122199 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.122158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-data\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.122199 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.122179    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7576p\" (UniqueName: \"kubernetes.io/projected/47b6c5fa-f73f-4211-b488-4f00729fd2d4-kube-api-access-7576p\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.122313 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.122256    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-credential-socket\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.122313 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.122274    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-token\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.222845 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.222807    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-data\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.223262 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.222860    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7576p\" (UniqueName: \"kubernetes.io/projected/47b6c5fa-f73f-4211-b488-4f00729fd2d4-kube-api-access-7576p\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.223262 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.222924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-credential-socket\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.223262 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.222941    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-token\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.223262 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.222989    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-envoy\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.223262 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.223044    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istiod-ca-cert\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.223262 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.223233    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-podinfo\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.223534 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.223274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-workload-socket\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.223534 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.223287    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-credential-socket\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.223534 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.223235    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-data\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.223534 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.223298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-workload-certs\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.223697 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.223590    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-workload-certs\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.223697 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.223618    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-workload-socket\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.223697 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.223662    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istiod-ca-cert\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.225282 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.225261    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-envoy\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.225484 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.225469    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-podinfo\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.229715 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.229685    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-token\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.229859 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.229820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7576p\" (UniqueName: \"kubernetes.io/projected/47b6c5fa-f73f-4211-b488-4f00729fd2d4-kube-api-access-7576p\") pod \"e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") " pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.377048 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.377016    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:42.507133 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.507112    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"]
Jul 28 22:48:42.510108 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:48:42.510082    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b6c5fa_f73f_4211_b488_4f00729fd2d4.slice/crio-ad79b5e511c88971e453b20e071d9fcbdbda2e50bbb1be6e99075db850c67f99 WatchSource:0}: Error finding container ad79b5e511c88971e453b20e071d9fcbdbda2e50bbb1be6e99075db850c67f99: Status 404 returned error can't find the container with id ad79b5e511c88971e453b20e071d9fcbdbda2e50bbb1be6e99075db850c67f99
Jul 28 22:48:42.512283 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.512253    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:48:42.512384 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.512317    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:48:42.512384 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.512342    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:48:42.938685 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.938653    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn" event={"ID":"47b6c5fa-f73f-4211-b488-4f00729fd2d4","Type":"ContainerStarted","Data":"ec2aab184c1a7686d51b9aef8525125fe1fd2753b454fc9c549a5da303f93307"}
Jul 28 22:48:42.938904 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.938703    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn" event={"ID":"47b6c5fa-f73f-4211-b488-4f00729fd2d4","Type":"ContainerStarted","Data":"ad79b5e511c88971e453b20e071d9fcbdbda2e50bbb1be6e99075db850c67f99"}
Jul 28 22:48:42.957048 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:42.956984    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn" podStartSLOduration=0.956969418 podStartE2EDuration="956.969418ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:48:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:48:42.954707096 +0000 UTC m=+2623.950295678" watchObservedRunningTime="2026-07-28 22:48:42.956969418 +0000 UTC m=+2623.952558000"
Jul 28 22:48:43.377341 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:43.377311    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:43.381886 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:43.381863    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:43.944868 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:43.944822    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:43.945618 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:43.945598    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:48:46.431086 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.431062    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:48:46.563196 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563111    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-workload-certs\") pod \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") "
Jul 28 22:48:46.563196 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563152    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-podinfo\") pod \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") "
Jul 28 22:48:46.563196 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563179    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istiod-ca-cert\") pod \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") "
Jul 28 22:48:46.563475 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563205    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-envoy\") pod \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") "
Jul 28 22:48:46.563475 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563248    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-token\") pod \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") "
Jul 28 22:48:46.563475 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563285    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-data\") pod \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") "
Jul 28 22:48:46.563475 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563306    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-credential-socket\") pod \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") "
Jul 28 22:48:46.563475 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563344    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxw2x\" (UniqueName: \"kubernetes.io/projected/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-kube-api-access-qxw2x\") pod \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") "
Jul 28 22:48:46.563475 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563410    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-workload-socket\") pod \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\" (UID: \"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f\") "
Jul 28 22:48:46.563764 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563484    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" (UID: "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:48:46.563764 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563606    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" (UID: "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 22:48:46.563764 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563652    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" (UID: "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:48:46.563764 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563734    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istiod-ca-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:46.563764 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563750    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-credential-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:46.563764 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563765    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-workload-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:46.564062 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.563820    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" (UID: "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:48:46.564181 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.564154    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" (UID: "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:48:46.565407 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.565379    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" (UID: "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:48:46.565578 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.565560    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-kube-api-access-qxw2x" (OuterVolumeSpecName: "kube-api-access-qxw2x") pod "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" (UID: "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f"). InnerVolumeSpecName "kube-api-access-qxw2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:48:46.565732 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.565717    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" (UID: "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:48:46.565794 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.565780    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" (UID: "8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 22:48:46.664434 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.664409    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-podinfo\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:46.664434 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.664432    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-envoy\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:46.664596 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.664441    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-token\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:46.664596 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.664449    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-istio-data\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:46.664596 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.664457    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxw2x\" (UniqueName: \"kubernetes.io/projected/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-kube-api-access-qxw2x\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:46.664596 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.664467    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f-workload-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:48:46.960535 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.960507    2564 generic.go:356] "Generic (PLEG): container finished" podID="8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" containerID="0d5813904ce636dc4ec88256e932b1bc89b510886395f659689a755a08d8749a" exitCode=0
Jul 28 22:48:46.960701 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.960554    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"
Jul 28 22:48:46.960701 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.960568    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb" event={"ID":"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f","Type":"ContainerDied","Data":"0d5813904ce636dc4ec88256e932b1bc89b510886395f659689a755a08d8749a"}
Jul 28 22:48:46.960701 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.960610    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb" event={"ID":"8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f","Type":"ContainerDied","Data":"58209036263a6330d678ff13eab763dc73961b5e7d32ad8759fbfc167fb48be9"}
Jul 28 22:48:46.960701 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.960633    2564 scope.go:117] "RemoveContainer" containerID="0d5813904ce636dc4ec88256e932b1bc89b510886395f659689a755a08d8749a"
Jul 28 22:48:46.972598 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.972580    2564 scope.go:117] "RemoveContainer" containerID="17fc75857df6d214be082cc8dc404fcee7bb0347341255e5d6c8f3ec26237568"
Jul 28 22:48:46.980082 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.980066    2564 scope.go:117] "RemoveContainer" containerID="0d5813904ce636dc4ec88256e932b1bc89b510886395f659689a755a08d8749a"
Jul 28 22:48:46.980326 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:48:46.980305    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d5813904ce636dc4ec88256e932b1bc89b510886395f659689a755a08d8749a\": container with ID starting with 0d5813904ce636dc4ec88256e932b1bc89b510886395f659689a755a08d8749a not found: ID does not exist" containerID="0d5813904ce636dc4ec88256e932b1bc89b510886395f659689a755a08d8749a"
Jul 28 22:48:46.980368 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.980336    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5813904ce636dc4ec88256e932b1bc89b510886395f659689a755a08d8749a"} err="failed to get container status \"0d5813904ce636dc4ec88256e932b1bc89b510886395f659689a755a08d8749a\": rpc error: code = NotFound desc = could not find container \"0d5813904ce636dc4ec88256e932b1bc89b510886395f659689a755a08d8749a\": container with ID starting with 0d5813904ce636dc4ec88256e932b1bc89b510886395f659689a755a08d8749a not found: ID does not exist"
Jul 28 22:48:46.980368 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.980353    2564 scope.go:117] "RemoveContainer" containerID="17fc75857df6d214be082cc8dc404fcee7bb0347341255e5d6c8f3ec26237568"
Jul 28 22:48:46.980572 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:48:46.980556    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17fc75857df6d214be082cc8dc404fcee7bb0347341255e5d6c8f3ec26237568\": container with ID starting with 17fc75857df6d214be082cc8dc404fcee7bb0347341255e5d6c8f3ec26237568 not found: ID does not exist" containerID="17fc75857df6d214be082cc8dc404fcee7bb0347341255e5d6c8f3ec26237568"
Jul 28 22:48:46.980609 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.980578    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17fc75857df6d214be082cc8dc404fcee7bb0347341255e5d6c8f3ec26237568"} err="failed to get container status \"17fc75857df6d214be082cc8dc404fcee7bb0347341255e5d6c8f3ec26237568\": rpc error: code = NotFound desc = could not find container \"17fc75857df6d214be082cc8dc404fcee7bb0347341255e5d6c8f3ec26237568\": container with ID starting with 17fc75857df6d214be082cc8dc404fcee7bb0347341255e5d6c8f3ec26237568 not found: ID does not exist"
Jul 28 22:48:46.984210 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.984192    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"]
Jul 28 22:48:46.987963 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:46.987944    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-9bcb6e-openshift-default-855d65997b-84hcb"]
Jul 28 22:48:47.507518 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:47.507483    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" path="/var/lib/kubelet/pods/8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f/volumes"
Jul 28 22:48:51.394836 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:51.394788    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:48:58.946617 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:58.946588    2564 patch_prober.go:28] interesting pod/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 28 22:48:58.946952 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:58.946653    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn" podUID="47b6c5fa-f73f-4211-b488-4f00729fd2d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 28 22:48:59.015131 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:59.015105    2564 generic.go:356] "Generic (PLEG): container finished" podID="47b6c5fa-f73f-4211-b488-4f00729fd2d4" containerID="ec2aab184c1a7686d51b9aef8525125fe1fd2753b454fc9c549a5da303f93307" exitCode=0
Jul 28 22:48:59.015233 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:59.015178    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn" event={"ID":"47b6c5fa-f73f-4211-b488-4f00729fd2d4","Type":"ContainerDied","Data":"ec2aab184c1a7686d51b9aef8525125fe1fd2753b454fc9c549a5da303f93307"}
Jul 28 22:48:59.015540 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:59.015525    2564 scope.go:117] "RemoveContainer" containerID="ec2aab184c1a7686d51b9aef8525125fe1fd2753b454fc9c549a5da303f93307"
Jul 28 22:48:59.016489 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:59.016467    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:48:59.016540 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:59.016528    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:48:59.016582 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:48:59.016571    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:49:00.024518 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:00.024400    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn" event={"ID":"47b6c5fa-f73f-4211-b488-4f00729fd2d4","Type":"ContainerStarted","Data":"fc852d8f39b1d79c6050afe7e2a4fdd62d7481f4551ae591b302815a60f5f10e"}
Jul 28 22:49:00.377845 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:00.377799    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:49:00.378084 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:00.378061    2564 patch_prober.go:28] interesting pod/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 28 22:49:00.378188 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:00.378114    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn" podUID="47b6c5fa-f73f-4211-b488-4f00729fd2d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 28 22:49:01.378221 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:01.378186    2564 patch_prober.go:28] interesting pod/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 28 22:49:01.378686 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:01.378247    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn" podUID="47b6c5fa-f73f-4211-b488-4f00729fd2d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 28 22:49:02.377456 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:02.377421    2564 patch_prober.go:28] interesting pod/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 28 22:49:02.377638 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:02.377472    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn" podUID="47b6c5fa-f73f-4211-b488-4f00729fd2d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 28 22:49:03.377480 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:03.377439    2564 patch_prober.go:28] interesting pod/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 28 22:49:03.377916 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:03.377500    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn" podUID="47b6c5fa-f73f-4211-b488-4f00729fd2d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 28 22:49:04.381273 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:04.381240    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:49:04.381660 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:04.381497    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:49:04.382156 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:04.382138    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 22:49:10.543408 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.543377    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"]
Jul 28 22:49:10.543793 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.543722    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" containerName="istio-proxy"
Jul 28 22:49:10.543793 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.543732    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" containerName="istio-proxy"
Jul 28 22:49:10.543793 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.543741    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" containerName="istio-proxy"
Jul 28 22:49:10.543793 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.543746    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" containerName="istio-proxy"
Jul 28 22:49:10.543793 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.543753    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" containerName="istio-proxy"
Jul 28 22:49:10.543793 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.543758    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" containerName="istio-proxy"
Jul 28 22:49:10.544009 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.543809    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" containerName="istio-proxy"
Jul 28 22:49:10.544009 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.543818    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9cc4fc2-0b60-4f7c-80f3-52e53bcbede3" containerName="istio-proxy"
Jul 28 22:49:10.544009 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.543840    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d7a7b5d-08c7-4e4b-82cb-3b2e64188a9f" containerName="istio-proxy"
Jul 28 22:49:10.546766 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.546750    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.550077 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.550056    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-aa2de7-openshift-default-dockercfg-m66vh\""
Jul 28 22:49:10.568246 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.568221    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"]
Jul 28 22:49:10.592208 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.592180    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-workload-certs\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.592330 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.592209    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-data\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.592330 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.592238    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp4v8\" (UniqueName: \"kubernetes.io/projected/19ac99d1-7d5d-4011-900d-4ebbc77702cf-kube-api-access-zp4v8\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.592330 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.592307    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-token\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.592456 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.592345    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-credential-socket\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.592456 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.592363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-workload-socket\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.592456 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.592393    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-podinfo\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.592456 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.592444    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istiod-ca-cert\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.592596 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.592463    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-envoy\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.693965 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.693935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-workload-certs\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.694153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.693973    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-data\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.694153 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.694097    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp4v8\" (UniqueName: \"kubernetes.io/projected/19ac99d1-7d5d-4011-900d-4ebbc77702cf-kube-api-access-zp4v8\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.694281 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.694163    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-token\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.694281 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.694192    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-credential-socket\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.694281 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.694221    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-workload-socket\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.694281 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.694263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-podinfo\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.694504 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.694286    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-workload-certs\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.694504 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.694326    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istiod-ca-cert\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.694504 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.694369    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-envoy\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.694504 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.694324    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-data\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.694649 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.694580    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-workload-socket\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.694711 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.694688    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-credential-socket\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.695039 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.695023    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istiod-ca-cert\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.696358 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.696340    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-envoy\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.696907 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.696890    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-podinfo\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.703023 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.703000    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-token\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.703263 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.703241    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp4v8\" (UniqueName: \"kubernetes.io/projected/19ac99d1-7d5d-4011-900d-4ebbc77702cf-kube-api-access-zp4v8\") pod \"e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") " pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.856570 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.856541    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:10.988110 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.988088    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"]
Jul 28 22:49:10.990406 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:49:10.990381    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ac99d1_7d5d_4011_900d_4ebbc77702cf.slice/crio-40b5abc6093b81de5b9147efb1448bb2a4f7024b74d9d1d30b5d6d009d5f7304 WatchSource:0}: Error finding container 40b5abc6093b81de5b9147efb1448bb2a4f7024b74d9d1d30b5d6d009d5f7304: Status 404 returned error can't find the container with id 40b5abc6093b81de5b9147efb1448bb2a4f7024b74d9d1d30b5d6d009d5f7304
Jul 28 22:49:10.992621 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.992583    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:49:10.992705 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.992647    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:49:10.992705 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:10.992680    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:49:11.084365 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:11.084329    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8" event={"ID":"19ac99d1-7d5d-4011-900d-4ebbc77702cf","Type":"ContainerStarted","Data":"4aaf21fe7e658dfa37f287d16db0c5a3c4feaa292ddd4f96679162f31d20edfc"}
Jul 28 22:49:11.084491 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:11.084391    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8" event={"ID":"19ac99d1-7d5d-4011-900d-4ebbc77702cf","Type":"ContainerStarted","Data":"40b5abc6093b81de5b9147efb1448bb2a4f7024b74d9d1d30b5d6d009d5f7304"}
Jul 28 22:49:11.104521 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:11.104463    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8" podStartSLOduration=1.1044421309999999 podStartE2EDuration="1.104442131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:49:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:49:11.101925323 +0000 UTC m=+2652.097513904" watchObservedRunningTime="2026-07-28 22:49:11.104442131 +0000 UTC m=+2652.100030714"
Jul 28 22:49:11.856948 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:11.856913    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:12.862492 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:12.862465    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:13.094069 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:13.094035    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:13.095232 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:13.095206    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:20.987973 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:20.987936    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:49:28.180971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:28.180008    2564 patch_prober.go:28] interesting pod/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:35976->10.133.0.47:15021: read: connection reset by peer" start-of-body=
Jul 28 22:49:28.180971 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:28.180086    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8" podUID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:35976->10.133.0.47:15021: read: connection reset by peer"
Jul 28 22:49:29.179074 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:29.179042    2564 generic.go:356] "Generic (PLEG): container finished" podID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" containerID="4aaf21fe7e658dfa37f287d16db0c5a3c4feaa292ddd4f96679162f31d20edfc" exitCode=0
Jul 28 22:49:29.179274 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:29.179082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8" event={"ID":"19ac99d1-7d5d-4011-900d-4ebbc77702cf","Type":"ContainerDied","Data":"4aaf21fe7e658dfa37f287d16db0c5a3c4feaa292ddd4f96679162f31d20edfc"}
Jul 28 22:49:29.179501 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:29.179486    2564 scope.go:117] "RemoveContainer" containerID="4aaf21fe7e658dfa37f287d16db0c5a3c4feaa292ddd4f96679162f31d20edfc"
Jul 28 22:49:29.180566 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:29.180538    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:49:29.180630 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:29.180607    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:49:29.180666 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:29.180649    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:49:30.185435 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:30.185404    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8" event={"ID":"19ac99d1-7d5d-4011-900d-4ebbc77702cf","Type":"ContainerStarted","Data":"d37603e4c5eeab86d24931096f2bf2ce30f5e91cd7b65a4bf67c3f7503195923"}
Jul 28 22:49:30.856905 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:30.856872    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:30.857102 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:30.857080    2564 patch_prober.go:28] interesting pod/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 28 22:49:30.857166 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:30.857145    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8" podUID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 28 22:49:31.857966 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:31.857927    2564 patch_prober.go:28] interesting pod/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 28 22:49:31.858359 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:31.857983    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8" podUID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 28 22:49:32.857486 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:32.857451    2564 patch_prober.go:28] interesting pod/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 28 22:49:32.857659 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:32.857509    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8" podUID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 28 22:49:33.857165 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:33.857123    2564 patch_prober.go:28] interesting pod/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 28 22:49:33.857579 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:33.857185    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8" podUID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 28 22:49:34.860705 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:34.860674    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:34.861105 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:34.861022    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:34.861677 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:34.861662    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 22:49:43.969527 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:43.969492    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"]
Jul 28 22:49:43.972963 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:43.972939    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:43.975480 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:43.975454    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3682ae\"/\"auth-test-model-3682ae-kserve-self-signed-certs\""
Jul 28 22:49:43.975480 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:43.975471    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3682ae\"/\"openshift-service-ca.crt\""
Jul 28 22:49:43.975649 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:43.975572    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3682ae\"/\"default-dockercfg-pn4x8\""
Jul 28 22:49:43.975735 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:43.975577    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3682ae\"/\"kube-root-ca.crt\""
Jul 28 22:49:43.981736 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:43.981713    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"]
Jul 28 22:49:44.009967 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.009938    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-dshm\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.010084 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.009984    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-tmp-dir\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.010129 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.010092    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-home\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.010166 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.010150    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cggdp\" (UniqueName: \"kubernetes.io/projected/1965d857-5b13-411e-a7e7-1b69e4d478e6-kube-api-access-cggdp\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.010243 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.010227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-model-cache\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.010282 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.010262    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1965d857-5b13-411e-a7e7-1b69e4d478e6-tls-certs\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.111315 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.111280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cggdp\" (UniqueName: \"kubernetes.io/projected/1965d857-5b13-411e-a7e7-1b69e4d478e6-kube-api-access-cggdp\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.111481 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.111365    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-model-cache\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.111481 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.111401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1965d857-5b13-411e-a7e7-1b69e4d478e6-tls-certs\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.111603 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.111523    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-dshm\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.111603 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.111552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-tmp-dir\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.111719 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.111634    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-home\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.111880 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.111848    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-model-cache\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.111997 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.111948    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-tmp-dir\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.112045 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.112030    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-home\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.113693 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.113668    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-dshm\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.113985 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.113965    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1965d857-5b13-411e-a7e7-1b69e4d478e6-tls-certs\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.119795 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.119775    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cggdp\" (UniqueName: \"kubernetes.io/projected/1965d857-5b13-411e-a7e7-1b69e4d478e6-kube-api-access-cggdp\") pod \"auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") " pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.283681 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.283599    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:44.422455 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:44.422433    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"]
Jul 28 22:49:44.424818 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:49:44.424792    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1965d857_5b13_411e_a7e7_1b69e4d478e6.slice/crio-00ba005dede7471fbe76a21374ca60d2a7359b41f422f331958517046a3e20d9 WatchSource:0}: Error finding container 00ba005dede7471fbe76a21374ca60d2a7359b41f422f331958517046a3e20d9: Status 404 returned error can't find the container with id 00ba005dede7471fbe76a21374ca60d2a7359b41f422f331958517046a3e20d9
Jul 28 22:49:45.256841 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:45.256802    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr" event={"ID":"1965d857-5b13-411e-a7e7-1b69e4d478e6","Type":"ContainerStarted","Data":"36723dd45e595a48d6e865ba776cbf447086391761a26f8c9ce5afd87444cf71"}
Jul 28 22:49:45.257228 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:45.256873    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr" event={"ID":"1965d857-5b13-411e-a7e7-1b69e4d478e6","Type":"ContainerStarted","Data":"00ba005dede7471fbe76a21374ca60d2a7359b41f422f331958517046a3e20d9"}
Jul 28 22:49:45.273565 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:45.273516    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr" podStartSLOduration=2.273501176 podStartE2EDuration="2.273501176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:49:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:49:45.272398552 +0000 UTC m=+2686.267987136" watchObservedRunningTime="2026-07-28 22:49:45.273501176 +0000 UTC m=+2686.269089736"
Jul 28 22:49:46.095420 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:46.095383    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:49:54.284561 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:54.284479    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:54.284561 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:54.284535    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:54.296553 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:54.296526    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:54.319100 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:54.319074    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:49:59.602507 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:59.602478    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:49:59.638339 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:49:59.638317    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:50:07.075097 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.075065    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"]
Jul 28 22:50:07.078520 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.078499    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.080608 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.080590    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa2de7\"/\"kube-root-ca.crt\""
Jul 28 22:50:07.081069 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.081050    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa2de7\"/\"auth-test-model-aa2de7-kserve-self-signed-certs\""
Jul 28 22:50:07.081069 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.081064    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa2de7\"/\"openshift-service-ca.crt\""
Jul 28 22:50:07.081218 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.081194    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa2de7\"/\"default-dockercfg-ch4mk\""
Jul 28 22:50:07.089602 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.089583    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"]
Jul 28 22:50:07.202072 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.202036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2960730a-9578-4336-88cc-8bc3c2503628-tls-certs\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.202243 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.202085    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-dshm\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.202243 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.202156    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prcr6\" (UniqueName: \"kubernetes.io/projected/2960730a-9578-4336-88cc-8bc3c2503628-kube-api-access-prcr6\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.202243 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.202221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-home\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.202392 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.202247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-tmp-dir\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.202392 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.202290    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-model-cache\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.303209 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.303173    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2960730a-9578-4336-88cc-8bc3c2503628-tls-certs\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.303461 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.303219    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-dshm\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.303461 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.303276    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prcr6\" (UniqueName: \"kubernetes.io/projected/2960730a-9578-4336-88cc-8bc3c2503628-kube-api-access-prcr6\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.303461 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.303312    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-home\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.303461 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.303345    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-tmp-dir\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.303461 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.303401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-model-cache\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.303776 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.303758    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-tmp-dir\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.303877 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.303820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-home\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.303939 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.303871    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-model-cache\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.305442 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.305426    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-dshm\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.305701 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.305686    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2960730a-9578-4336-88cc-8bc3c2503628-tls-certs\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.311414 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.311394    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prcr6\" (UniqueName: \"kubernetes.io/projected/2960730a-9578-4336-88cc-8bc3c2503628-kube-api-access-prcr6\") pod \"auth-test-model-aa2de7-kserve-8567f7df55-bv489\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") " pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.388282 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.388262    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:07.517199 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:07.517167    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"]
Jul 28 22:50:07.520079 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:50:07.520049    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2960730a_9578_4336_88cc_8bc3c2503628.slice/crio-a6e089e3fb6a964e557d6d4bd650cc978420967539879f0014962cf5d356b63e WatchSource:0}: Error finding container a6e089e3fb6a964e557d6d4bd650cc978420967539879f0014962cf5d356b63e: Status 404 returned error can't find the container with id a6e089e3fb6a964e557d6d4bd650cc978420967539879f0014962cf5d356b63e
Jul 28 22:50:08.370199 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:08.370169    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489" event={"ID":"2960730a-9578-4336-88cc-8bc3c2503628","Type":"ContainerStarted","Data":"05c37a67710d7c918b3689f9572c87ec10325e5279f8e1a778aefd8c20074cb6"}
Jul 28 22:50:08.370572 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:08.370206    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489" event={"ID":"2960730a-9578-4336-88cc-8bc3c2503628","Type":"ContainerStarted","Data":"a6e089e3fb6a964e557d6d4bd650cc978420967539879f0014962cf5d356b63e"}
Jul 28 22:50:08.390710 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:08.387245    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489" podStartSLOduration=1.3872249779999999 podStartE2EDuration="1.387224978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:50:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:50:08.383390469 +0000 UTC m=+2709.378979065" watchObservedRunningTime="2026-07-28 22:50:08.387224978 +0000 UTC m=+2709.382813566"
Jul 28 22:50:10.693019 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:10.692990    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:50:17.389125 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:17.389087    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:17.389619 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:17.389145    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:17.402010 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:17.401983    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:17.422326 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:17.422298    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:50:44.491017 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:50:44.490989    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:51:06.191145 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:51:06.191106    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:51:20.490666 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:51:20.490637    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:51:32.489186 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:51:32.489103    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:51:46.996598 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:51:46.996565    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:52:05.604814 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:52:05.604782    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:52:27.891361 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:52:27.891322    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:52:45.395612 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:52:45.395576    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:53:09.588660 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:53:09.588560    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:53:25.285010 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:53:25.284978    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:53:46.094990 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:53:46.094951    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:54:03.890738 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:03.890703    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:54:26.597600 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:26.597576    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:54:31.022895 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:31.022858    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"]
Jul 28 22:54:31.972896 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:31.972860    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"]
Jul 28 22:54:42.393861 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:42.393814    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:54:46.044477 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.044428    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr" podUID="1965d857-5b13-411e-a7e7-1b69e4d478e6" containerName="main" containerID="cri-o://36723dd45e595a48d6e865ba776cbf447086391761a26f8c9ce5afd87444cf71" gracePeriod=45
Jul 28 22:54:46.287247 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.287222    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:54:46.428600 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.428568    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-dshm\") pod \"1965d857-5b13-411e-a7e7-1b69e4d478e6\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") "
Jul 28 22:54:46.428902 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.428633    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1965d857-5b13-411e-a7e7-1b69e4d478e6-tls-certs\") pod \"1965d857-5b13-411e-a7e7-1b69e4d478e6\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") "
Jul 28 22:54:46.428902 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.428660    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cggdp\" (UniqueName: \"kubernetes.io/projected/1965d857-5b13-411e-a7e7-1b69e4d478e6-kube-api-access-cggdp\") pod \"1965d857-5b13-411e-a7e7-1b69e4d478e6\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") "
Jul 28 22:54:46.428902 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.428697    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-home\") pod \"1965d857-5b13-411e-a7e7-1b69e4d478e6\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") "
Jul 28 22:54:46.428902 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.428740    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-tmp-dir\") pod \"1965d857-5b13-411e-a7e7-1b69e4d478e6\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") "
Jul 28 22:54:46.428902 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.428787    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-model-cache\") pod \"1965d857-5b13-411e-a7e7-1b69e4d478e6\" (UID: \"1965d857-5b13-411e-a7e7-1b69e4d478e6\") "
Jul 28 22:54:46.429178 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.429022    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-home" (OuterVolumeSpecName: "home") pod "1965d857-5b13-411e-a7e7-1b69e4d478e6" (UID: "1965d857-5b13-411e-a7e7-1b69e4d478e6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:54:46.429178 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.429075    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1965d857-5b13-411e-a7e7-1b69e4d478e6" (UID: "1965d857-5b13-411e-a7e7-1b69e4d478e6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:54:46.429178 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.429121    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-home\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:54:46.429178 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.429151    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-model-cache" (OuterVolumeSpecName: "model-cache") pod "1965d857-5b13-411e-a7e7-1b69e4d478e6" (UID: "1965d857-5b13-411e-a7e7-1b69e4d478e6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:54:46.430880 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.430852    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-dshm" (OuterVolumeSpecName: "dshm") pod "1965d857-5b13-411e-a7e7-1b69e4d478e6" (UID: "1965d857-5b13-411e-a7e7-1b69e4d478e6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:54:46.430998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.430923    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1965d857-5b13-411e-a7e7-1b69e4d478e6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1965d857-5b13-411e-a7e7-1b69e4d478e6" (UID: "1965d857-5b13-411e-a7e7-1b69e4d478e6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:54:46.431060 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.431014    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1965d857-5b13-411e-a7e7-1b69e4d478e6-kube-api-access-cggdp" (OuterVolumeSpecName: "kube-api-access-cggdp") pod "1965d857-5b13-411e-a7e7-1b69e4d478e6" (UID: "1965d857-5b13-411e-a7e7-1b69e4d478e6"). InnerVolumeSpecName "kube-api-access-cggdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:54:46.529909 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.529874    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-model-cache\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:54:46.529909 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.529904    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-dshm\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:54:46.529909 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.529912    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1965d857-5b13-411e-a7e7-1b69e4d478e6-tls-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:54:46.530150 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.529922    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cggdp\" (UniqueName: \"kubernetes.io/projected/1965d857-5b13-411e-a7e7-1b69e4d478e6-kube-api-access-cggdp\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:54:46.530150 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.529930    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1965d857-5b13-411e-a7e7-1b69e4d478e6-tmp-dir\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:54:46.680599 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.680516    2564 generic.go:356] "Generic (PLEG): container finished" podID="1965d857-5b13-411e-a7e7-1b69e4d478e6" containerID="36723dd45e595a48d6e865ba776cbf447086391761a26f8c9ce5afd87444cf71" exitCode=0
Jul 28 22:54:46.680599 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.680566    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"
Jul 28 22:54:46.680599 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.680574    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr" event={"ID":"1965d857-5b13-411e-a7e7-1b69e4d478e6","Type":"ContainerDied","Data":"36723dd45e595a48d6e865ba776cbf447086391761a26f8c9ce5afd87444cf71"}
Jul 28 22:54:46.680878 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.680604    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr" event={"ID":"1965d857-5b13-411e-a7e7-1b69e4d478e6","Type":"ContainerDied","Data":"00ba005dede7471fbe76a21374ca60d2a7359b41f422f331958517046a3e20d9"}
Jul 28 22:54:46.680878 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.680620    2564 scope.go:117] "RemoveContainer" containerID="36723dd45e595a48d6e865ba776cbf447086391761a26f8c9ce5afd87444cf71"
Jul 28 22:54:46.689791 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.689776    2564 scope.go:117] "RemoveContainer" containerID="36723dd45e595a48d6e865ba776cbf447086391761a26f8c9ce5afd87444cf71"
Jul 28 22:54:46.690027 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:54:46.690010    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36723dd45e595a48d6e865ba776cbf447086391761a26f8c9ce5afd87444cf71\": container with ID starting with 36723dd45e595a48d6e865ba776cbf447086391761a26f8c9ce5afd87444cf71 not found: ID does not exist" containerID="36723dd45e595a48d6e865ba776cbf447086391761a26f8c9ce5afd87444cf71"
Jul 28 22:54:46.690080 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.690036    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36723dd45e595a48d6e865ba776cbf447086391761a26f8c9ce5afd87444cf71"} err="failed to get container status \"36723dd45e595a48d6e865ba776cbf447086391761a26f8c9ce5afd87444cf71\": rpc error: code = NotFound desc = could not find container \"36723dd45e595a48d6e865ba776cbf447086391761a26f8c9ce5afd87444cf71\": container with ID starting with 36723dd45e595a48d6e865ba776cbf447086391761a26f8c9ce5afd87444cf71 not found: ID does not exist"
Jul 28 22:54:46.700334 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.700313    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"]
Jul 28 22:54:46.703388 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.703368    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3682ae/auth-test-model-3682ae-kserve-dfdcfb8d7-gcnhr"]
Jul 28 22:54:46.992612 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:46.992521    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489" podUID="2960730a-9578-4336-88cc-8bc3c2503628" containerName="main" containerID="cri-o://05c37a67710d7c918b3689f9572c87ec10325e5279f8e1a778aefd8c20074cb6" gracePeriod=45
Jul 28 22:54:47.248204 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.248137    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:54:47.437686 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.437656    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-home\") pod \"2960730a-9578-4336-88cc-8bc3c2503628\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") "
Jul 28 22:54:47.437908 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.437699    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prcr6\" (UniqueName: \"kubernetes.io/projected/2960730a-9578-4336-88cc-8bc3c2503628-kube-api-access-prcr6\") pod \"2960730a-9578-4336-88cc-8bc3c2503628\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") "
Jul 28 22:54:47.437908 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.437745    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-tmp-dir\") pod \"2960730a-9578-4336-88cc-8bc3c2503628\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") "
Jul 28 22:54:47.437908 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.437801    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-dshm\") pod \"2960730a-9578-4336-88cc-8bc3c2503628\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") "
Jul 28 22:54:47.437908 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.437822    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-model-cache\") pod \"2960730a-9578-4336-88cc-8bc3c2503628\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") "
Jul 28 22:54:47.438124 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.437919    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2960730a-9578-4336-88cc-8bc3c2503628-tls-certs\") pod \"2960730a-9578-4336-88cc-8bc3c2503628\" (UID: \"2960730a-9578-4336-88cc-8bc3c2503628\") "
Jul 28 22:54:47.438124 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.437972    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-home" (OuterVolumeSpecName: "home") pod "2960730a-9578-4336-88cc-8bc3c2503628" (UID: "2960730a-9578-4336-88cc-8bc3c2503628"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:54:47.438124 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.438054    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2960730a-9578-4336-88cc-8bc3c2503628" (UID: "2960730a-9578-4336-88cc-8bc3c2503628"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:54:47.438124 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.438066    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-model-cache" (OuterVolumeSpecName: "model-cache") pod "2960730a-9578-4336-88cc-8bc3c2503628" (UID: "2960730a-9578-4336-88cc-8bc3c2503628"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:54:47.438321 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.438291    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-model-cache\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:54:47.438321 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.438310    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-home\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:54:47.438418 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.438328    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-tmp-dir\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:54:47.440088 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.440063    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2960730a-9578-4336-88cc-8bc3c2503628-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2960730a-9578-4336-88cc-8bc3c2503628" (UID: "2960730a-9578-4336-88cc-8bc3c2503628"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:54:47.440223 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.440107    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-dshm" (OuterVolumeSpecName: "dshm") pod "2960730a-9578-4336-88cc-8bc3c2503628" (UID: "2960730a-9578-4336-88cc-8bc3c2503628"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:54:47.440223 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.440155    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2960730a-9578-4336-88cc-8bc3c2503628-kube-api-access-prcr6" (OuterVolumeSpecName: "kube-api-access-prcr6") pod "2960730a-9578-4336-88cc-8bc3c2503628" (UID: "2960730a-9578-4336-88cc-8bc3c2503628"). InnerVolumeSpecName "kube-api-access-prcr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:54:47.508556 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.508478    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1965d857-5b13-411e-a7e7-1b69e4d478e6" path="/var/lib/kubelet/pods/1965d857-5b13-411e-a7e7-1b69e4d478e6/volumes"
Jul 28 22:54:47.538866 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.538821    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2960730a-9578-4336-88cc-8bc3c2503628-dshm\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:54:47.538866 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.538861    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2960730a-9578-4336-88cc-8bc3c2503628-tls-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:54:47.539021 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.538872    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prcr6\" (UniqueName: \"kubernetes.io/projected/2960730a-9578-4336-88cc-8bc3c2503628-kube-api-access-prcr6\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:54:47.685903 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.685868    2564 generic.go:356] "Generic (PLEG): container finished" podID="2960730a-9578-4336-88cc-8bc3c2503628" containerID="05c37a67710d7c918b3689f9572c87ec10325e5279f8e1a778aefd8c20074cb6" exitCode=0
Jul 28 22:54:47.686079 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.685911    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"
Jul 28 22:54:47.686079 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.685946    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489" event={"ID":"2960730a-9578-4336-88cc-8bc3c2503628","Type":"ContainerDied","Data":"05c37a67710d7c918b3689f9572c87ec10325e5279f8e1a778aefd8c20074cb6"}
Jul 28 22:54:47.686079 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.685983    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489" event={"ID":"2960730a-9578-4336-88cc-8bc3c2503628","Type":"ContainerDied","Data":"a6e089e3fb6a964e557d6d4bd650cc978420967539879f0014962cf5d356b63e"}
Jul 28 22:54:47.686079 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.686010    2564 scope.go:117] "RemoveContainer" containerID="05c37a67710d7c918b3689f9572c87ec10325e5279f8e1a778aefd8c20074cb6"
Jul 28 22:54:47.694557 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.694542    2564 scope.go:117] "RemoveContainer" containerID="05c37a67710d7c918b3689f9572c87ec10325e5279f8e1a778aefd8c20074cb6"
Jul 28 22:54:47.694780 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:54:47.694764    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05c37a67710d7c918b3689f9572c87ec10325e5279f8e1a778aefd8c20074cb6\": container with ID starting with 05c37a67710d7c918b3689f9572c87ec10325e5279f8e1a778aefd8c20074cb6 not found: ID does not exist" containerID="05c37a67710d7c918b3689f9572c87ec10325e5279f8e1a778aefd8c20074cb6"
Jul 28 22:54:47.694864 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.694789    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05c37a67710d7c918b3689f9572c87ec10325e5279f8e1a778aefd8c20074cb6"} err="failed to get container status \"05c37a67710d7c918b3689f9572c87ec10325e5279f8e1a778aefd8c20074cb6\": rpc error: code = NotFound desc = could not find container \"05c37a67710d7c918b3689f9572c87ec10325e5279f8e1a778aefd8c20074cb6\": container with ID starting with 05c37a67710d7c918b3689f9572c87ec10325e5279f8e1a778aefd8c20074cb6 not found: ID does not exist"
Jul 28 22:54:47.701058 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.701036    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"]
Jul 28 22:54:47.704052 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:47.704031    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/auth-test-model-aa2de7-kserve-8567f7df55-bv489"]
Jul 28 22:54:49.508688 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:49.508653    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2960730a-9578-4336-88cc-8bc3c2503628" path="/var/lib/kubelet/pods/2960730a-9578-4336-88cc-8bc3c2503628/volumes"
Jul 28 22:54:59.629879 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:59.629850    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:54:59.666621 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:54:59.666596    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:55:07.279967 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.279940    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"]
Jul 28 22:55:07.280335 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.280268    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1965d857-5b13-411e-a7e7-1b69e4d478e6" containerName="main"
Jul 28 22:55:07.280335 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.280279    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1965d857-5b13-411e-a7e7-1b69e4d478e6" containerName="main"
Jul 28 22:55:07.280335 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.280298    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2960730a-9578-4336-88cc-8bc3c2503628" containerName="main"
Jul 28 22:55:07.280335 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.280304    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2960730a-9578-4336-88cc-8bc3c2503628" containerName="main"
Jul 28 22:55:07.280470 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.280361    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1965d857-5b13-411e-a7e7-1b69e4d478e6" containerName="main"
Jul 28 22:55:07.280470 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.280371    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2960730a-9578-4336-88cc-8bc3c2503628" containerName="main"
Jul 28 22:55:07.284724 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.284703    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.287401 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.287378    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa2de7\"/\"default-dockercfg-ch4mk\""
Jul 28 22:55:07.287539 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.287443    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa2de7\"/\"openshift-service-ca.crt\""
Jul 28 22:55:07.287603 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.287587    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa2de7\"/\"kube-root-ca.crt\""
Jul 28 22:55:07.287603 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.287593    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa2de7\"/\"sub-test-model-aa2de7-kserve-self-signed-certs\""
Jul 28 22:55:07.294546 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.294527    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"]
Jul 28 22:55:07.427081 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.427046    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-home\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.427270 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.427110    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-tmp-dir\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.427270 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.427144    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/624451e0-7475-4187-9c88-0522188bdbe2-tls-certs\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.427270 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.427163    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-model-cache\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.427375 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.427276    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-dshm\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.427375 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.427308    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv6w8\" (UniqueName: \"kubernetes.io/projected/624451e0-7475-4187-9c88-0522188bdbe2-kube-api-access-vv6w8\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.527928 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.527893    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-dshm\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.528121 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.527941    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv6w8\" (UniqueName: \"kubernetes.io/projected/624451e0-7475-4187-9c88-0522188bdbe2-kube-api-access-vv6w8\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.528121 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.527968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-home\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.528121 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.528018    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-tmp-dir\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.528121 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.528048    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/624451e0-7475-4187-9c88-0522188bdbe2-tls-certs\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.528121 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.528074    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-model-cache\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.528420 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.528395    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-home\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.528483 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.528414    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-tmp-dir\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.528483 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.528454    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-model-cache\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.530254 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.530197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-dshm\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.530463 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.530446    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/624451e0-7475-4187-9c88-0522188bdbe2-tls-certs\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.534589 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.534565    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv6w8\" (UniqueName: \"kubernetes.io/projected/624451e0-7475-4187-9c88-0522188bdbe2-kube-api-access-vv6w8\") pod \"sub-test-model-aa2de7-kserve-f64985cb7-6gjcx\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") " pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.595370 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.595325    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:07.725805 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.725782    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"]
Jul 28 22:55:07.727675 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:55:07.727641    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod624451e0_7475_4187_9c88_0522188bdbe2.slice/crio-fa35166f9ae41d56b2dd7d88c686cadaedb7d2768ccce60ce985a0aada8fd85c WatchSource:0}: Error finding container fa35166f9ae41d56b2dd7d88c686cadaedb7d2768ccce60ce985a0aada8fd85c: Status 404 returned error can't find the container with id fa35166f9ae41d56b2dd7d88c686cadaedb7d2768ccce60ce985a0aada8fd85c
Jul 28 22:55:07.785841 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:07.785799    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx" event={"ID":"624451e0-7475-4187-9c88-0522188bdbe2","Type":"ContainerStarted","Data":"fa35166f9ae41d56b2dd7d88c686cadaedb7d2768ccce60ce985a0aada8fd85c"}
Jul 28 22:55:08.791783 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:08.791745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx" event={"ID":"624451e0-7475-4187-9c88-0522188bdbe2","Type":"ContainerStarted","Data":"bb75301a2285226f1220c7ef5767fc77c5e695459292bbf4e2d6d62d15ab264f"}
Jul 28 22:55:08.806775 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:08.806729    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx" podStartSLOduration=1.806714268 podStartE2EDuration="1.806714268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:55:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:55:08.805536247 +0000 UTC m=+3009.801124829" watchObservedRunningTime="2026-07-28 22:55:08.806714268 +0000 UTC m=+3009.802302827"
Jul 28 22:55:10.778820 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:10.778783    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:55:17.595692 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:17.595646    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:17.596136 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:17.595706    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:17.612121 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:17.612093    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:17.844697 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:17.844668    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:55:40.091632 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:40.091588    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:55:57.492944 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:55:57.492861    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:56:12.095652 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:12.095618    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:56:17.677692 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:17.677647    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"]
Jul 28 22:56:28.295662 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:28.295624    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:56:32.696623 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:32.696584    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx" podUID="624451e0-7475-4187-9c88-0522188bdbe2" containerName="main" containerID="cri-o://bb75301a2285226f1220c7ef5767fc77c5e695459292bbf4e2d6d62d15ab264f" gracePeriod=45
Jul 28 22:56:32.947691 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:32.947633    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:56:33.016712 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.016672    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv6w8\" (UniqueName: \"kubernetes.io/projected/624451e0-7475-4187-9c88-0522188bdbe2-kube-api-access-vv6w8\") pod \"624451e0-7475-4187-9c88-0522188bdbe2\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") "
Jul 28 22:56:33.016906 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.016740    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-model-cache\") pod \"624451e0-7475-4187-9c88-0522188bdbe2\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") "
Jul 28 22:56:33.016906 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.016789    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/624451e0-7475-4187-9c88-0522188bdbe2-tls-certs\") pod \"624451e0-7475-4187-9c88-0522188bdbe2\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") "
Jul 28 22:56:33.016906 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.016822    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-dshm\") pod \"624451e0-7475-4187-9c88-0522188bdbe2\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") "
Jul 28 22:56:33.016906 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.016888    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-home\") pod \"624451e0-7475-4187-9c88-0522188bdbe2\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") "
Jul 28 22:56:33.017136 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.016916    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-tmp-dir\") pod \"624451e0-7475-4187-9c88-0522188bdbe2\" (UID: \"624451e0-7475-4187-9c88-0522188bdbe2\") "
Jul 28 22:56:33.017136 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.017043    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-model-cache" (OuterVolumeSpecName: "model-cache") pod "624451e0-7475-4187-9c88-0522188bdbe2" (UID: "624451e0-7475-4187-9c88-0522188bdbe2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:56:33.017322 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.017259    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "624451e0-7475-4187-9c88-0522188bdbe2" (UID: "624451e0-7475-4187-9c88-0522188bdbe2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:56:33.017322 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.017277    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-home" (OuterVolumeSpecName: "home") pod "624451e0-7475-4187-9c88-0522188bdbe2" (UID: "624451e0-7475-4187-9c88-0522188bdbe2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:56:33.017469 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.017346    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-model-cache\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:56:33.019064 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.019043    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/624451e0-7475-4187-9c88-0522188bdbe2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "624451e0-7475-4187-9c88-0522188bdbe2" (UID: "624451e0-7475-4187-9c88-0522188bdbe2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:56:33.019171 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.019088    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-dshm" (OuterVolumeSpecName: "dshm") pod "624451e0-7475-4187-9c88-0522188bdbe2" (UID: "624451e0-7475-4187-9c88-0522188bdbe2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:56:33.019230 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.019187    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/624451e0-7475-4187-9c88-0522188bdbe2-kube-api-access-vv6w8" (OuterVolumeSpecName: "kube-api-access-vv6w8") pod "624451e0-7475-4187-9c88-0522188bdbe2" (UID: "624451e0-7475-4187-9c88-0522188bdbe2"). InnerVolumeSpecName "kube-api-access-vv6w8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:56:33.118631 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.118582    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/624451e0-7475-4187-9c88-0522188bdbe2-tls-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:56:33.118631 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.118624    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-dshm\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:56:33.118631 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.118633    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-home\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:56:33.118631 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.118641    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/624451e0-7475-4187-9c88-0522188bdbe2-tmp-dir\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:56:33.118631 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.118652    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv6w8\" (UniqueName: \"kubernetes.io/projected/624451e0-7475-4187-9c88-0522188bdbe2-kube-api-access-vv6w8\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:56:33.184779 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.184747    2564 generic.go:356] "Generic (PLEG): container finished" podID="624451e0-7475-4187-9c88-0522188bdbe2" containerID="bb75301a2285226f1220c7ef5767fc77c5e695459292bbf4e2d6d62d15ab264f" exitCode=0
Jul 28 22:56:33.184966 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.184789    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"
Jul 28 22:56:33.184966 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.184845    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx" event={"ID":"624451e0-7475-4187-9c88-0522188bdbe2","Type":"ContainerDied","Data":"bb75301a2285226f1220c7ef5767fc77c5e695459292bbf4e2d6d62d15ab264f"}
Jul 28 22:56:33.184966 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.184888    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx" event={"ID":"624451e0-7475-4187-9c88-0522188bdbe2","Type":"ContainerDied","Data":"fa35166f9ae41d56b2dd7d88c686cadaedb7d2768ccce60ce985a0aada8fd85c"}
Jul 28 22:56:33.184966 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.184906    2564 scope.go:117] "RemoveContainer" containerID="bb75301a2285226f1220c7ef5767fc77c5e695459292bbf4e2d6d62d15ab264f"
Jul 28 22:56:33.193706 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.193688    2564 scope.go:117] "RemoveContainer" containerID="bb75301a2285226f1220c7ef5767fc77c5e695459292bbf4e2d6d62d15ab264f"
Jul 28 22:56:33.193989 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:56:33.193970    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb75301a2285226f1220c7ef5767fc77c5e695459292bbf4e2d6d62d15ab264f\": container with ID starting with bb75301a2285226f1220c7ef5767fc77c5e695459292bbf4e2d6d62d15ab264f not found: ID does not exist" containerID="bb75301a2285226f1220c7ef5767fc77c5e695459292bbf4e2d6d62d15ab264f"
Jul 28 22:56:33.194061 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.193995    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb75301a2285226f1220c7ef5767fc77c5e695459292bbf4e2d6d62d15ab264f"} err="failed to get container status \"bb75301a2285226f1220c7ef5767fc77c5e695459292bbf4e2d6d62d15ab264f\": rpc error: code = NotFound desc = could not find container \"bb75301a2285226f1220c7ef5767fc77c5e695459292bbf4e2d6d62d15ab264f\": container with ID starting with bb75301a2285226f1220c7ef5767fc77c5e695459292bbf4e2d6d62d15ab264f not found: ID does not exist"
Jul 28 22:56:33.204329 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.204267    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"]
Jul 28 22:56:33.205793 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.205771    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/sub-test-model-aa2de7-kserve-f64985cb7-6gjcx"]
Jul 28 22:56:33.508642 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:33.508549    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="624451e0-7475-4187-9c88-0522188bdbe2" path="/var/lib/kubelet/pods/624451e0-7475-4187-9c88-0522188bdbe2/volumes"
Jul 28 22:56:34.766544 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.766506    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"]
Jul 28 22:56:34.767084 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.767064    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="624451e0-7475-4187-9c88-0522188bdbe2" containerName="main"
Jul 28 22:56:34.767166 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.767087    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="624451e0-7475-4187-9c88-0522188bdbe2" containerName="main"
Jul 28 22:56:34.767223 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.767174    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="624451e0-7475-4187-9c88-0522188bdbe2" containerName="main"
Jul 28 22:56:34.771961 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.771940    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.774958 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.774922    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3682ae\"/\"rate-test-model-3682ae-kserve-self-signed-certs\""
Jul 28 22:56:34.775102 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.774992    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3682ae\"/\"openshift-service-ca.crt\""
Jul 28 22:56:34.775102 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.774929    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3682ae\"/\"default-dockercfg-pn4x8\""
Jul 28 22:56:34.775646 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.775623    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3682ae\"/\"kube-root-ca.crt\""
Jul 28 22:56:34.778171 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.778147    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"]
Jul 28 22:56:34.837878 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.837852    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-tmp-dir\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.838016 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.837909    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxkr6\" (UniqueName: \"kubernetes.io/projected/c499ae33-8c4e-4131-a609-e506434245ff-kube-api-access-hxkr6\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.838016 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.837964    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-home\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.838016 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.838003    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-model-cache\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.838123 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.838019    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c499ae33-8c4e-4131-a609-e506434245ff-tls-certs\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.838123 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.838077    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-dshm\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.938702 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.938674    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-dshm\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.938908 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.938709    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-tmp-dir\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.938908 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.938753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxkr6\" (UniqueName: \"kubernetes.io/projected/c499ae33-8c4e-4131-a609-e506434245ff-kube-api-access-hxkr6\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.938908 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.938778    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-home\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.938908 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.938807    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-model-cache\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.939112 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.939085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c499ae33-8c4e-4131-a609-e506434245ff-tls-certs\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.939255 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.939228    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-tmp-dir\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.939335 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.939259    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-home\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.939335 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.939275    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-model-cache\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.941034 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.941012    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-dshm\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.941371 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.941355    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c499ae33-8c4e-4131-a609-e506434245ff-tls-certs\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:34.946269 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:34.946246    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxkr6\" (UniqueName: \"kubernetes.io/projected/c499ae33-8c4e-4131-a609-e506434245ff-kube-api-access-hxkr6\") pod \"rate-test-model-3682ae-kserve-864597b47-8kdkd\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") " pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:35.082354 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:35.082254    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:35.217777 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:35.217744    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"]
Jul 28 22:56:35.221443 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:56:35.221407    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc499ae33_8c4e_4131_a609_e506434245ff.slice/crio-0522bcfc775cfd1ebda1a6c8aea1aba671f5be9a2ac7eb028c21bde6d79db53a WatchSource:0}: Error finding container 0522bcfc775cfd1ebda1a6c8aea1aba671f5be9a2ac7eb028c21bde6d79db53a: Status 404 returned error can't find the container with id 0522bcfc775cfd1ebda1a6c8aea1aba671f5be9a2ac7eb028c21bde6d79db53a
Jul 28 22:56:36.204030 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:36.203986    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd" event={"ID":"c499ae33-8c4e-4131-a609-e506434245ff","Type":"ContainerStarted","Data":"f77c2e251ba40d5392112b458a7f3cd41bfeddc634fad191a9dbe05dd6621343"}
Jul 28 22:56:36.204504 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:36.204042    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd" event={"ID":"c499ae33-8c4e-4131-a609-e506434245ff","Type":"ContainerStarted","Data":"0522bcfc775cfd1ebda1a6c8aea1aba671f5be9a2ac7eb028c21bde6d79db53a"}
Jul 28 22:56:36.221004 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:36.220961    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd" podStartSLOduration=2.220945381 podStartE2EDuration="2.220945381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:56:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:56:36.21885164 +0000 UTC m=+3097.214440213" watchObservedRunningTime="2026-07-28 22:56:36.220945381 +0000 UTC m=+3097.216533963"
Jul 28 22:56:38.590467 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:38.590435    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:56:45.083084 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:45.083033    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:45.083084 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:45.083099    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:45.095284 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:45.095261    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:56:45.257970 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:56:45.257941    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:57:00.776304 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.776274    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"]
Jul 28 22:57:00.781022 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.781002    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.783814 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.783789    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa2de7\"/\"kube-root-ca.crt\""
Jul 28 22:57:00.783945 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.783789    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa2de7\"/\"rate-test-model-aa2de7-kserve-self-signed-certs\""
Jul 28 22:57:00.783945 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.783853    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-aa2de7\"/\"openshift-service-ca.crt\""
Jul 28 22:57:00.783945 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.783789    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-aa2de7\"/\"default-dockercfg-ch4mk\""
Jul 28 22:57:00.789508 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.789486    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"]
Jul 28 22:57:00.871199 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.871170    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-tmp-dir\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.871396 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.871211    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-dshm\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.871396 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.871234    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d903c5e0-3781-40ba-be2a-52493d26def3-tls-certs\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.871396 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.871339    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-model-cache\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.871578 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.871450    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq6js\" (UniqueName: \"kubernetes.io/projected/d903c5e0-3781-40ba-be2a-52493d26def3-kube-api-access-jq6js\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.871578 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.871512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-home\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.972220 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.972183    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-model-cache\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.972417 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.972294    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq6js\" (UniqueName: \"kubernetes.io/projected/d903c5e0-3781-40ba-be2a-52493d26def3-kube-api-access-jq6js\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.972417 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.972356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-home\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.972417 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.972384    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-tmp-dir\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.972591 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.972423    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-dshm\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.972591 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.972458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d903c5e0-3781-40ba-be2a-52493d26def3-tls-certs\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.972695 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.972589    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-model-cache\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.972695 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.972683    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-home\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.972808 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.972706    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-tmp-dir\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.974604 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.974578    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-dshm\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.974881 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.974864    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d903c5e0-3781-40ba-be2a-52493d26def3-tls-certs\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:00.979884 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:00.979866    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq6js\" (UniqueName: \"kubernetes.io/projected/d903c5e0-3781-40ba-be2a-52493d26def3-kube-api-access-jq6js\") pod \"rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") " pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:01.091597 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:01.091510    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:01.222144 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:01.222119    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"]
Jul 28 22:57:01.224592 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:57:01.224561    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd903c5e0_3781_40ba_be2a_52493d26def3.slice/crio-edb26a5527b189be3ffbb64618c501fe73f92fa19d0bacb8cad10a714c02f4f3 WatchSource:0}: Error finding container edb26a5527b189be3ffbb64618c501fe73f92fa19d0bacb8cad10a714c02f4f3: Status 404 returned error can't find the container with id edb26a5527b189be3ffbb64618c501fe73f92fa19d0bacb8cad10a714c02f4f3
Jul 28 22:57:01.320656 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:01.320623    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn" event={"ID":"d903c5e0-3781-40ba-be2a-52493d26def3","Type":"ContainerStarted","Data":"737a96302181c23b5ecab8affe1bd8ab7a2345ded173c0fc4e4bf41fae1ddac2"}
Jul 28 22:57:01.320656 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:01.320663    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn" event={"ID":"d903c5e0-3781-40ba-be2a-52493d26def3","Type":"ContainerStarted","Data":"edb26a5527b189be3ffbb64618c501fe73f92fa19d0bacb8cad10a714c02f4f3"}
Jul 28 22:57:01.338347 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:01.338288    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn" podStartSLOduration=1.338270726 podStartE2EDuration="1.338270726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:57:01.33777477 +0000 UTC m=+3122.333363369" watchObservedRunningTime="2026-07-28 22:57:01.338270726 +0000 UTC m=+3122.333859309"
Jul 28 22:57:04.400861 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:04.400819    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:57:11.092545 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:11.092510    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:11.092545 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:11.092555    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:11.104980 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:11.104955    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:11.377608 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:11.377581    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:57:41.290277 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:41.290186    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:57:55.591087 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:57:55.591054    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:58:09.489089 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:09.489055    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:58:13.492478 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:13.492446    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"]
Jul 28 22:58:14.300810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:14.300777    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"]
Jul 28 22:58:24.490693 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:24.490655    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:58:28.512032 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.511964    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd" podUID="c499ae33-8c4e-4131-a609-e506434245ff" containerName="main" containerID="cri-o://f77c2e251ba40d5392112b458a7f3cd41bfeddc634fad191a9dbe05dd6621343" gracePeriod=45
Jul 28 22:58:28.731800 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.731770    2564 generic.go:356] "Generic (PLEG): container finished" podID="c499ae33-8c4e-4131-a609-e506434245ff" containerID="f77c2e251ba40d5392112b458a7f3cd41bfeddc634fad191a9dbe05dd6621343" exitCode=0
Jul 28 22:58:28.731968 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.731819    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd" event={"ID":"c499ae33-8c4e-4131-a609-e506434245ff","Type":"ContainerDied","Data":"f77c2e251ba40d5392112b458a7f3cd41bfeddc634fad191a9dbe05dd6621343"}
Jul 28 22:58:28.754507 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.754484    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:58:28.817998 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.817917    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-model-cache\") pod \"c499ae33-8c4e-4131-a609-e506434245ff\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") "
Jul 28 22:58:28.818167 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.818001    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-dshm\") pod \"c499ae33-8c4e-4131-a609-e506434245ff\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") "
Jul 28 22:58:28.818167 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.818041    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-tmp-dir\") pod \"c499ae33-8c4e-4131-a609-e506434245ff\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") "
Jul 28 22:58:28.818167 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.818076    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-home\") pod \"c499ae33-8c4e-4131-a609-e506434245ff\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") "
Jul 28 22:58:28.818167 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.818111    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxkr6\" (UniqueName: \"kubernetes.io/projected/c499ae33-8c4e-4131-a609-e506434245ff-kube-api-access-hxkr6\") pod \"c499ae33-8c4e-4131-a609-e506434245ff\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") "
Jul 28 22:58:28.818404 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.818187    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c499ae33-8c4e-4131-a609-e506434245ff-tls-certs\") pod \"c499ae33-8c4e-4131-a609-e506434245ff\" (UID: \"c499ae33-8c4e-4131-a609-e506434245ff\") "
Jul 28 22:58:28.818404 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.818212    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-model-cache" (OuterVolumeSpecName: "model-cache") pod "c499ae33-8c4e-4131-a609-e506434245ff" (UID: "c499ae33-8c4e-4131-a609-e506434245ff"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:58:28.818404 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.818294    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c499ae33-8c4e-4131-a609-e506434245ff" (UID: "c499ae33-8c4e-4131-a609-e506434245ff"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:58:28.818404 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.818308    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-home" (OuterVolumeSpecName: "home") pod "c499ae33-8c4e-4131-a609-e506434245ff" (UID: "c499ae33-8c4e-4131-a609-e506434245ff"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:58:28.818579 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.818561    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-model-cache\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:58:28.818624 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.818585    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-tmp-dir\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:58:28.818624 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.818594    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-home\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:58:28.820337 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.820302    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c499ae33-8c4e-4131-a609-e506434245ff-kube-api-access-hxkr6" (OuterVolumeSpecName: "kube-api-access-hxkr6") pod "c499ae33-8c4e-4131-a609-e506434245ff" (UID: "c499ae33-8c4e-4131-a609-e506434245ff"). InnerVolumeSpecName "kube-api-access-hxkr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:58:28.820644 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.820627    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c499ae33-8c4e-4131-a609-e506434245ff-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c499ae33-8c4e-4131-a609-e506434245ff" (UID: "c499ae33-8c4e-4131-a609-e506434245ff"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:58:28.820644 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.820631    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-dshm" (OuterVolumeSpecName: "dshm") pod "c499ae33-8c4e-4131-a609-e506434245ff" (UID: "c499ae33-8c4e-4131-a609-e506434245ff"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:58:28.919848 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.919794    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxkr6\" (UniqueName: \"kubernetes.io/projected/c499ae33-8c4e-4131-a609-e506434245ff-kube-api-access-hxkr6\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:58:28.919848 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.919821    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c499ae33-8c4e-4131-a609-e506434245ff-tls-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:58:28.919848 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:28.919852    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c499ae33-8c4e-4131-a609-e506434245ff-dshm\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:58:29.320939 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.320893    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn" podUID="d903c5e0-3781-40ba-be2a-52493d26def3" containerName="main" containerID="cri-o://737a96302181c23b5ecab8affe1bd8ab7a2345ded173c0fc4e4bf41fae1ddac2" gracePeriod=45
Jul 28 22:58:29.570697 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.570670    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:58:29.727845 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.727803    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d903c5e0-3781-40ba-be2a-52493d26def3-tls-certs\") pod \"d903c5e0-3781-40ba-be2a-52493d26def3\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") "
Jul 28 22:58:29.728073 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.727869    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-tmp-dir\") pod \"d903c5e0-3781-40ba-be2a-52493d26def3\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") "
Jul 28 22:58:29.728073 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.727911    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-dshm\") pod \"d903c5e0-3781-40ba-be2a-52493d26def3\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") "
Jul 28 22:58:29.728073 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.727991    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-home\") pod \"d903c5e0-3781-40ba-be2a-52493d26def3\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") "
Jul 28 22:58:29.728073 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.728022    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq6js\" (UniqueName: \"kubernetes.io/projected/d903c5e0-3781-40ba-be2a-52493d26def3-kube-api-access-jq6js\") pod \"d903c5e0-3781-40ba-be2a-52493d26def3\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") "
Jul 28 22:58:29.728324 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.728095    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-model-cache\") pod \"d903c5e0-3781-40ba-be2a-52493d26def3\" (UID: \"d903c5e0-3781-40ba-be2a-52493d26def3\") "
Jul 28 22:58:29.728324 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.728109    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d903c5e0-3781-40ba-be2a-52493d26def3" (UID: "d903c5e0-3781-40ba-be2a-52493d26def3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:58:29.728324 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.728199    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-home" (OuterVolumeSpecName: "home") pod "d903c5e0-3781-40ba-be2a-52493d26def3" (UID: "d903c5e0-3781-40ba-be2a-52493d26def3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:58:29.728529 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.728409    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-model-cache" (OuterVolumeSpecName: "model-cache") pod "d903c5e0-3781-40ba-be2a-52493d26def3" (UID: "d903c5e0-3781-40ba-be2a-52493d26def3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:58:29.728529 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.728512    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-home\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:58:29.728621 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.728534    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-model-cache\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:58:29.728621 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.728574    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-tmp-dir\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:58:29.730191 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.730167    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-dshm" (OuterVolumeSpecName: "dshm") pod "d903c5e0-3781-40ba-be2a-52493d26def3" (UID: "d903c5e0-3781-40ba-be2a-52493d26def3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 22:58:29.730316 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.730200    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d903c5e0-3781-40ba-be2a-52493d26def3-kube-api-access-jq6js" (OuterVolumeSpecName: "kube-api-access-jq6js") pod "d903c5e0-3781-40ba-be2a-52493d26def3" (UID: "d903c5e0-3781-40ba-be2a-52493d26def3"). InnerVolumeSpecName "kube-api-access-jq6js". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 22:58:29.730316 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.730263    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d903c5e0-3781-40ba-be2a-52493d26def3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d903c5e0-3781-40ba-be2a-52493d26def3" (UID: "d903c5e0-3781-40ba-be2a-52493d26def3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 22:58:29.738046 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.738019    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd" event={"ID":"c499ae33-8c4e-4131-a609-e506434245ff","Type":"ContainerDied","Data":"0522bcfc775cfd1ebda1a6c8aea1aba671f5be9a2ac7eb028c21bde6d79db53a"}
Jul 28 22:58:29.738159 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.738046    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"
Jul 28 22:58:29.738159 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.738071    2564 scope.go:117] "RemoveContainer" containerID="f77c2e251ba40d5392112b458a7f3cd41bfeddc634fad191a9dbe05dd6621343"
Jul 28 22:58:29.739353 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.739332    2564 generic.go:356] "Generic (PLEG): container finished" podID="d903c5e0-3781-40ba-be2a-52493d26def3" containerID="737a96302181c23b5ecab8affe1bd8ab7a2345ded173c0fc4e4bf41fae1ddac2" exitCode=0
Jul 28 22:58:29.739439 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.739362    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn" event={"ID":"d903c5e0-3781-40ba-be2a-52493d26def3","Type":"ContainerDied","Data":"737a96302181c23b5ecab8affe1bd8ab7a2345ded173c0fc4e4bf41fae1ddac2"}
Jul 28 22:58:29.739439 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.739382    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"
Jul 28 22:58:29.739439 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.739394    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn" event={"ID":"d903c5e0-3781-40ba-be2a-52493d26def3","Type":"ContainerDied","Data":"edb26a5527b189be3ffbb64618c501fe73f92fa19d0bacb8cad10a714c02f4f3"}
Jul 28 22:58:29.752750 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.752730    2564 scope.go:117] "RemoveContainer" containerID="737a96302181c23b5ecab8affe1bd8ab7a2345ded173c0fc4e4bf41fae1ddac2"
Jul 28 22:58:29.760301 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.760285    2564 scope.go:117] "RemoveContainer" containerID="737a96302181c23b5ecab8affe1bd8ab7a2345ded173c0fc4e4bf41fae1ddac2"
Jul 28 22:58:29.760575 ip-10-0-134-211 kubenswrapper[2564]: E0728 22:58:29.760560    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"737a96302181c23b5ecab8affe1bd8ab7a2345ded173c0fc4e4bf41fae1ddac2\": container with ID starting with 737a96302181c23b5ecab8affe1bd8ab7a2345ded173c0fc4e4bf41fae1ddac2 not found: ID does not exist" containerID="737a96302181c23b5ecab8affe1bd8ab7a2345ded173c0fc4e4bf41fae1ddac2"
Jul 28 22:58:29.760619 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.760586    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737a96302181c23b5ecab8affe1bd8ab7a2345ded173c0fc4e4bf41fae1ddac2"} err="failed to get container status \"737a96302181c23b5ecab8affe1bd8ab7a2345ded173c0fc4e4bf41fae1ddac2\": rpc error: code = NotFound desc = could not find container \"737a96302181c23b5ecab8affe1bd8ab7a2345ded173c0fc4e4bf41fae1ddac2\": container with ID starting with 737a96302181c23b5ecab8affe1bd8ab7a2345ded173c0fc4e4bf41fae1ddac2 not found: ID does not exist"
Jul 28 22:58:29.761677 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.761659    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"]
Jul 28 22:58:29.764993 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.764973    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3682ae/rate-test-model-3682ae-kserve-864597b47-8kdkd"]
Jul 28 22:58:29.773333 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.773313    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"]
Jul 28 22:58:29.782067 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.782047    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-aa2de7/rate-test-model-aa2de7-kserve-5884fbd5f9-9pgdn"]
Jul 28 22:58:29.829891 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.829867    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d903c5e0-3781-40ba-be2a-52493d26def3-tls-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:58:29.829891 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.829888    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d903c5e0-3781-40ba-be2a-52493d26def3-dshm\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:58:29.830025 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:29.829897    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq6js\" (UniqueName: \"kubernetes.io/projected/d903c5e0-3781-40ba-be2a-52493d26def3-kube-api-access-jq6js\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 22:58:31.507674 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:31.507637    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c499ae33-8c4e-4131-a609-e506434245ff" path="/var/lib/kubelet/pods/c499ae33-8c4e-4131-a609-e506434245ff/volumes"
Jul 28 22:58:31.508081 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:31.508063    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d903c5e0-3781-40ba-be2a-52493d26def3" path="/var/lib/kubelet/pods/d903c5e0-3781-40ba-be2a-52493d26def3/volumes"
Jul 28 22:58:33.635351 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.635323    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"]
Jul 28 22:58:33.635737 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.635693    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d903c5e0-3781-40ba-be2a-52493d26def3" containerName="main"
Jul 28 22:58:33.635737 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.635706    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d903c5e0-3781-40ba-be2a-52493d26def3" containerName="main"
Jul 28 22:58:33.635737 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.635733    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c499ae33-8c4e-4131-a609-e506434245ff" containerName="main"
Jul 28 22:58:33.635737 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.635740    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c499ae33-8c4e-4131-a609-e506434245ff" containerName="main"
Jul 28 22:58:33.635899 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.635793    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c499ae33-8c4e-4131-a609-e506434245ff" containerName="main"
Jul 28 22:58:33.635899 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.635808    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d903c5e0-3781-40ba-be2a-52493d26def3" containerName="main"
Jul 28 22:58:33.640429 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.640413    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.644661 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.644641    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-ebba94-openshift-default-dockercfg-hk7bt\""
Jul 28 22:58:33.659766 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.659745    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"]
Jul 28 22:58:33.766092 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.766061    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-envoy\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.766272 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.766099    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-workload-socket\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.766272 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.766128    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-podinfo\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.766272 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.766214    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-credential-socket\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.766272 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.766247    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istiod-ca-cert\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.766432 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.766273    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfdzk\" (UniqueName: \"kubernetes.io/projected/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-kube-api-access-gfdzk\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.766432 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.766313    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-data\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.766432 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.766357    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-token\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.766432 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.766389    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-workload-certs\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.866990 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.866951    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-envoy\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.867173 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.866999    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-workload-socket\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.867173 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.867035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-podinfo\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.867173 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.867074    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-credential-socket\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.867173 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.867103    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istiod-ca-cert\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.867173 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.867133    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfdzk\" (UniqueName: \"kubernetes.io/projected/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-kube-api-access-gfdzk\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.867482 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.867457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-workload-socket\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.867482 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.867170    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-data\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.867605 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.867485    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-credential-socket\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.867605 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.867534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-token\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.867605 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.867586    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-workload-certs\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.867803 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.867782    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-data\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.867900 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.867882    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istiod-ca-cert\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.867968 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.867942    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-workload-certs\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.869307 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.869283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-envoy\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.869612 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.869591    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-podinfo\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.877922 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.877898    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfdzk\" (UniqueName: \"kubernetes.io/projected/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-kube-api-access-gfdzk\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.880686 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.880656    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-token\") pod \"e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") " pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:33.952019 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:33.951941    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:34.087960 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:34.087936    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"]
Jul 28 22:58:34.089565 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:58:34.089545    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f68618b_b86f_4d22_9bb1_f8df3844dcaf.slice/crio-a7ab7ffa1f8fb2276f69cd1930daf628b477a559b61a2917c20aa235300a6c63 WatchSource:0}: Error finding container a7ab7ffa1f8fb2276f69cd1930daf628b477a559b61a2917c20aa235300a6c63: Status 404 returned error can't find the container with id a7ab7ffa1f8fb2276f69cd1930daf628b477a559b61a2917c20aa235300a6c63
Jul 28 22:58:34.091653 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:34.091623    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:58:34.091760 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:34.091697    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:58:34.091760 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:34.091740    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:58:34.767239 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:34.767198    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk" event={"ID":"4f68618b-b86f-4d22-9bb1-f8df3844dcaf","Type":"ContainerStarted","Data":"163ddf6ed6df91cef198ed4ea7ccd94706a92155f09d79ec64a26af251018e56"}
Jul 28 22:58:34.767664 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:34.767248    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk" event={"ID":"4f68618b-b86f-4d22-9bb1-f8df3844dcaf","Type":"ContainerStarted","Data":"a7ab7ffa1f8fb2276f69cd1930daf628b477a559b61a2917c20aa235300a6c63"}
Jul 28 22:58:34.785527 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:34.785476    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk" podStartSLOduration=1.785460025 podStartE2EDuration="1.785460025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:58:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:58:34.784050734 +0000 UTC m=+3215.779639316" watchObservedRunningTime="2026-07-28 22:58:34.785460025 +0000 UTC m=+3215.781048598"
Jul 28 22:58:34.952172 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:34.952140    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:35.957964 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:35.957936    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:36.775852 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:36.775806    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:36.776798 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:36.776774    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:45.094448 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:45.094416    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:58:52.817064 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:52.816967    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 22:58:52.817064 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:52.817054    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk" podUID="4f68618b-b86f-4d22-9bb1-f8df3844dcaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 22:58:53.866787 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:53.866751    2564 generic.go:356] "Generic (PLEG): container finished" podID="4f68618b-b86f-4d22-9bb1-f8df3844dcaf" containerID="163ddf6ed6df91cef198ed4ea7ccd94706a92155f09d79ec64a26af251018e56" exitCode=0
Jul 28 22:58:53.867350 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:53.866824    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk" event={"ID":"4f68618b-b86f-4d22-9bb1-f8df3844dcaf","Type":"ContainerDied","Data":"163ddf6ed6df91cef198ed4ea7ccd94706a92155f09d79ec64a26af251018e56"}
Jul 28 22:58:53.867350 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:53.867249    2564 scope.go:117] "RemoveContainer" containerID="163ddf6ed6df91cef198ed4ea7ccd94706a92155f09d79ec64a26af251018e56"
Jul 28 22:58:53.868321 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:53.868295    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:58:53.868403 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:53.868361    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:58:53.868403 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:53.868392    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:58:54.872992 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:54.872953    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk" event={"ID":"4f68618b-b86f-4d22-9bb1-f8df3844dcaf","Type":"ContainerStarted","Data":"0ba55033325fc9f35fcbaa3fa3d6b871dcc9d2736ee2beec5cb4562de166fbac"}
Jul 28 22:58:54.952842 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:54.952805    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:54.953074 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:54.953048    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 28 22:58:54.953122 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:54.953101    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk" podUID="4f68618b-b86f-4d22-9bb1-f8df3844dcaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 28 22:58:55.952583 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:55.952546    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 28 22:58:55.953087 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:55.952610    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk" podUID="4f68618b-b86f-4d22-9bb1-f8df3844dcaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 28 22:58:56.953056 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:56.953018    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 28 22:58:56.953543 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:56.953078    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk" podUID="4f68618b-b86f-4d22-9bb1-f8df3844dcaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 28 22:58:57.952620 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:57.952583    2564 patch_prober.go:28] interesting pod/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 28 22:58:57.952810 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:57.952642    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk" podUID="4f68618b-b86f-4d22-9bb1-f8df3844dcaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 28 22:58:58.955916 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:58.955888    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:58.956357 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:58.956164    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:58:58.956821 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:58:58.956801    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 22:59:02.751500 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.751461    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"]
Jul 28 22:59:02.757093 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.757072    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.758984 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.758965    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-908e19-openshift-default-dockercfg-wfbkl\""
Jul 28 22:59:02.767963 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.767790    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"]
Jul 28 22:59:02.844893 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.844852    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-workload-socket\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.844893 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.844896    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-workload-certs\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.845128 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.844917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b32f6126-9cc7-47c9-b234-13091a3bd97c-istiod-ca-cert\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.845128 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.844986    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvhn8\" (UniqueName: \"kubernetes.io/projected/b32f6126-9cc7-47c9-b234-13091a3bd97c-kube-api-access-tvhn8\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.845128 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.845018    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-data\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.845128 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.845072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-token\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.845128 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.845092    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-envoy\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.845407 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.845139    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-podinfo\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.845407 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.845165    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-credential-socket\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.945817 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.945781    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-workload-certs\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.945817 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.945818    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b32f6126-9cc7-47c9-b234-13091a3bd97c-istiod-ca-cert\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.946055 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.945882    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvhn8\" (UniqueName: \"kubernetes.io/projected/b32f6126-9cc7-47c9-b234-13091a3bd97c-kube-api-access-tvhn8\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.946055 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.945914    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-data\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.946055 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.945976    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-token\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.946055 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.946006    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-envoy\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.946275 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.946077    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-podinfo\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.946275 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.946125    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-credential-socket\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.946275 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.946159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-workload-socket\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.946275 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.946210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-workload-certs\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.946491 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.946287    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-data\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.946491 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.946455    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-workload-socket\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.946598 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.946524    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-credential-socket\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.946598 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.946584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b32f6126-9cc7-47c9-b234-13091a3bd97c-istiod-ca-cert\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.948433 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.948411    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-envoy\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.948658 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.948638    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-podinfo\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.953693 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.953666    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-token\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:02.954023 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:02.954002    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvhn8\" (UniqueName: \"kubernetes.io/projected/b32f6126-9cc7-47c9-b234-13091a3bd97c-kube-api-access-tvhn8\") pod \"e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") " pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:03.071714 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:03.071624    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:03.208267 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:03.208239    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"]
Jul 28 22:59:03.210464 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:59:03.210426    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb32f6126_9cc7_47c9_b234_13091a3bd97c.slice/crio-24fc7db1d900b9dc192ee0914630b49b3717faae58f70715bba7c2aed70f6011 WatchSource:0}: Error finding container 24fc7db1d900b9dc192ee0914630b49b3717faae58f70715bba7c2aed70f6011: Status 404 returned error can't find the container with id 24fc7db1d900b9dc192ee0914630b49b3717faae58f70715bba7c2aed70f6011
Jul 28 22:59:03.212703 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:03.212672    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:59:03.212812 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:03.212750    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:59:03.212812 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:03.212796    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:59:03.915453 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:03.915422    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz" event={"ID":"b32f6126-9cc7-47c9-b234-13091a3bd97c","Type":"ContainerStarted","Data":"02aeaba13524cb7987a01093c529e667dfd5c8aeca93fd0d91184d8504521032"}
Jul 28 22:59:03.915871 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:03.915478    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz" event={"ID":"b32f6126-9cc7-47c9-b234-13091a3bd97c","Type":"ContainerStarted","Data":"24fc7db1d900b9dc192ee0914630b49b3717faae58f70715bba7c2aed70f6011"}
Jul 28 22:59:03.948517 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:03.948457    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz" podStartSLOduration=1.948437215 podStartE2EDuration="1.948437215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:59:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:59:03.947668107 +0000 UTC m=+3244.943256689" watchObservedRunningTime="2026-07-28 22:59:03.948437215 +0000 UTC m=+3244.944025792"
Jul 28 22:59:04.071961 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:04.071928    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:04.076791 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:04.076766    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:04.920976 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:04.920943    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:04.921910 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:04.921890    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:16.284108 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:16.284070    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:59:25.014252 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:25.014217    2564 generic.go:356] "Generic (PLEG): container finished" podID="b32f6126-9cc7-47c9-b234-13091a3bd97c" containerID="02aeaba13524cb7987a01093c529e667dfd5c8aeca93fd0d91184d8504521032" exitCode=0
Jul 28 22:59:25.014680 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:25.014291    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz" event={"ID":"b32f6126-9cc7-47c9-b234-13091a3bd97c","Type":"ContainerDied","Data":"02aeaba13524cb7987a01093c529e667dfd5c8aeca93fd0d91184d8504521032"}
Jul 28 22:59:25.014755 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:25.014737    2564 scope.go:117] "RemoveContainer" containerID="02aeaba13524cb7987a01093c529e667dfd5c8aeca93fd0d91184d8504521032"
Jul 28 22:59:25.015864 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:25.015818    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:59:25.015930 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:25.015916    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:59:25.015976 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:25.015948    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 22:59:26.025012 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:26.024971    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz" event={"ID":"b32f6126-9cc7-47c9-b234-13091a3bd97c","Type":"ContainerStarted","Data":"bbd5ec9d82b41e67349f8ed1cafadba9952b2ad0ad55efc87cc7f5ae85c8e64c"}
Jul 28 22:59:26.071923 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:26.071892    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:26.072184 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:26.072161    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 28 22:59:26.072242 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:26.072223    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz" podUID="b32f6126-9cc7-47c9-b234-13091a3bd97c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 28 22:59:27.072538 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:27.072502    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 28 22:59:27.072952 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:27.072556    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz" podUID="b32f6126-9cc7-47c9-b234-13091a3bd97c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 28 22:59:28.072232 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:28.072197    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 28 22:59:28.072433 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:28.072251    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz" podUID="b32f6126-9cc7-47c9-b234-13091a3bd97c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 28 22:59:29.072962 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:29.072932    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 28 22:59:29.073395 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:29.072996    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz" podUID="b32f6126-9cc7-47c9-b234-13091a3bd97c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 28 22:59:30.075577 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:30.075548    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:30.076052 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:30.075856    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:30.076548 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:30.076532    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 22:59:43.276097 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.276062    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"]
Jul 28 22:59:43.279240 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.279221    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.281092 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.281076    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-ebba94\"/\"kube-root-ca.crt\""
Jul 28 22:59:43.281589 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.281569    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-ebba94\"/\"default-dockercfg-nt8l8\""
Jul 28 22:59:43.281652 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.281614    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-ebba94\"/\"openshift-service-ca.crt\""
Jul 28 22:59:43.281702 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.281680    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-ebba94\"/\"ipp-route-ebba94-kserve-self-signed-certs\""
Jul 28 22:59:43.289212 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.289191    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"]
Jul 28 22:59:43.364599 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.364570    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-dshm\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.364599 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.364601    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-home\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.364804 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.364623    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppm77\" (UniqueName: \"kubernetes.io/projected/a62af738-8d66-42a8-8577-462f744ab398-kube-api-access-ppm77\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.364804 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.364732    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-model-cache\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.364804 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.364760    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-tmp-dir\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.364804 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.364799    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a62af738-8d66-42a8-8577-462f744ab398-tls-certs\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.465387 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.465352    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-dshm\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.465387 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.465385    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-home\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.465645 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.465401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppm77\" (UniqueName: \"kubernetes.io/projected/a62af738-8d66-42a8-8577-462f744ab398-kube-api-access-ppm77\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.465645 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.465437    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-model-cache\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.465645 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.465454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-tmp-dir\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.465645 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.465489    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a62af738-8d66-42a8-8577-462f744ab398-tls-certs\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.465899 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.465751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-home\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.465899 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.465822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-model-cache\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.466025 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.465950    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-tmp-dir\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.467661 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.467634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-dshm\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.468001 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.467985    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a62af738-8d66-42a8-8577-462f744ab398-tls-certs\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.472924 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.472904    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppm77\" (UniqueName: \"kubernetes.io/projected/a62af738-8d66-42a8-8577-462f744ab398-kube-api-access-ppm77\") pod \"ipp-route-ebba94-kserve-68b766b86c-8pcsl\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") " pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.589472 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.589394    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:43.734176 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:43.732747    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"]
Jul 28 22:59:43.736808 ip-10-0-134-211 kubenswrapper[2564]: W0728 22:59:43.736775    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda62af738_8d66_42a8_8577_462f744ab398.slice/crio-c4f158f3f64d7c1c67e6106b8802c8ae64fdd0ed844be4da9007dec27ffef92a WatchSource:0}: Error finding container c4f158f3f64d7c1c67e6106b8802c8ae64fdd0ed844be4da9007dec27ffef92a: Status 404 returned error can't find the container with id c4f158f3f64d7c1c67e6106b8802c8ae64fdd0ed844be4da9007dec27ffef92a
Jul 28 22:59:44.116774 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:44.116733    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl" event={"ID":"a62af738-8d66-42a8-8577-462f744ab398","Type":"ContainerStarted","Data":"da7a13761f5b4861d5deed1e82f022dec5dc802fbfef5602a0cff1fd95f32830"}
Jul 28 22:59:44.116978 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:44.116783    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl" event={"ID":"a62af738-8d66-42a8-8577-462f744ab398","Type":"ContainerStarted","Data":"c4f158f3f64d7c1c67e6106b8802c8ae64fdd0ed844be4da9007dec27ffef92a"}
Jul 28 22:59:44.142125 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:44.142077    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl" podStartSLOduration=1.142061767 podStartE2EDuration="1.142061767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 22:59:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 22:59:44.140113458 +0000 UTC m=+3285.135702053" watchObservedRunningTime="2026-07-28 22:59:44.142061767 +0000 UTC m=+3285.137650368"
Jul 28 22:59:47.306686 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:47.306650    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 22:59:53.590007 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:53.589957    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:53.590007 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:53.590011    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:53.602717 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:53.602691    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:54.178015 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:54.177985    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 22:59:59.660208 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:59.660183    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 22:59:59.696289 ip-10-0-134-211 kubenswrapper[2564]: I0728 22:59:59.696262    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-srsbn_fe27dde5-04ae-4d2f-9cd4-6e75c4832dca/ovn-acl-logging/0.log"
Jul 28 23:00:18.199303 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:00:18.199267    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 23:00:54.988637 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:00:54.988596    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 23:01:15.794958 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:15.794925    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 23:01:34.493003 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:34.492970    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 23:01:39.508514 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:39.508488    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"]
Jul 28 23:01:45.407871 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:45.407820    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 23:01:54.530971 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.530862    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl" podUID="a62af738-8d66-42a8-8577-462f744ab398" containerName="main" containerID="cri-o://da7a13761f5b4861d5deed1e82f022dec5dc802fbfef5602a0cff1fd95f32830" gracePeriod=45
Jul 28 23:01:54.771490 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.771452    2564 generic.go:356] "Generic (PLEG): container finished" podID="a62af738-8d66-42a8-8577-462f744ab398" containerID="da7a13761f5b4861d5deed1e82f022dec5dc802fbfef5602a0cff1fd95f32830" exitCode=0
Jul 28 23:01:54.771637 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.771520    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl" event={"ID":"a62af738-8d66-42a8-8577-462f744ab398","Type":"ContainerDied","Data":"da7a13761f5b4861d5deed1e82f022dec5dc802fbfef5602a0cff1fd95f32830"}
Jul 28 23:01:54.771637 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.771562    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl" event={"ID":"a62af738-8d66-42a8-8577-462f744ab398","Type":"ContainerDied","Data":"c4f158f3f64d7c1c67e6106b8802c8ae64fdd0ed844be4da9007dec27ffef92a"}
Jul 28 23:01:54.771637 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.771578    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4f158f3f64d7c1c67e6106b8802c8ae64fdd0ed844be4da9007dec27ffef92a"
Jul 28 23:01:54.782716 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.782654    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 23:01:54.861307 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.861272    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppm77\" (UniqueName: \"kubernetes.io/projected/a62af738-8d66-42a8-8577-462f744ab398-kube-api-access-ppm77\") pod \"a62af738-8d66-42a8-8577-462f744ab398\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") "
Jul 28 23:01:54.861489 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.861325    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-tmp-dir\") pod \"a62af738-8d66-42a8-8577-462f744ab398\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") "
Jul 28 23:01:54.861489 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.861475    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a62af738-8d66-42a8-8577-462f744ab398-tls-certs\") pod \"a62af738-8d66-42a8-8577-462f744ab398\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") "
Jul 28 23:01:54.861575 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.861501    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-dshm\") pod \"a62af738-8d66-42a8-8577-462f744ab398\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") "
Jul 28 23:01:54.861575 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.861535    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-model-cache\") pod \"a62af738-8d66-42a8-8577-462f744ab398\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") "
Jul 28 23:01:54.861693 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.861586    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-home\") pod \"a62af738-8d66-42a8-8577-462f744ab398\" (UID: \"a62af738-8d66-42a8-8577-462f744ab398\") "
Jul 28 23:01:54.861693 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.861593    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a62af738-8d66-42a8-8577-462f744ab398" (UID: "a62af738-8d66-42a8-8577-462f744ab398"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:01:54.861822 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.861796    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-model-cache" (OuterVolumeSpecName: "model-cache") pod "a62af738-8d66-42a8-8577-462f744ab398" (UID: "a62af738-8d66-42a8-8577-462f744ab398"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:01:54.861905 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.861882    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-home" (OuterVolumeSpecName: "home") pod "a62af738-8d66-42a8-8577-462f744ab398" (UID: "a62af738-8d66-42a8-8577-462f744ab398"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:01:54.861978 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.861961    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-model-cache\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:01:54.862017 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.861981    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-home\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:01:54.862017 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.861990    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-tmp-dir\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:01:54.863701 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.863678    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-dshm" (OuterVolumeSpecName: "dshm") pod "a62af738-8d66-42a8-8577-462f744ab398" (UID: "a62af738-8d66-42a8-8577-462f744ab398"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:01:54.863701 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.863701    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a62af738-8d66-42a8-8577-462f744ab398-kube-api-access-ppm77" (OuterVolumeSpecName: "kube-api-access-ppm77") pod "a62af738-8d66-42a8-8577-462f744ab398" (UID: "a62af738-8d66-42a8-8577-462f744ab398"). InnerVolumeSpecName "kube-api-access-ppm77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 23:01:54.863864 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.863715    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a62af738-8d66-42a8-8577-462f744ab398-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a62af738-8d66-42a8-8577-462f744ab398" (UID: "a62af738-8d66-42a8-8577-462f744ab398"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 23:01:54.963349 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.963313    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a62af738-8d66-42a8-8577-462f744ab398-tls-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:01:54.963349 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.963344    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a62af738-8d66-42a8-8577-462f744ab398-dshm\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:01:54.963349 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:54.963353    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppm77\" (UniqueName: \"kubernetes.io/projected/a62af738-8d66-42a8-8577-462f744ab398-kube-api-access-ppm77\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:01:55.776387 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:55.776307    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"
Jul 28 23:01:55.790661 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:55.790620    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"]
Jul 28 23:01:55.793646 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:55.793609    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-ebba94/ipp-route-ebba94-kserve-68b766b86c-8pcsl"]
Jul 28 23:01:57.509188 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:01:57.509152    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a62af738-8d66-42a8-8577-462f744ab398" path="/var/lib/kubelet/pods/a62af738-8d66-42a8-8577-462f744ab398/volumes"
Jul 28 23:02:23.540528 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:23.540483    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"]
Jul 28 23:02:23.541056 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:23.540721    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk" podUID="4f68618b-b86f-4d22-9bb1-f8df3844dcaf" containerName="istio-proxy" containerID="cri-o://0ba55033325fc9f35fcbaa3fa3d6b871dcc9d2736ee2beec5cb4562de166fbac" gracePeriod=30
Jul 28 23:02:28.803879 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.803802    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 23:02:28.934128 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.934098    2564 generic.go:356] "Generic (PLEG): container finished" podID="4f68618b-b86f-4d22-9bb1-f8df3844dcaf" containerID="0ba55033325fc9f35fcbaa3fa3d6b871dcc9d2736ee2beec5cb4562de166fbac" exitCode=0
Jul 28 23:02:28.934279 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.934148    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"
Jul 28 23:02:28.934279 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.934172    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk" event={"ID":"4f68618b-b86f-4d22-9bb1-f8df3844dcaf","Type":"ContainerDied","Data":"0ba55033325fc9f35fcbaa3fa3d6b871dcc9d2736ee2beec5cb4562de166fbac"}
Jul 28 23:02:28.934279 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.934213    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk" event={"ID":"4f68618b-b86f-4d22-9bb1-f8df3844dcaf","Type":"ContainerDied","Data":"a7ab7ffa1f8fb2276f69cd1930daf628b477a559b61a2917c20aa235300a6c63"}
Jul 28 23:02:28.934279 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.934233    2564 scope.go:117] "RemoveContainer" containerID="0ba55033325fc9f35fcbaa3fa3d6b871dcc9d2736ee2beec5cb4562de166fbac"
Jul 28 23:02:28.942838 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.942806    2564 scope.go:117] "RemoveContainer" containerID="163ddf6ed6df91cef198ed4ea7ccd94706a92155f09d79ec64a26af251018e56"
Jul 28 23:02:28.950456 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.950442    2564 scope.go:117] "RemoveContainer" containerID="0ba55033325fc9f35fcbaa3fa3d6b871dcc9d2736ee2beec5cb4562de166fbac"
Jul 28 23:02:28.950681 ip-10-0-134-211 kubenswrapper[2564]: E0728 23:02:28.950662    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ba55033325fc9f35fcbaa3fa3d6b871dcc9d2736ee2beec5cb4562de166fbac\": container with ID starting with 0ba55033325fc9f35fcbaa3fa3d6b871dcc9d2736ee2beec5cb4562de166fbac not found: ID does not exist" containerID="0ba55033325fc9f35fcbaa3fa3d6b871dcc9d2736ee2beec5cb4562de166fbac"
Jul 28 23:02:28.950733 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.950688    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba55033325fc9f35fcbaa3fa3d6b871dcc9d2736ee2beec5cb4562de166fbac"} err="failed to get container status \"0ba55033325fc9f35fcbaa3fa3d6b871dcc9d2736ee2beec5cb4562de166fbac\": rpc error: code = NotFound desc = could not find container \"0ba55033325fc9f35fcbaa3fa3d6b871dcc9d2736ee2beec5cb4562de166fbac\": container with ID starting with 0ba55033325fc9f35fcbaa3fa3d6b871dcc9d2736ee2beec5cb4562de166fbac not found: ID does not exist"
Jul 28 23:02:28.950733 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.950704    2564 scope.go:117] "RemoveContainer" containerID="163ddf6ed6df91cef198ed4ea7ccd94706a92155f09d79ec64a26af251018e56"
Jul 28 23:02:28.950943 ip-10-0-134-211 kubenswrapper[2564]: E0728 23:02:28.950925    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"163ddf6ed6df91cef198ed4ea7ccd94706a92155f09d79ec64a26af251018e56\": container with ID starting with 163ddf6ed6df91cef198ed4ea7ccd94706a92155f09d79ec64a26af251018e56 not found: ID does not exist" containerID="163ddf6ed6df91cef198ed4ea7ccd94706a92155f09d79ec64a26af251018e56"
Jul 28 23:02:28.951003 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.950952    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"163ddf6ed6df91cef198ed4ea7ccd94706a92155f09d79ec64a26af251018e56"} err="failed to get container status \"163ddf6ed6df91cef198ed4ea7ccd94706a92155f09d79ec64a26af251018e56\": rpc error: code = NotFound desc = could not find container \"163ddf6ed6df91cef198ed4ea7ccd94706a92155f09d79ec64a26af251018e56\": container with ID starting with 163ddf6ed6df91cef198ed4ea7ccd94706a92155f09d79ec64a26af251018e56 not found: ID does not exist"
Jul 28 23:02:28.977260 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.977238    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-workload-socket\") pod \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") "
Jul 28 23:02:28.977344 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.977287    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-workload-certs\") pod \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") "
Jul 28 23:02:28.977344 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.977331    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-credential-socket\") pod \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") "
Jul 28 23:02:28.977428 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.977362    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-envoy\") pod \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") "
Jul 28 23:02:28.977428 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.977417    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istiod-ca-cert\") pod \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") "
Jul 28 23:02:28.977510 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.977472    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4f68618b-b86f-4d22-9bb1-f8df3844dcaf" (UID: "4f68618b-b86f-4d22-9bb1-f8df3844dcaf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:02:28.977510 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.977478    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-token\") pod \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") "
Jul 28 23:02:28.977617 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.977583    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-data\") pod \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") "
Jul 28 23:02:28.977672 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.977620    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-podinfo\") pod \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") "
Jul 28 23:02:28.977672 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.977622    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4f68618b-b86f-4d22-9bb1-f8df3844dcaf" (UID: "4f68618b-b86f-4d22-9bb1-f8df3844dcaf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:02:28.977672 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.977632    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4f68618b-b86f-4d22-9bb1-f8df3844dcaf" (UID: "4f68618b-b86f-4d22-9bb1-f8df3844dcaf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:02:28.977672 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.977664    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfdzk\" (UniqueName: \"kubernetes.io/projected/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-kube-api-access-gfdzk\") pod \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\" (UID: \"4f68618b-b86f-4d22-9bb1-f8df3844dcaf\") "
Jul 28 23:02:28.977925 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.977847    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4f68618b-b86f-4d22-9bb1-f8df3844dcaf" (UID: "4f68618b-b86f-4d22-9bb1-f8df3844dcaf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 23:02:28.978074 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.978051    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-workload-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:28.978074 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.978075    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-workload-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:28.978242 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.978088    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-credential-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:28.978242 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.978100    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istiod-ca-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:28.978428 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.978407    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-data" (OuterVolumeSpecName: "istio-data") pod "4f68618b-b86f-4d22-9bb1-f8df3844dcaf" (UID: "4f68618b-b86f-4d22-9bb1-f8df3844dcaf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:02:28.979518 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.979492    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f68618b-b86f-4d22-9bb1-f8df3844dcaf" (UID: "4f68618b-b86f-4d22-9bb1-f8df3844dcaf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 23:02:28.979651 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.979632    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4f68618b-b86f-4d22-9bb1-f8df3844dcaf" (UID: "4f68618b-b86f-4d22-9bb1-f8df3844dcaf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 23:02:28.979912 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.979894    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-kube-api-access-gfdzk" (OuterVolumeSpecName: "kube-api-access-gfdzk") pod "4f68618b-b86f-4d22-9bb1-f8df3844dcaf" (UID: "4f68618b-b86f-4d22-9bb1-f8df3844dcaf"). InnerVolumeSpecName "kube-api-access-gfdzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 23:02:28.980014 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:28.980000    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4f68618b-b86f-4d22-9bb1-f8df3844dcaf" (UID: "4f68618b-b86f-4d22-9bb1-f8df3844dcaf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:02:29.079616 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:29.079542    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-token\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:29.079616 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:29.079574    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-data\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:29.079616 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:29.079587    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-podinfo\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:29.079616 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:29.079599    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfdzk\" (UniqueName: \"kubernetes.io/projected/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-kube-api-access-gfdzk\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:29.079616 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:29.079611    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f68618b-b86f-4d22-9bb1-f8df3844dcaf-istio-envoy\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:29.255155 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:29.255124    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"]
Jul 28 23:02:29.258402 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:29.258379    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-ebba94-openshift-default-6d5475864d-v4rzk"]
Jul 28 23:02:29.507867 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:29.507818    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f68618b-b86f-4d22-9bb1-f8df3844dcaf" path="/var/lib/kubelet/pods/4f68618b-b86f-4d22-9bb1-f8df3844dcaf/volumes"
Jul 28 23:02:33.100443 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:33.100411    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 23:02:36.919984 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:36.919943    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"]
Jul 28 23:02:36.920458 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:36.920219    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz" podUID="b32f6126-9cc7-47c9-b234-13091a3bd97c" containerName="istio-proxy" containerID="cri-o://bbd5ec9d82b41e67349f8ed1cafadba9952b2ad0ad55efc87cc7f5ae85c8e64c" gracePeriod=30
Jul 28 23:02:42.167711 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.167686    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 23:02:42.201313 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.201242    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-envoy\") pod \"b32f6126-9cc7-47c9-b234-13091a3bd97c\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") "
Jul 28 23:02:42.201313 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.201276    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-credential-socket\") pod \"b32f6126-9cc7-47c9-b234-13091a3bd97c\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") "
Jul 28 23:02:42.201471 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.201341    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b32f6126-9cc7-47c9-b234-13091a3bd97c-istiod-ca-cert\") pod \"b32f6126-9cc7-47c9-b234-13091a3bd97c\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") "
Jul 28 23:02:42.201471 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.201376    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-podinfo\") pod \"b32f6126-9cc7-47c9-b234-13091a3bd97c\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") "
Jul 28 23:02:42.201471 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.201404    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-workload-certs\") pod \"b32f6126-9cc7-47c9-b234-13091a3bd97c\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") "
Jul 28 23:02:42.201471 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.201445    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-data\") pod \"b32f6126-9cc7-47c9-b234-13091a3bd97c\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") "
Jul 28 23:02:42.201678 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.201474    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvhn8\" (UniqueName: \"kubernetes.io/projected/b32f6126-9cc7-47c9-b234-13091a3bd97c-kube-api-access-tvhn8\") pod \"b32f6126-9cc7-47c9-b234-13091a3bd97c\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") "
Jul 28 23:02:42.201678 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.201496    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-token\") pod \"b32f6126-9cc7-47c9-b234-13091a3bd97c\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") "
Jul 28 23:02:42.201678 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.201578    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-workload-socket\") pod \"b32f6126-9cc7-47c9-b234-13091a3bd97c\" (UID: \"b32f6126-9cc7-47c9-b234-13091a3bd97c\") "
Jul 28 23:02:42.201678 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.201620    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b32f6126-9cc7-47c9-b234-13091a3bd97c" (UID: "b32f6126-9cc7-47c9-b234-13091a3bd97c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:02:42.201969 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.201816    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b32f6126-9cc7-47c9-b234-13091a3bd97c" (UID: "b32f6126-9cc7-47c9-b234-13091a3bd97c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:02:42.202037 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.201971    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-credential-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:42.202037 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.201990    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-workload-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:42.202142 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.202103    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b32f6126-9cc7-47c9-b234-13091a3bd97c" (UID: "b32f6126-9cc7-47c9-b234-13091a3bd97c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:02:42.202276 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.202258    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b32f6126-9cc7-47c9-b234-13091a3bd97c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b32f6126-9cc7-47c9-b234-13091a3bd97c" (UID: "b32f6126-9cc7-47c9-b234-13091a3bd97c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 23:02:42.202619 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.202591    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-data" (OuterVolumeSpecName: "istio-data") pod "b32f6126-9cc7-47c9-b234-13091a3bd97c" (UID: "b32f6126-9cc7-47c9-b234-13091a3bd97c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:02:42.203503 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.203474    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b32f6126-9cc7-47c9-b234-13091a3bd97c" (UID: "b32f6126-9cc7-47c9-b234-13091a3bd97c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:02:42.203901 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.203876    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b32f6126-9cc7-47c9-b234-13091a3bd97c" (UID: "b32f6126-9cc7-47c9-b234-13091a3bd97c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 23:02:42.204114 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.204087    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b32f6126-9cc7-47c9-b234-13091a3bd97c-kube-api-access-tvhn8" (OuterVolumeSpecName: "kube-api-access-tvhn8") pod "b32f6126-9cc7-47c9-b234-13091a3bd97c" (UID: "b32f6126-9cc7-47c9-b234-13091a3bd97c"). InnerVolumeSpecName "kube-api-access-tvhn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 23:02:42.204189 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.204093    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-token" (OuterVolumeSpecName: "istio-token") pod "b32f6126-9cc7-47c9-b234-13091a3bd97c" (UID: "b32f6126-9cc7-47c9-b234-13091a3bd97c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 23:02:42.302672 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.302648    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b32f6126-9cc7-47c9-b234-13091a3bd97c-istiod-ca-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:42.302672 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.302669    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-podinfo\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:42.302820 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.302678    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-data\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:42.302820 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.302687    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvhn8\" (UniqueName: \"kubernetes.io/projected/b32f6126-9cc7-47c9-b234-13091a3bd97c-kube-api-access-tvhn8\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:42.302820 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.302696    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-token\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:42.302820 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.302704    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-workload-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:42.302820 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:42.302712    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b32f6126-9cc7-47c9-b234-13091a3bd97c-istio-envoy\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:43.009458 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:43.009426    2564 generic.go:356] "Generic (PLEG): container finished" podID="b32f6126-9cc7-47c9-b234-13091a3bd97c" containerID="bbd5ec9d82b41e67349f8ed1cafadba9952b2ad0ad55efc87cc7f5ae85c8e64c" exitCode=0
Jul 28 23:02:43.009630 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:43.009467    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz" event={"ID":"b32f6126-9cc7-47c9-b234-13091a3bd97c","Type":"ContainerDied","Data":"bbd5ec9d82b41e67349f8ed1cafadba9952b2ad0ad55efc87cc7f5ae85c8e64c"}
Jul 28 23:02:43.009630 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:43.009483    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"
Jul 28 23:02:43.009630 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:43.009533    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz" event={"ID":"b32f6126-9cc7-47c9-b234-13091a3bd97c","Type":"ContainerDied","Data":"24fc7db1d900b9dc192ee0914630b49b3717faae58f70715bba7c2aed70f6011"}
Jul 28 23:02:43.009630 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:43.009564    2564 scope.go:117] "RemoveContainer" containerID="bbd5ec9d82b41e67349f8ed1cafadba9952b2ad0ad55efc87cc7f5ae85c8e64c"
Jul 28 23:02:43.018708 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:43.018695    2564 scope.go:117] "RemoveContainer" containerID="02aeaba13524cb7987a01093c529e667dfd5c8aeca93fd0d91184d8504521032"
Jul 28 23:02:43.026285 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:43.026267    2564 scope.go:117] "RemoveContainer" containerID="bbd5ec9d82b41e67349f8ed1cafadba9952b2ad0ad55efc87cc7f5ae85c8e64c"
Jul 28 23:02:43.026532 ip-10-0-134-211 kubenswrapper[2564]: E0728 23:02:43.026514    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbd5ec9d82b41e67349f8ed1cafadba9952b2ad0ad55efc87cc7f5ae85c8e64c\": container with ID starting with bbd5ec9d82b41e67349f8ed1cafadba9952b2ad0ad55efc87cc7f5ae85c8e64c not found: ID does not exist" containerID="bbd5ec9d82b41e67349f8ed1cafadba9952b2ad0ad55efc87cc7f5ae85c8e64c"
Jul 28 23:02:43.026583 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:43.026541    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbd5ec9d82b41e67349f8ed1cafadba9952b2ad0ad55efc87cc7f5ae85c8e64c"} err="failed to get container status \"bbd5ec9d82b41e67349f8ed1cafadba9952b2ad0ad55efc87cc7f5ae85c8e64c\": rpc error: code = NotFound desc = could not find container \"bbd5ec9d82b41e67349f8ed1cafadba9952b2ad0ad55efc87cc7f5ae85c8e64c\": container with ID starting with bbd5ec9d82b41e67349f8ed1cafadba9952b2ad0ad55efc87cc7f5ae85c8e64c not found: ID does not exist"
Jul 28 23:02:43.026583 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:43.026559    2564 scope.go:117] "RemoveContainer" containerID="02aeaba13524cb7987a01093c529e667dfd5c8aeca93fd0d91184d8504521032"
Jul 28 23:02:43.026733 ip-10-0-134-211 kubenswrapper[2564]: E0728 23:02:43.026718    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02aeaba13524cb7987a01093c529e667dfd5c8aeca93fd0d91184d8504521032\": container with ID starting with 02aeaba13524cb7987a01093c529e667dfd5c8aeca93fd0d91184d8504521032 not found: ID does not exist" containerID="02aeaba13524cb7987a01093c529e667dfd5c8aeca93fd0d91184d8504521032"
Jul 28 23:02:43.026768 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:43.026739    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02aeaba13524cb7987a01093c529e667dfd5c8aeca93fd0d91184d8504521032"} err="failed to get container status \"02aeaba13524cb7987a01093c529e667dfd5c8aeca93fd0d91184d8504521032\": rpc error: code = NotFound desc = could not find container \"02aeaba13524cb7987a01093c529e667dfd5c8aeca93fd0d91184d8504521032\": container with ID starting with 02aeaba13524cb7987a01093c529e667dfd5c8aeca93fd0d91184d8504521032 not found: ID does not exist"
Jul 28 23:02:43.029946 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:43.029928    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"]
Jul 28 23:02:43.033798 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:43.033777    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-908e19-openshift-default-d48f4f556-98mlz"]
Jul 28 23:02:43.508398 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:43.508369    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b32f6126-9cc7-47c9-b234-13091a3bd97c" path="/var/lib/kubelet/pods/b32f6126-9cc7-47c9-b234-13091a3bd97c/volumes"
Jul 28 23:02:49.695083 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:49.695049    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 23:02:51.230822 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:51.230776    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"]
Jul 28 23:02:51.231306 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:51.231051    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn" podUID="47b6c5fa-f73f-4211-b488-4f00729fd2d4" containerName="istio-proxy" containerID="cri-o://fc852d8f39b1d79c6050afe7e2a4fdd62d7481f4551ae591b302815a60f5f10e" gracePeriod=30
Jul 28 23:02:56.485660 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.485634    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 23:02:56.632148 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632119    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-token\") pod \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") "
Jul 28 23:02:56.632329 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632160    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-credential-socket\") pod \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") "
Jul 28 23:02:56.632329 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632206    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-workload-socket\") pod \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") "
Jul 28 23:02:56.632329 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632230    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-podinfo\") pod \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") "
Jul 28 23:02:56.632329 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632268    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7576p\" (UniqueName: \"kubernetes.io/projected/47b6c5fa-f73f-4211-b488-4f00729fd2d4-kube-api-access-7576p\") pod \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") "
Jul 28 23:02:56.632329 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632298    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-envoy\") pod \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") "
Jul 28 23:02:56.632596 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632338    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-workload-certs\") pod \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") "
Jul 28 23:02:56.632596 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632353    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-data\") pod \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") "
Jul 28 23:02:56.632596 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632402    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istiod-ca-cert\") pod \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\" (UID: \"47b6c5fa-f73f-4211-b488-4f00729fd2d4\") "
Jul 28 23:02:56.632596 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632479    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "47b6c5fa-f73f-4211-b488-4f00729fd2d4" (UID: "47b6c5fa-f73f-4211-b488-4f00729fd2d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:02:56.632596 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632492    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "47b6c5fa-f73f-4211-b488-4f00729fd2d4" (UID: "47b6c5fa-f73f-4211-b488-4f00729fd2d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:02:56.632901 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632728    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "47b6c5fa-f73f-4211-b488-4f00729fd2d4" (UID: "47b6c5fa-f73f-4211-b488-4f00729fd2d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:02:56.632901 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632771    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "47b6c5fa-f73f-4211-b488-4f00729fd2d4" (UID: "47b6c5fa-f73f-4211-b488-4f00729fd2d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 23:02:56.632901 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632797    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-credential-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:56.632901 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632817    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-workload-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:56.632901 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.632863    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-workload-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:56.633528 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.633494    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-data" (OuterVolumeSpecName: "istio-data") pod "47b6c5fa-f73f-4211-b488-4f00729fd2d4" (UID: "47b6c5fa-f73f-4211-b488-4f00729fd2d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:02:56.634402 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.634368    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "47b6c5fa-f73f-4211-b488-4f00729fd2d4" (UID: "47b6c5fa-f73f-4211-b488-4f00729fd2d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:02:56.634402 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.634383    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-token" (OuterVolumeSpecName: "istio-token") pod "47b6c5fa-f73f-4211-b488-4f00729fd2d4" (UID: "47b6c5fa-f73f-4211-b488-4f00729fd2d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 23:02:56.634851 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.634447    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "47b6c5fa-f73f-4211-b488-4f00729fd2d4" (UID: "47b6c5fa-f73f-4211-b488-4f00729fd2d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 23:02:56.634851 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.634528    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47b6c5fa-f73f-4211-b488-4f00729fd2d4-kube-api-access-7576p" (OuterVolumeSpecName: "kube-api-access-7576p") pod "47b6c5fa-f73f-4211-b488-4f00729fd2d4" (UID: "47b6c5fa-f73f-4211-b488-4f00729fd2d4"). InnerVolumeSpecName "kube-api-access-7576p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 23:02:56.733809 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.733764    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istiod-ca-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:56.733809 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.733803    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-token\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:56.733809 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.733813    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-podinfo\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:56.734061 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.733820    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7576p\" (UniqueName: \"kubernetes.io/projected/47b6c5fa-f73f-4211-b488-4f00729fd2d4-kube-api-access-7576p\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:56.734061 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.733854    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-envoy\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:56.734061 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:56.733862    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47b6c5fa-f73f-4211-b488-4f00729fd2d4-istio-data\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:02:57.075939 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:57.075848    2564 generic.go:356] "Generic (PLEG): container finished" podID="47b6c5fa-f73f-4211-b488-4f00729fd2d4" containerID="fc852d8f39b1d79c6050afe7e2a4fdd62d7481f4551ae591b302815a60f5f10e" exitCode=0
Jul 28 23:02:57.075939 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:57.075901    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"
Jul 28 23:02:57.075939 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:57.075917    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn" event={"ID":"47b6c5fa-f73f-4211-b488-4f00729fd2d4","Type":"ContainerDied","Data":"fc852d8f39b1d79c6050afe7e2a4fdd62d7481f4551ae591b302815a60f5f10e"}
Jul 28 23:02:57.076155 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:57.075977    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn" event={"ID":"47b6c5fa-f73f-4211-b488-4f00729fd2d4","Type":"ContainerDied","Data":"ad79b5e511c88971e453b20e071d9fcbdbda2e50bbb1be6e99075db850c67f99"}
Jul 28 23:02:57.076155 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:57.076001    2564 scope.go:117] "RemoveContainer" containerID="fc852d8f39b1d79c6050afe7e2a4fdd62d7481f4551ae591b302815a60f5f10e"
Jul 28 23:02:57.085289 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:57.085272    2564 scope.go:117] "RemoveContainer" containerID="ec2aab184c1a7686d51b9aef8525125fe1fd2753b454fc9c549a5da303f93307"
Jul 28 23:02:57.093758 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:57.093677    2564 scope.go:117] "RemoveContainer" containerID="fc852d8f39b1d79c6050afe7e2a4fdd62d7481f4551ae591b302815a60f5f10e"
Jul 28 23:02:57.094102 ip-10-0-134-211 kubenswrapper[2564]: E0728 23:02:57.094069    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc852d8f39b1d79c6050afe7e2a4fdd62d7481f4551ae591b302815a60f5f10e\": container with ID starting with fc852d8f39b1d79c6050afe7e2a4fdd62d7481f4551ae591b302815a60f5f10e not found: ID does not exist" containerID="fc852d8f39b1d79c6050afe7e2a4fdd62d7481f4551ae591b302815a60f5f10e"
Jul 28 23:02:57.094206 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:57.094117    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc852d8f39b1d79c6050afe7e2a4fdd62d7481f4551ae591b302815a60f5f10e"} err="failed to get container status \"fc852d8f39b1d79c6050afe7e2a4fdd62d7481f4551ae591b302815a60f5f10e\": rpc error: code = NotFound desc = could not find container \"fc852d8f39b1d79c6050afe7e2a4fdd62d7481f4551ae591b302815a60f5f10e\": container with ID starting with fc852d8f39b1d79c6050afe7e2a4fdd62d7481f4551ae591b302815a60f5f10e not found: ID does not exist"
Jul 28 23:02:57.094206 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:57.094143    2564 scope.go:117] "RemoveContainer" containerID="ec2aab184c1a7686d51b9aef8525125fe1fd2753b454fc9c549a5da303f93307"
Jul 28 23:02:57.094519 ip-10-0-134-211 kubenswrapper[2564]: E0728 23:02:57.094486    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec2aab184c1a7686d51b9aef8525125fe1fd2753b454fc9c549a5da303f93307\": container with ID starting with ec2aab184c1a7686d51b9aef8525125fe1fd2753b454fc9c549a5da303f93307 not found: ID does not exist" containerID="ec2aab184c1a7686d51b9aef8525125fe1fd2753b454fc9c549a5da303f93307"
Jul 28 23:02:57.094604 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:57.094526    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec2aab184c1a7686d51b9aef8525125fe1fd2753b454fc9c549a5da303f93307"} err="failed to get container status \"ec2aab184c1a7686d51b9aef8525125fe1fd2753b454fc9c549a5da303f93307\": rpc error: code = NotFound desc = could not find container \"ec2aab184c1a7686d51b9aef8525125fe1fd2753b454fc9c549a5da303f93307\": container with ID starting with ec2aab184c1a7686d51b9aef8525125fe1fd2753b454fc9c549a5da303f93307 not found: ID does not exist"
Jul 28 23:02:57.098541 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:57.098339    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"]
Jul 28 23:02:57.111407 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:57.109879    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-3682ae-openshift-default-7d7d7668bd-6mnvn"]
Jul 28 23:02:57.508089 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:02:57.508058    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47b6c5fa-f73f-4211-b488-4f00729fd2d4" path="/var/lib/kubelet/pods/47b6c5fa-f73f-4211-b488-4f00729fd2d4/volumes"
Jul 28 23:03:01.391222 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:01.391188    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wtlnc"]
Jul 28 23:03:03.651791 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:03.651753    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"]
Jul 28 23:03:03.652206 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:03.652058    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8" podUID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" containerName="istio-proxy" containerID="cri-o://d37603e4c5eeab86d24931096f2bf2ce30f5e91cd7b65a4bf67c3f7503195923" gracePeriod=30
Jul 28 23:03:04.863196 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:04.863160    2564 patch_prober.go:28] interesting pod/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 23:03:04.863568 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:04.863218    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8" podUID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 23:03:08.922290 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:08.922230    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 23:03:09.040004 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.039971    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-credential-socket\") pod \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") "
Jul 28 23:03:09.040162 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040021    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-envoy\") pod \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") "
Jul 28 23:03:09.040162 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040049    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-workload-certs\") pod \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") "
Jul 28 23:03:09.040162 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040121    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-podinfo\") pod \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") "
Jul 28 23:03:09.040162 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040155    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istiod-ca-cert\") pod \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") "
Jul 28 23:03:09.040365 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040178    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-workload-socket\") pod \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") "
Jul 28 23:03:09.040365 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040220    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19ac99d1-7d5d-4011-900d-4ebbc77702cf" (UID: "19ac99d1-7d5d-4011-900d-4ebbc77702cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:03:09.040365 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040228    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-token\") pod \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") "
Jul 28 23:03:09.040365 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040303    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19ac99d1-7d5d-4011-900d-4ebbc77702cf" (UID: "19ac99d1-7d5d-4011-900d-4ebbc77702cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:03:09.040365 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040320    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp4v8\" (UniqueName: \"kubernetes.io/projected/19ac99d1-7d5d-4011-900d-4ebbc77702cf-kube-api-access-zp4v8\") pod \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") "
Jul 28 23:03:09.040365 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040349    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-data\") pod \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\" (UID: \"19ac99d1-7d5d-4011-900d-4ebbc77702cf\") "
Jul 28 23:03:09.040686 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040451    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19ac99d1-7d5d-4011-900d-4ebbc77702cf" (UID: "19ac99d1-7d5d-4011-900d-4ebbc77702cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:03:09.040686 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040559    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19ac99d1-7d5d-4011-900d-4ebbc77702cf" (UID: "19ac99d1-7d5d-4011-900d-4ebbc77702cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 23:03:09.040796 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040756    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istiod-ca-cert\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:03:09.040796 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040778    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-workload-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:03:09.040989 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040794    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-credential-socket\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:03:09.040989 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.040809    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-workload-certs\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:03:09.041431 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.041403    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-data" (OuterVolumeSpecName: "istio-data") pod "19ac99d1-7d5d-4011-900d-4ebbc77702cf" (UID: "19ac99d1-7d5d-4011-900d-4ebbc77702cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:03:09.042270 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.042250    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19ac99d1-7d5d-4011-900d-4ebbc77702cf" (UID: "19ac99d1-7d5d-4011-900d-4ebbc77702cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 23:03:09.042348 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.042315    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ac99d1-7d5d-4011-900d-4ebbc77702cf-kube-api-access-zp4v8" (OuterVolumeSpecName: "kube-api-access-zp4v8") pod "19ac99d1-7d5d-4011-900d-4ebbc77702cf" (UID: "19ac99d1-7d5d-4011-900d-4ebbc77702cf"). InnerVolumeSpecName "kube-api-access-zp4v8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 23:03:09.042546 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.042521    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-token" (OuterVolumeSpecName: "istio-token") pod "19ac99d1-7d5d-4011-900d-4ebbc77702cf" (UID: "19ac99d1-7d5d-4011-900d-4ebbc77702cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 23:03:09.042546 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.042537    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19ac99d1-7d5d-4011-900d-4ebbc77702cf" (UID: "19ac99d1-7d5d-4011-900d-4ebbc77702cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 23:03:09.133184 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.133155    2564 generic.go:356] "Generic (PLEG): container finished" podID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" containerID="d37603e4c5eeab86d24931096f2bf2ce30f5e91cd7b65a4bf67c3f7503195923" exitCode=0
Jul 28 23:03:09.133291 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.133194    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8" event={"ID":"19ac99d1-7d5d-4011-900d-4ebbc77702cf","Type":"ContainerDied","Data":"d37603e4c5eeab86d24931096f2bf2ce30f5e91cd7b65a4bf67c3f7503195923"}
Jul 28 23:03:09.133291 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.133210    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"
Jul 28 23:03:09.133291 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.133248    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8" event={"ID":"19ac99d1-7d5d-4011-900d-4ebbc77702cf","Type":"ContainerDied","Data":"40b5abc6093b81de5b9147efb1448bb2a4f7024b74d9d1d30b5d6d009d5f7304"}
Jul 28 23:03:09.133291 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.133278    2564 scope.go:117] "RemoveContainer" containerID="d37603e4c5eeab86d24931096f2bf2ce30f5e91cd7b65a4bf67c3f7503195923"
Jul 28 23:03:09.141406 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.141389    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-podinfo\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:03:09.141485 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.141408    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-token\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:03:09.141485 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.141418    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp4v8\" (UniqueName: \"kubernetes.io/projected/19ac99d1-7d5d-4011-900d-4ebbc77702cf-kube-api-access-zp4v8\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:03:09.141485 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.141427    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-data\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:03:09.141485 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.141435    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19ac99d1-7d5d-4011-900d-4ebbc77702cf-istio-envoy\") on node \"ip-10-0-134-211.ec2.internal\" DevicePath \"\""
Jul 28 23:03:09.141756 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.141742    2564 scope.go:117] "RemoveContainer" containerID="4aaf21fe7e658dfa37f287d16db0c5a3c4feaa292ddd4f96679162f31d20edfc"
Jul 28 23:03:09.149208 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.149191    2564 scope.go:117] "RemoveContainer" containerID="d37603e4c5eeab86d24931096f2bf2ce30f5e91cd7b65a4bf67c3f7503195923"
Jul 28 23:03:09.149448 ip-10-0-134-211 kubenswrapper[2564]: E0728 23:03:09.149427    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d37603e4c5eeab86d24931096f2bf2ce30f5e91cd7b65a4bf67c3f7503195923\": container with ID starting with d37603e4c5eeab86d24931096f2bf2ce30f5e91cd7b65a4bf67c3f7503195923 not found: ID does not exist" containerID="d37603e4c5eeab86d24931096f2bf2ce30f5e91cd7b65a4bf67c3f7503195923"
Jul 28 23:03:09.149500 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.149455    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d37603e4c5eeab86d24931096f2bf2ce30f5e91cd7b65a4bf67c3f7503195923"} err="failed to get container status \"d37603e4c5eeab86d24931096f2bf2ce30f5e91cd7b65a4bf67c3f7503195923\": rpc error: code = NotFound desc = could not find container \"d37603e4c5eeab86d24931096f2bf2ce30f5e91cd7b65a4bf67c3f7503195923\": container with ID starting with d37603e4c5eeab86d24931096f2bf2ce30f5e91cd7b65a4bf67c3f7503195923 not found: ID does not exist"
Jul 28 23:03:09.149500 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.149472    2564 scope.go:117] "RemoveContainer" containerID="4aaf21fe7e658dfa37f287d16db0c5a3c4feaa292ddd4f96679162f31d20edfc"
Jul 28 23:03:09.149687 ip-10-0-134-211 kubenswrapper[2564]: E0728 23:03:09.149668    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4aaf21fe7e658dfa37f287d16db0c5a3c4feaa292ddd4f96679162f31d20edfc\": container with ID starting with 4aaf21fe7e658dfa37f287d16db0c5a3c4feaa292ddd4f96679162f31d20edfc not found: ID does not exist" containerID="4aaf21fe7e658dfa37f287d16db0c5a3c4feaa292ddd4f96679162f31d20edfc"
Jul 28 23:03:09.149752 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.149697    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4aaf21fe7e658dfa37f287d16db0c5a3c4feaa292ddd4f96679162f31d20edfc"} err="failed to get container status \"4aaf21fe7e658dfa37f287d16db0c5a3c4feaa292ddd4f96679162f31d20edfc\": rpc error: code = NotFound desc = could not find container \"4aaf21fe7e658dfa37f287d16db0c5a3c4feaa292ddd4f96679162f31d20edfc\": container with ID starting with 4aaf21fe7e658dfa37f287d16db0c5a3c4feaa292ddd4f96679162f31d20edfc not found: ID does not exist"
Jul 28 23:03:09.153065 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.153044    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"]
Jul 28 23:03:09.156689 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.156668    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-aa2de7-openshift-default-789bfc7dd4-rs9z8"]
Jul 28 23:03:09.507507 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.507477    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" path="/var/lib/kubelet/pods/19ac99d1-7d5d-4011-900d-4ebbc77702cf/volumes"
Jul 28 23:03:09.948655 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:09.948626    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rkwww_b602404e-1aef-416c-ab11-99c20549b324/manager/0.log"
Jul 28 23:03:10.078797 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:10.078766    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-nsqf9_7f18a44c-ab99-4543-b19c-39e654f4dca0/manager/0.log"
Jul 28 23:03:10.735905 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:10.735876    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6974ffcb4c-dr965_5e2952ce-0018-4908-8d47-b0a441c86421/copy-manifests/0.log"
Jul 28 23:03:10.755623 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:10.755598    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6974ffcb4c-dr965_5e2952ce-0018-4908-8d47-b0a441c86421/manager/0.log"
Jul 28 23:03:13.297016 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:13.296988    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qlskb_d9b6bddd-d25b-48da-92a5-bce0f8df552e/manager/0.log"
Jul 28 23:03:13.759286 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:13.759261    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wtlnc_0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8/limitador/0.log"
Jul 28 23:03:13.885876 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:13.885846    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-v8c6t_df1bf9a1-8d53-439d-85f5-3542257fceb2/manager/0.log"
Jul 28 23:03:14.256772 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:14.256744    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799csnz9j_e04ffdad-4477-43df-9e3c-c2e535aa48e2/istio-proxy/0.log"
Jul 28 23:03:14.751072 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:14.751042    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-vvp5n_22cd99ff-18bb-41cf-a90c-41df4020b3a1/istio-proxy/1.log"
Jul 28 23:03:16.096567 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:16.096536    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-668ft_d91b65b5-3d5b-410e-a01c-28593a3cee55/main/0.log"
Jul 28 23:03:24.446636 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:24.446559    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t6bj4_d268c04e-d61a-493f-a465-5a048e4b815f/global-pull-secret-syncer/0.log"
Jul 28 23:03:24.540208 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:24.540172    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6xksh_8dd3e5d4-2a3a-4b2d-bb32-d88de52e28a4/konnectivity-agent/0.log"
Jul 28 23:03:24.646778 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:24.646748    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-211.ec2.internal_66c77808443d2cca2649284227dd8760/haproxy/0.log"
Jul 28 23:03:29.902163 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:29.902133    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qlskb_d9b6bddd-d25b-48da-92a5-bce0f8df552e/manager/0.log"
Jul 28 23:03:30.187925 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:30.187847    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wtlnc_0b285f1f-3f64-4ab6-ad8c-0b28e0e3b4a8/limitador/0.log"
Jul 28 23:03:30.297749 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:30.297723    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-v8c6t_df1bf9a1-8d53-439d-85f5-3542257fceb2/manager/0.log"
Jul 28 23:03:31.879064 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:31.878988    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fb90dc9-8abc-4a49-b28f-21f82cccc14f/alertmanager/0.log"
Jul 28 23:03:31.907004 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:31.906982    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fb90dc9-8abc-4a49-b28f-21f82cccc14f/config-reloader/0.log"
Jul 28 23:03:31.929434 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:31.929412    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fb90dc9-8abc-4a49-b28f-21f82cccc14f/kube-rbac-proxy-web/0.log"
Jul 28 23:03:31.952028 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:31.952007    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fb90dc9-8abc-4a49-b28f-21f82cccc14f/kube-rbac-proxy/0.log"
Jul 28 23:03:31.972883 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:31.972860    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fb90dc9-8abc-4a49-b28f-21f82cccc14f/kube-rbac-proxy-metric/0.log"
Jul 28 23:03:31.994337 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:31.994315    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fb90dc9-8abc-4a49-b28f-21f82cccc14f/prom-label-proxy/0.log"
Jul 28 23:03:32.020025 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:32.020005    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5fb90dc9-8abc-4a49-b28f-21f82cccc14f/init-config-reloader/0.log"
Jul 28 23:03:32.254105 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:32.254014    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d7bq6_60962d72-378f-4849-8ee9-12a0b8647cbc/node-exporter/0.log"
Jul 28 23:03:32.276265 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:32.276243    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d7bq6_60962d72-378f-4849-8ee9-12a0b8647cbc/kube-rbac-proxy/0.log"
Jul 28 23:03:32.297298 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:32.297277    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d7bq6_60962d72-378f-4849-8ee9-12a0b8647cbc/init-textfile/0.log"
Jul 28 23:03:32.584475 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:32.584373    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf81a6ad-d7ff-46bd-baa5-bc8c27441985/prometheus/0.log"
Jul 28 23:03:32.615866 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:32.615820    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf81a6ad-d7ff-46bd-baa5-bc8c27441985/config-reloader/0.log"
Jul 28 23:03:32.638292 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:32.638250    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf81a6ad-d7ff-46bd-baa5-bc8c27441985/thanos-sidecar/0.log"
Jul 28 23:03:32.665172 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:32.665152    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf81a6ad-d7ff-46bd-baa5-bc8c27441985/kube-rbac-proxy-web/0.log"
Jul 28 23:03:32.687363 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:32.687344    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf81a6ad-d7ff-46bd-baa5-bc8c27441985/kube-rbac-proxy/0.log"
Jul 28 23:03:32.709588 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:32.709571    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf81a6ad-d7ff-46bd-baa5-bc8c27441985/kube-rbac-proxy-thanos/0.log"
Jul 28 23:03:32.733283 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:32.733265    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf81a6ad-d7ff-46bd-baa5-bc8c27441985/init-config-reloader/0.log"
Jul 28 23:03:34.639863 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.639818    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"]
Jul 28 23:03:34.640321 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640291    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b32f6126-9cc7-47c9-b234-13091a3bd97c" containerName="istio-proxy"
Jul 28 23:03:34.640321 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640308    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b32f6126-9cc7-47c9-b234-13091a3bd97c" containerName="istio-proxy"
Jul 28 23:03:34.640446 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640334    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f68618b-b86f-4d22-9bb1-f8df3844dcaf" containerName="istio-proxy"
Jul 28 23:03:34.640446 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640343    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f68618b-b86f-4d22-9bb1-f8df3844dcaf" containerName="istio-proxy"
Jul 28 23:03:34.640446 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640368    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f68618b-b86f-4d22-9bb1-f8df3844dcaf" containerName="istio-proxy"
Jul 28 23:03:34.640446 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640376    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f68618b-b86f-4d22-9bb1-f8df3844dcaf" containerName="istio-proxy"
Jul 28 23:03:34.640446 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640390    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47b6c5fa-f73f-4211-b488-4f00729fd2d4" containerName="istio-proxy"
Jul 28 23:03:34.640446 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640400    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="47b6c5fa-f73f-4211-b488-4f00729fd2d4" containerName="istio-proxy"
Jul 28 23:03:34.640446 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640412    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a62af738-8d66-42a8-8577-462f744ab398" containerName="main"
Jul 28 23:03:34.640446 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640420    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a62af738-8d66-42a8-8577-462f744ab398" containerName="main"
Jul 28 23:03:34.640446 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640433    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47b6c5fa-f73f-4211-b488-4f00729fd2d4" containerName="istio-proxy"
Jul 28 23:03:34.640446 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640441    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="47b6c5fa-f73f-4211-b488-4f00729fd2d4" containerName="istio-proxy"
Jul 28 23:03:34.640944 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640451    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" containerName="istio-proxy"
Jul 28 23:03:34.640944 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640458    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" containerName="istio-proxy"
Jul 28 23:03:34.640944 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640470    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" containerName="istio-proxy"
Jul 28 23:03:34.640944 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640478    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" containerName="istio-proxy"
Jul 28 23:03:34.640944 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640558    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a62af738-8d66-42a8-8577-462f744ab398" containerName="main"
Jul 28 23:03:34.640944 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640570    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f68618b-b86f-4d22-9bb1-f8df3844dcaf" containerName="istio-proxy"
Jul 28 23:03:34.640944 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640580    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="47b6c5fa-f73f-4211-b488-4f00729fd2d4" containerName="istio-proxy"
Jul 28 23:03:34.640944 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640589    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f68618b-b86f-4d22-9bb1-f8df3844dcaf" containerName="istio-proxy"
Jul 28 23:03:34.640944 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640598    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b32f6126-9cc7-47c9-b234-13091a3bd97c" containerName="istio-proxy"
Jul 28 23:03:34.640944 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640606    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="47b6c5fa-f73f-4211-b488-4f00729fd2d4" containerName="istio-proxy"
Jul 28 23:03:34.640944 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640613    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" containerName="istio-proxy"
Jul 28 23:03:34.640944 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.640622    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="19ac99d1-7d5d-4011-900d-4ebbc77702cf" containerName="istio-proxy"
Jul 28 23:03:34.644037 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.644017    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.645700 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.645679    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x8jld\"/\"kube-root-ca.crt\""
Jul 28 23:03:34.645853 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.645822    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x8jld\"/\"openshift-service-ca.crt\""
Jul 28 23:03:34.646273 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.646239    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x8jld\"/\"default-dockercfg-jw6hm\""
Jul 28 23:03:34.649280 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.649259    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"]
Jul 28 23:03:34.759231 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.759197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc-sys\") pod \"perf-node-gather-daemonset-k7qp4\" (UID: \"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.759429 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.759254    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmzp6\" (UniqueName: \"kubernetes.io/projected/3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc-kube-api-access-gmzp6\") pod \"perf-node-gather-daemonset-k7qp4\" (UID: \"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.759429 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.759328    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc-podres\") pod \"perf-node-gather-daemonset-k7qp4\" (UID: \"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.759429 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.759382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc-proc\") pod \"perf-node-gather-daemonset-k7qp4\" (UID: \"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.759568 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.759434    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc-lib-modules\") pod \"perf-node-gather-daemonset-k7qp4\" (UID: \"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.860722 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.860688    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc-proc\") pod \"perf-node-gather-daemonset-k7qp4\" (UID: \"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.860903 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.860747    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc-lib-modules\") pod \"perf-node-gather-daemonset-k7qp4\" (UID: \"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.860903 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.860775    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc-sys\") pod \"perf-node-gather-daemonset-k7qp4\" (UID: \"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.860903 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.860812    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc-proc\") pod \"perf-node-gather-daemonset-k7qp4\" (UID: \"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.860903 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.860825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmzp6\" (UniqueName: \"kubernetes.io/projected/3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc-kube-api-access-gmzp6\") pod \"perf-node-gather-daemonset-k7qp4\" (UID: \"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.860903 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.860896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc-podres\") pod \"perf-node-gather-daemonset-k7qp4\" (UID: \"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.861122 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.860908    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc-sys\") pod \"perf-node-gather-daemonset-k7qp4\" (UID: \"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.861122 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.860955    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc-lib-modules\") pod \"perf-node-gather-daemonset-k7qp4\" (UID: \"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.861122 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.861002    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc-podres\") pod \"perf-node-gather-daemonset-k7qp4\" (UID: \"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.867933 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.867913    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmzp6\" (UniqueName: \"kubernetes.io/projected/3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc-kube-api-access-gmzp6\") pod \"perf-node-gather-daemonset-k7qp4\" (UID: \"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc\") " pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:34.954056 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:34.953955    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:35.079869 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:35.079811    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"]
Jul 28 23:03:35.082473 ip-10-0-134-211 kubenswrapper[2564]: W0728 23:03:35.082449    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3ddf9bae_1b20_46a6_aad5_8436ab6b1ccc.slice/crio-08024b10474531260fd7ff20db6b06e986f2378737487bcc7c92cc2aca36b871 WatchSource:0}: Error finding container 08024b10474531260fd7ff20db6b06e986f2378737487bcc7c92cc2aca36b871: Status 404 returned error can't find the container with id 08024b10474531260fd7ff20db6b06e986f2378737487bcc7c92cc2aca36b871
Jul 28 23:03:35.256029 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:35.256000    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4" event={"ID":"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc","Type":"ContainerStarted","Data":"974bdd3f9bd83d463384b56cbe33559cd72960d6277cd4ce0b434e4acd2a387c"}
Jul 28 23:03:35.256183 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:35.256054    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4" event={"ID":"3ddf9bae-1b20-46a6-aad5-8436ab6b1ccc","Type":"ContainerStarted","Data":"08024b10474531260fd7ff20db6b06e986f2378737487bcc7c92cc2aca36b871"}
Jul 28 23:03:35.256183 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:35.256132    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:35.269900 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:35.269854    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4" podStartSLOduration=1.269818265 podStartE2EDuration="1.269818265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 23:03:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 23:03:35.269119314 +0000 UTC m=+3516.264707895" watchObservedRunningTime="2026-07-28 23:03:35.269818265 +0000 UTC m=+3516.265406846"
Jul 28 23:03:35.501153 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:35.501085    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-g8777_4eae46d2-636c-4978-b970-d238535e0f06/download-server/0.log"
Jul 28 23:03:37.105376 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:37.105346    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qpdrd_7dca52ed-50f3-4956-b017-05aadb1710f7/dns/0.log"
Jul 28 23:03:37.131451 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:37.131431    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qpdrd_7dca52ed-50f3-4956-b017-05aadb1710f7/kube-rbac-proxy/0.log"
Jul 28 23:03:37.202720 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:37.202694    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dctt5_6824e8d1-ee18-41fb-aaa6-3a914506cef5/dns-node-resolver/0.log"
Jul 28 23:03:37.828373 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:37.828342    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jf2mm_04ea5950-65fd-407e-aadc-392852a3a0bc/node-ca/0.log"
Jul 28 23:03:38.762737 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:38.762709    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799csnz9j_e04ffdad-4477-43df-9e3c-c2e535aa48e2/istio-proxy/0.log"
Jul 28 23:03:38.981809 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:38.981777    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-vvp5n_22cd99ff-18bb-41cf-a90c-41df4020b3a1/istio-proxy/0.log"
Jul 28 23:03:39.033222 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:39.033137    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-vvp5n_22cd99ff-18bb-41cf-a90c-41df4020b3a1/istio-proxy/1.log"
Jul 28 23:03:39.950374 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:39.950322    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-scglc_ae3c4870-bae7-4e87-ba4d-7b2029bb84fd/serve-healthcheck-canary/0.log"
Jul 28 23:03:40.474745 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:40.474721    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6nj6n_2b0c1ef3-8729-490a-ab6c-4eda696fa58f/kube-rbac-proxy/0.log"
Jul 28 23:03:40.498213 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:40.498192    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6nj6n_2b0c1ef3-8729-490a-ab6c-4eda696fa58f/exporter/0.log"
Jul 28 23:03:40.521714 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:40.521692    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6nj6n_2b0c1ef3-8729-490a-ab6c-4eda696fa58f/extractor/0.log"
Jul 28 23:03:41.269787 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:41.269716    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x8jld/perf-node-gather-daemonset-k7qp4"
Jul 28 23:03:42.736319 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:42.736291    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rkwww_b602404e-1aef-416c-ab11-99c20549b324/manager/0.log"
Jul 28 23:03:43.126922 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:43.126891    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-nsqf9_7f18a44c-ab99-4543-b19c-39e654f4dca0/manager/0.log"
Jul 28 23:03:43.618025 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:43.617997    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6974ffcb4c-dr965_5e2952ce-0018-4908-8d47-b0a441c86421/manager/0.log"
Jul 28 23:03:43.635310 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:43.635285    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6974ffcb4c-dr965_5e2952ce-0018-4908-8d47-b0a441c86421/copy-manifests/0.log"
Jul 28 23:03:44.943419 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:44.943391    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799csnz9j_e04ffdad-4477-43df-9e3c-c2e535aa48e2/istio-proxy/0.log"
Jul 28 23:03:45.106018 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:45.105990    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75cf9697f-w9qht_c12a7e2e-5362-47bb-ac44-d5e4073fa403/manager/0.log"
Jul 28 23:03:45.123895 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:45.123860    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-vvp5n_22cd99ff-18bb-41cf-a90c-41df4020b3a1/istio-proxy/0.log"
Jul 28 23:03:45.172375 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:45.172351    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-vvp5n_22cd99ff-18bb-41cf-a90c-41df4020b3a1/istio-proxy/1.log"
Jul 28 23:03:46.670427 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:46.670403    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799csnz9j_e04ffdad-4477-43df-9e3c-c2e535aa48e2/istio-proxy/0.log"
Jul 28 23:03:46.864032 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:46.864007    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-vvp5n_22cd99ff-18bb-41cf-a90c-41df4020b3a1/istio-proxy/0.log"
Jul 28 23:03:46.913916 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:46.913866    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-vvp5n_22cd99ff-18bb-41cf-a90c-41df4020b3a1/istio-proxy/1.log"
Jul 28 23:03:51.884297 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:51.884266    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gdjkx_1ff19d47-9db7-4182-b0f8-42dea938de24/kube-multus-additional-cni-plugins/0.log"
Jul 28 23:03:51.905487 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:51.905465    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gdjkx_1ff19d47-9db7-4182-b0f8-42dea938de24/egress-router-binary-copy/0.log"
Jul 28 23:03:51.926399 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:51.926376    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gdjkx_1ff19d47-9db7-4182-b0f8-42dea938de24/cni-plugins/0.log"
Jul 28 23:03:51.947550 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:51.947526    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gdjkx_1ff19d47-9db7-4182-b0f8-42dea938de24/bond-cni-plugin/0.log"
Jul 28 23:03:51.971335 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:51.971315    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gdjkx_1ff19d47-9db7-4182-b0f8-42dea938de24/routeoverride-cni/0.log"
Jul 28 23:03:51.993035 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:51.993014    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gdjkx_1ff19d47-9db7-4182-b0f8-42dea938de24/whereabouts-cni-bincopy/0.log"
Jul 28 23:03:52.016804 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:52.016784    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gdjkx_1ff19d47-9db7-4182-b0f8-42dea938de24/whereabouts-cni/0.log"
Jul 28 23:03:52.059450 ip-10-0-134-211 kubenswrapper[2564]: I0728 23:03:52.059430    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nlh6l_f795de7c-7235-4dd8-b3bb-1893cb3fd386/kube-multus/0.log"