Jul 28 19:33:07.780146 ip-10-0-128-52 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 19:33:07.780176 ip-10-0-128-52 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 19:33:07.780183 ip-10-0-128-52 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 19:33:07.780420 ip-10-0-128-52 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 19:33:17.879743 ip-10-0-128-52 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 28 19:33:17.879761 ip-10-0-128-52 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8ecc3cf024954dd8901409a5aaeba12e --
Jul 28 19:35:14.850191 ip-10-0-128-52 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 19:35:15.302032 ip-10-0-128-52 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 19:35:15.302032 ip-10-0-128-52 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 19:35:15.302032 ip-10-0-128-52 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 19:35:15.302032 ip-10-0-128-52 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 19:35:15.302032 ip-10-0-128-52 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 19:35:15.303870 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.303786    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 19:35:15.308864 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.308829    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:35:15.308981 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.308927    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:35:15.308981 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.308938    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:35:15.308981 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.308943    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:35:15.308981 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.308948    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:35:15.308981 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.308952    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:35:15.308981 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.308958    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:35:15.308981 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.308963    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:35:15.308981 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.308967    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:35:15.308981 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.308972    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:35:15.308981 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.308976    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:35:15.308981 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.308983    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:35:15.308981 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.308988    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.308993    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309002    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309006    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309011    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309016    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309020    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309025    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309029    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309034    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309038    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309043    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309047    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309051    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309061    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309066    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309098    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309104    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309109    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309117    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:35:15.309429 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309125    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309130    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309137    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309142    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309147    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309152    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309163    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309167    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309172    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309176    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309180    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309185    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309189    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309193    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309199    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309203    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309208    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309212    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309217    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309226    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:35:15.309965 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309231    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309258    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309279    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309287    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309291    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309294    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309298    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309315    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309371    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309501    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309511    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309514    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309518    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309521    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309523    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309526    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309529    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309532    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309535    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309552    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:35:15.310448 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309556    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309558    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309561    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309564    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309567    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309570    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309573    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309575    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309578    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309581    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309583    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309586    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309588    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309595    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309600    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309603    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309606    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309609    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309611    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309614    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:35:15.310942 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309617    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309622    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309626    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309630    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309633    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309636    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.309640    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310376    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310383    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310387    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310390    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310393    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310396    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310399    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310402    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310405    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310408    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310410    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310414    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310416    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:35:15.311419 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310419    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310421    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310424    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310427    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310429    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310432    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310434    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310437    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310440    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310442    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310445    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310447    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310451    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310454    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310457    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310459    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310462    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310465    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310467    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310470    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:35:15.311917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310472    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310475    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310478    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310481    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310483    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310486    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310488    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310491    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310493    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310496    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310498    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310502    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310504    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310507    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310509    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310512    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310523    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310526    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310530    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:35:15.312442 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310533    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310553    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310557    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310559    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310562    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310570    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310574    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310577    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310579    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310582    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310587    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310590    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310594    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310597    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310599    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310602    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310605    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310608    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310610    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:35:15.312929 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310613    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310615    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310618    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310620    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310623    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310625    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310629    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310632    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310635    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310638    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310641    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310643    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310646    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310648    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310651    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310654    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310656    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310659    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310663    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310666    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:35:15.313384 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310668    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310671    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310673    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310676    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310678    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310681    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310683    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.310686    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311073    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311078    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311081    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311083    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311086    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311089    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311092    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311094    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311097    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311100    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311103    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311105    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:35:15.313890 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311108    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311110    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311114    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311116    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311118    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311121    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311124    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311126    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311129    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311131    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311134    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311136    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311139    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311141    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311144    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311147    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311149    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311151    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311154    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:35:15.314370 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311156    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311159    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311162    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311164    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311167    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311169    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311172    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311174    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311177    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311179    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311181    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311184    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311188    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311192    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311195    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311197    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311200    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311203    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311206    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:35:15.314844 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311208    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311211    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311214    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311216    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311219    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311221    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311224    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311227    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311229    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311232    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311235    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311238    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311240    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311242    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311245    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311247    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311250    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311253    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311255    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311257    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:35:15.315298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311260    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311262    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311265    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311267    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311270    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311272    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311281    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311285    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311288    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311291    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311294    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311296    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311299    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311302    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311305    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311308    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311311    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311314    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311316    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:35:15.315784 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311320    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311323    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311326    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311329    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311332    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311334    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311337    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311339    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311342    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.311344    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311415    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311422    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311451    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311456    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311460    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311463    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311467    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311471    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311474    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311479    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311483    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311486    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 19:35:15.316248 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311489    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311492    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311495    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311498    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311502    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311505    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311509    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311512    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311515    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311518    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311521    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311524    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311527    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311530    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311534    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311552    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311556    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311559    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311562    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311565    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311569    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311572    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311575    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311578    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311581    2563 flags.go:64] FLAG: --enable-server="true"
Jul 28 19:35:15.316783 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311584    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311589    2563 flags.go:64] FLAG: --event-burst="100"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311592    2563 flags.go:64] FLAG: --event-qps="50"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311595    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311600    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311603    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311607    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311609    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311613    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311616    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311619    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311622    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311625    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311629    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311632    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311635    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311637    2563 flags.go:64] FLAG: --feature-gates=""
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311641    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311644    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311647    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311650    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311653    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311656    2563 flags.go:64] FLAG: --help="false"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311659    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311662    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 19:35:15.317382 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311665    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311668    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311671    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311674    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311677    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311680    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311682    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311685    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311688    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311691    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311694    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311699    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311702    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311705    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311708    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311711    2563 flags.go:64] FLAG: --lock-file=""
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311714    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311716    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311719    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311727    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311731    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311734    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311737    2563 flags.go:64] FLAG: --logging-format="text"
Jul 28 19:35:15.318091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311740    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311743    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311746    2563 flags.go:64] FLAG: --manifest-url=""
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311749    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311753    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311756    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311760    2563 flags.go:64] FLAG: --max-pods="110"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311763    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311766    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311769    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311772    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311775    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311780    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311783    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311790    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311793    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311796    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311799    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311802    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311807    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311812    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311815    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311818    2563 flags.go:64] FLAG: --port="10250"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311821    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 19:35:15.318675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311824    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-028c0caa4c12fcadb"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311827    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311830    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311833    2563 flags.go:64] FLAG: --register-node="true"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311836    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311840    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311843    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311846    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311849    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311852    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311855    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311858    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311861    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311864    2563 flags.go:64] FLAG: --runonce="false"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311866    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311869    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311872    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311875    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311878    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311880    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311883    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311887    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311890    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311893    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311896    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311899    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 19:35:15.319262 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311902    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311905    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311909    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311914    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311917    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311920    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311924    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311927    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311930    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311933    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311936    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311939    2563 flags.go:64] FLAG: --v="2"
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311943    2563 flags.go:64] FLAG: --version="false"
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311947    2563 flags.go:64] FLAG: --vmodule=""
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311951    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.311954    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312069    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312073    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312077    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312080    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312083    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312085    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312088    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:35:15.319875 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312091    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312094    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312096    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312099    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312105    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312108    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312111    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312114    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312117    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312120    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312123    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312128    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312131    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312134    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312137    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312139    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312142    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312144    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312147    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:35:15.320418 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312150    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312153    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312155    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312158    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312161    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312164    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312166    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312169    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312172    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312174    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312178    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312182    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312185    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312188    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312190    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312193    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312195    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312199    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312202    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312205    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:35:15.320967 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312207    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312210    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312213    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312215    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312220    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312222    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312225    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312227    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312230    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312233    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312235    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312238    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312241    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312244    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312246    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312249    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312252    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312256    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312258    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:35:15.321484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312261    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312264    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312267    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312269    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312272    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312275    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312277    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312280    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312282    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312285    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312289    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312291    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312294    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312297    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312299    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312302    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312304    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312308    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312311    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312314    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:35:15.322039 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312317    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:35:15.322536 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312320    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:35:15.322536 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312322    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:35:15.322536 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312325    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:35:15.322536 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312327    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:35:15.322536 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312330    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:35:15.322536 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312333    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:35:15.322536 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312335    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:35:15.322536 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312338    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:35:15.322536 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312340    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:35:15.322536 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312343    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:35:15.322536 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312346    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:35:15.322536 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312349    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:35:15.322536 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.312351    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:35:15.322536 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.312357    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 19:35:15.322536 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.319259    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.319276    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.320344    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.320353    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320410    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320416    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320419    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320423    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320426    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320429    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320431    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320434    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320437    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320439    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320442    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320444    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320447    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320450    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320454    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320456    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:35:15.322917 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320459    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320462    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320464    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320467    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320469    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320472    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320475    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320479    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320482    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320485    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320488    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320491    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320494    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320500    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320503    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320506    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320509    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320512    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320514    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:35:15.323403 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320517    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320519    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320522    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320525    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320527    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320530    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320532    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320535    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320550    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320554    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320558    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320561    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320564    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320566    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320569    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320572    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320575    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320577    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320580    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:35:15.323922 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320584    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320588    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320592    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320595    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320598    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320601    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320604    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320607    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320610    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320613    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320615    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320618    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320621    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320624    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320626    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320629    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320631    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320634    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320636    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:35:15.324377 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320639    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320641    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320644    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320646    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320649    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320652    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320654    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320657    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320659    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320661    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320664    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320667    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320669    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320672    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320674    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320677    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320679    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320682    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320684    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320687    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:35:15.324900 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320689    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:35:15.325373 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320692    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:35:15.325373 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320695    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:35:15.325373 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320697    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:35:15.325373 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320700    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:35:15.325373 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320703    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:35:15.325373 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.320708    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 19:35:15.325373 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320823    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 19:35:15.325373 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320827    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 19:35:15.325373 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320830    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 19:35:15.325373 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320833    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 19:35:15.325373 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320836    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 19:35:15.325373 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320839    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 19:35:15.325373 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320841    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 19:35:15.325373 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320843    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 19:35:15.325373 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320847    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320849    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320852    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320854    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320857    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320859    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320862    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320864    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320867    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320869    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320872    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320874    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320877    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320879    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320881    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320884    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320887    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320889    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320892    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320894    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 19:35:15.325744 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320897    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320900    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320902    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320905    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320907    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320910    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320913    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320915    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320917    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320920    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320922    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320925    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320927    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320930    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320932    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320935    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320938    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320940    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320943    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320945    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 19:35:15.326220 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320948    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320951    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320953    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320956    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320958    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320960    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320963    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320965    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320968    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320971    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320974    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320977    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320979    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320983    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320986    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320990    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320993    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320996    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.320999    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321003    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 19:35:15.326704 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321006    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321008    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321011    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321014    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321016    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321018    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321021    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321023    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321026    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321029    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321033    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321035    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321039    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321042    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321044    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321047    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321050    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321053    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321056    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 19:35:15.327203 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321059    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 19:35:15.327738 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321061    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 19:35:15.327738 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321064    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 19:35:15.327738 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321067    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 19:35:15.327738 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321070    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 19:35:15.327738 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321072    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 19:35:15.327738 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321074    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 19:35:15.327738 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321077    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 19:35:15.327738 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321080    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 19:35:15.327738 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321083    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 19:35:15.327738 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321085    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 19:35:15.327738 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:15.321088    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 19:35:15.327738 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.321093    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 19:35:15.327738 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.321205    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 19:35:15.327738 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.323224    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 19:35:15.327738 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.324596    2563 server.go:1019] "Starting client certificate rotation"
Jul 28 19:35:15.328102 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.324693    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 19:35:15.328102 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.325490    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 19:35:15.328102 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.327053    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 19:35:15.328251 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.328235    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 19:35:15.339157 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.339141    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 28 19:35:15.341910 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.341886    2563 log.go:25] "Validated CRI v1 image API"
Jul 28 19:35:15.343315 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.343297    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 19:35:15.348246 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.348224    2563 fs.go:135] Filesystem UUIDs: map[27bc363b-e87c-4b13-88cb-bad5cf0acb84:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d175e4b5-bf71-48c0-94e4-7f2942df3197:/dev/nvme0n1p4]
Jul 28 19:35:15.348322 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.348245    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 19:35:15.353567 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.353450    2563 manager.go:216] Machine: {Timestamp:2026-07-28 19:35:15.352949629 +0000 UTC m=+0.375245211 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107194 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20897fa93540f91772ece45e2d1141 SystemUUID:ec20897f-a935-40f9-1772-ece45e2d1141 BootID:8ecc3cf0-2495-4dd8-9014-09a5aaeba12e Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7e:d8:d9:4d:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7e:d8:d9:4d:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:fb:68:34:77:ee Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 19:35:15.353567 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.353558    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 19:35:15.353739 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.353720    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 19:35:15.357731 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.357712    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 19:35:15.357792 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.357769    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 19:35:15.357950 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.357795    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-52.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 19:35:15.359095 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.359083    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 19:35:15.359139 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.359098    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 19:35:15.359139 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.359106    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 19:35:15.359927 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.359915    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 19:35:15.360738 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.360727    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 19:35:15.363202 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.363190    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 19:35:15.363323 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.363313    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 19:35:15.363355 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.363345    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 19:35:15.363355 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.363354    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 19:35:15.363415 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.363374    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 19:35:15.363415 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.363384    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 28 19:35:15.363415 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.363393    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 19:35:15.363818 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.363805    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 19:35:15.363861 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.363827    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 19:35:15.366468 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.366453    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 19:35:15.368527 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.368511    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 19:35:15.368581 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.368544    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 19:35:15.372732 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.372718    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 19:35:15.372732 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.372736    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 19:35:15.372839 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.372746    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 19:35:15.372839 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.372756    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 19:35:15.372839 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.372769    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 19:35:15.372839 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.372779    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 19:35:15.372839 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.372792    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 19:35:15.372839 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.372798    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 19:35:15.372839 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.372805    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 19:35:15.372839 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.372810    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 19:35:15.372839 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.372821    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 19:35:15.372839 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.372827    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 19:35:15.373131 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.372922    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-52.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 19:35:15.373131 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.372924    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 19:35:15.373680 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.373668    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 19:35:15.373728 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.373682    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 19:35:15.377165 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.377152    2563 server.go:1268] "Started kubelet"
Jul 28 19:35:15.377385 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.377342    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 19:35:15.377564 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.377321    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 19:35:15.377564 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.377533    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 19:35:15.378025 ip-10-0-128-52 systemd[1]: Started Kubernetes Kubelet.
Jul 28 19:35:15.379270 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.379219    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 19:35:15.384645 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.384623    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 19:35:15.384964 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.384939    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dvcdd"
Jul 28 19:35:15.385752 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.385717    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 19:35:15.388017 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.387998    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-52.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 19:35:15.388870 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.387825    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-52.ec2.internal.18c68b2a222b2383  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-52.ec2.internal,UID:ip-10-0-128-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-52.ec2.internal,},FirstTimestamp:2026-07-28 19:35:15.377120131 +0000 UTC m=+0.399415713,LastTimestamp:2026-07-28 19:35:15.377120131 +0000 UTC m=+0.399415713,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-52.ec2.internal,}"
Jul 28 19:35:15.390282 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.390256    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 19:35:15.390390 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.390257    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 19:35:15.390444 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.390423    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:15.390994 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.390938    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dvcdd"
Jul 28 19:35:15.391170 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.391148    2563 factory.go:55] Registering systemd factory
Jul 28 19:35:15.391170 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.391170    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 28 19:35:15.391319 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.391300    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 19:35:15.391319 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.391314    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 19:35:15.391407 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.391300    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 19:35:15.391452 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.391435    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 19:35:15.391452 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.391444    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 19:35:15.391452 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.391449    2563 factory.go:153] Registering CRI-O factory
Jul 28 19:35:15.391670 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.391507    2563 factory.go:223] Registration of the crio container factory successfully
Jul 28 19:35:15.391670 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.391575    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 19:35:15.391670 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.391596    2563 factory.go:103] Registering Raw factory
Jul 28 19:35:15.391670 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.391612    2563 manager.go:1196] Started watching for new ooms in manager
Jul 28 19:35:15.392011 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.391995    2563 manager.go:349] Starting recovery of all containers
Jul 28 19:35:15.399049 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.399028    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:35:15.401864 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.401813    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-52.ec2.internal\" not found" node="ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.403810 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.403795    2563 manager.go:354] Recovery completed
Jul 28 19:35:15.410643 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.410611    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:35:15.412627 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.412595    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:35:15.412702 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.412647    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:35:15.412702 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.412665    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:35:15.413298 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.413283    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 19:35:15.413298 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.413297    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 19:35:15.413425 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.413314    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 19:35:15.413425 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.413367    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:35:15.414164 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.414141    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:35:15.414244 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.414178    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:35:15.414244 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.414193    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:35:15.415038 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.415025    2563 policy_none.go:49] "None policy: Start"
Jul 28 19:35:15.415077 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.415041    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 19:35:15.415077 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.415053    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 19:35:15.416073 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.416061    2563 policy_none.go:47] "Start"
Jul 28 19:35:15.458364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.458202    2563 manager.go:337] "Starting Device Plugin manager"
Jul 28 19:35:15.458471 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.458389    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 19:35:15.458471 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.458403    2563 server.go:87] "Starting device plugin registration server"
Jul 28 19:35:15.458665 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.458652    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 19:35:15.458722 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.458666    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 19:35:15.458796 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.458777    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 19:35:15.458884 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.458867    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 19:35:15.458884 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.458882    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 19:35:15.459481 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.459456    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 19:35:15.459573 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.459520    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:15.558832 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.558759    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:35:15.561386 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.561368    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:35:15.561495 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.561409    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:35:15.561495 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.561426    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:35:15.561495 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.561465    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.571636 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.571611    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.571636 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.571636    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-52.ec2.internal\": node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:15.595995 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.595974    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:15.596354 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.596328    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 19:35:15.597651 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.597632    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 19:35:15.597744 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.597670    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 19:35:15.597744 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.597690    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 19:35:15.597744 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.597722    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 19:35:15.600788 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.600768    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:35:15.696846 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.696796    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:15.697980 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.697955    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal"]
Jul 28 19:35:15.698041 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.698031    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:35:15.699052 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.699033    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:35:15.699164 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.699073    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:35:15.699164 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.699091    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:35:15.700680 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.700667    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:35:15.700826 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.700806    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.700874 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.700837    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:35:15.702035 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.702017    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:35:15.702120 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.702049    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:35:15.702120 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.702063    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:35:15.702120 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.702061    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:35:15.702273 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.702149    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:35:15.702273 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.702170    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:35:15.703482 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.703465    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.703575 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.703496    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 19:35:15.704221 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.704188    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 19:35:15.704221 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.704217    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 19:35:15.704366 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.704228    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeHasSufficientPID"
Jul 28 19:35:15.731434 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.731408    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-52.ec2.internal\" not found" node="ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.736101 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.736078    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-52.ec2.internal\" not found" node="ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.797091 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.797052    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:15.797091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.797090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/709461260afadf7576f50f17fcd37505-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal\" (UID: \"709461260afadf7576f50f17fcd37505\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.797318 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.797122    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/709461260afadf7576f50f17fcd37505-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal\" (UID: \"709461260afadf7576f50f17fcd37505\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.797318 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.797148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c42ef49a264502a7ba84c385b4bf7337-config\") pod \"kube-apiserver-proxy-ip-10-0-128-52.ec2.internal\" (UID: \"c42ef49a264502a7ba84c385b4bf7337\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.897677 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.897588    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:15.897677 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.897613    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/709461260afadf7576f50f17fcd37505-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal\" (UID: \"709461260afadf7576f50f17fcd37505\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.897677 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.897657    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/709461260afadf7576f50f17fcd37505-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal\" (UID: \"709461260afadf7576f50f17fcd37505\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.897677 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.897679    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/709461260afadf7576f50f17fcd37505-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal\" (UID: \"709461260afadf7576f50f17fcd37505\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.897876 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.897702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c42ef49a264502a7ba84c385b4bf7337-config\") pod \"kube-apiserver-proxy-ip-10-0-128-52.ec2.internal\" (UID: \"c42ef49a264502a7ba84c385b4bf7337\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.897876 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.897744    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c42ef49a264502a7ba84c385b4bf7337-config\") pod \"kube-apiserver-proxy-ip-10-0-128-52.ec2.internal\" (UID: \"c42ef49a264502a7ba84c385b4bf7337\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.897876 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:15.897774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/709461260afadf7576f50f17fcd37505-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal\" (UID: \"709461260afadf7576f50f17fcd37505\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 28 19:35:15.998622 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:15.998582    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:16.036442 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:16.036409    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 28 19:35:16.039241 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:16.039216    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal"
Jul 28 19:35:16.099186 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:16.099143    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:16.199895 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:16.199801    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:16.300334 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:16.300286    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:16.310279 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:16.310256    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:35:16.324281 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:16.324257    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 19:35:16.324437 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:16.324419    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 19:35:16.324478 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:16.324455    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 19:35:16.324478 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:16.324465    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 19:35:16.396557 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:16.396504    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 19:30:16 +0000 UTC" deadline="2028-01-19 05:26:01.291316811 +0000 UTC"
Jul 28 19:35:16.396557 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:16.396537    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12945h50m44.894783303s"
Jul 28 19:35:16.401255 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:16.401223    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:16.502086 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:16.502009    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:16.602218 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:16.602189    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:16.624358 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:16.624307    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod709461260afadf7576f50f17fcd37505.slice/crio-22e2d5b6854ca7b5fd238d37c8c086934c370e9737cc60902db1736638551c81 WatchSource:0}: Error finding container 22e2d5b6854ca7b5fd238d37c8c086934c370e9737cc60902db1736638551c81: Status 404 returned error can't find the container with id 22e2d5b6854ca7b5fd238d37c8c086934c370e9737cc60902db1736638551c81
Jul 28 19:35:16.630889 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:16.630873    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 19:35:16.667279 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:16.667251    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc42ef49a264502a7ba84c385b4bf7337.slice/crio-c092cf9dcfdc55536531893dff7be97d0b2a68a319ebd102ffda0960460200b7 WatchSource:0}: Error finding container c092cf9dcfdc55536531893dff7be97d0b2a68a319ebd102ffda0960460200b7: Status 404 returned error can't find the container with id c092cf9dcfdc55536531893dff7be97d0b2a68a319ebd102ffda0960460200b7
Jul 28 19:35:16.703107 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:16.703073    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:16.804172 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:16.804092    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:16.904881 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:16.904838    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-52.ec2.internal\" not found"
Jul 28 19:35:16.964696 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:16.964671    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:35:16.990493 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:16.990462    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal"
Jul 28 19:35:16.999138 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:16.999112    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 19:35:17.000071 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.000057    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal"
Jul 28 19:35:17.009987 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.009961    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 19:35:17.364220 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.364188    2563 apiserver.go:52] "Watching apiserver"
Jul 28 19:35:17.372418 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.372390    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 19:35:17.372943 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.372916    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6","openshift-cluster-node-tuning-operator/tuned-dm7p4","openshift-dns/node-resolver-xwflf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal","openshift-multus/multus-additional-cni-plugins-gvbn2","openshift-multus/network-metrics-daemon-8jk5c","kube-system/global-pull-secret-syncer-5lcrt","openshift-image-registry/node-ca-wjwd5","openshift-multus/multus-kp7xk","openshift-network-diagnostics/network-check-target-hgp4z","openshift-network-operator/iptables-alerter-dkcs2","openshift-ovn-kubernetes/ovnkube-node-r2vvp","kube-system/konnectivity-agent-lqzln"]
Jul 28 19:35:17.374700 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.374669    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:17.374807 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:17.374761    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:17.376173 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.376150    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:17.376283 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:17.376224    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:17.377497 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.377465    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.379817 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.379796    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xwflf"
Jul 28 19:35:17.380300 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.380274    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 19:35:17.380502 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.380303    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 19:35:17.380502 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.380471    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bvgpc\""
Jul 28 19:35:17.381749 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.381729    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lqzln"
Jul 28 19:35:17.382530 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.382511    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 19:35:17.382817 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.382740    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 19:35:17.382966 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.382941    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cv7g4\""
Jul 28 19:35:17.383163 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.383135    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.384063 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.384040    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 19:35:17.384293 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.384273    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bgntw\""
Jul 28 19:35:17.384990 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.384700    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wjwd5"
Jul 28 19:35:17.385257 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.385240    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 19:35:17.385495 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.385477    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 19:35:17.385800 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.385619    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 19:35:17.386036 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.385949    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 19:35:17.386036 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.385983    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 19:35:17.387958 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.387369    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.387958 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.387743    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bdmdk\""
Jul 28 19:35:17.388656 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.388107    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 19:35:17.388656 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.388175    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 19:35:17.388918 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.388900    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 19:35:17.389091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.389071    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wtzh4\""
Jul 28 19:35:17.389261 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.389240    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 19:35:17.389540 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.389524    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.390807 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.390788    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 19:35:17.391010 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.390982    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 19:35:17.391165 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.391148    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 19:35:17.392247 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.391914    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.392828 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.392802    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 19:35:17.392828 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.392813    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v9rm7\""
Jul 28 19:35:17.392976 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.392909    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 19:35:17.393205 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.393179    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 19:35:17.393308 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.393205    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 19:35:17.393308 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.393286    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 19:35:17.393452 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.393186    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 19:35:17.393779 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.393757    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 19:35:17.393905 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.393885    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mtw9j\""
Jul 28 19:35:17.394205 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.394186    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 19:35:17.394432 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.394414    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:17.394512 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:17.394498    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:17.395910 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.395891    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k875c\""
Jul 28 19:35:17.396255 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.396232    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dkcs2"
Jul 28 19:35:17.398771 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.398670    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 19:35:17.398771 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.398747    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-glbbp\""
Jul 28 19:35:17.399428 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.399407    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 19:35:17.399733 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.399689    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 19:35:17.403669 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.403324    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 19:35:17.408080 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408060    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5c1c9e47-fe52-4009-b91f-4a1b3a5d448c-serviceca\") pod \"node-ca-wjwd5\" (UID: \"5c1c9e47-fe52-4009-b91f-4a1b3a5d448c\") " pod="openshift-image-registry/node-ca-wjwd5"
Jul 28 19:35:17.408359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408303    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-etc-openvswitch\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.408461 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408432    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-run-openvswitch\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.408528 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408460    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b867cce9-9377-4d64-8d38-5eccbac5c2aa-ovnkube-config\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.408528 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408485    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-sysctl-d\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.408528 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408512    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-registration-dir\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.408717 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhbvw\" (UniqueName: \"kubernetes.io/projected/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-kube-api-access-lhbvw\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.408717 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408561    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-slash\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.408717 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-node-log\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.408717 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b867cce9-9377-4d64-8d38-5eccbac5c2aa-ovnkube-script-lib\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.408717 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-etc-selinux\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.408717 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408686    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-cni-binary-copy\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.408717 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408711    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-multus-conf-dir\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.409068 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408744    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-multus-daemon-config\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.409068 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30a8c748-7ce1-43f3-a4ba-f414ec8ee93c-agent-certs\") pod \"konnectivity-agent-lqzln\" (UID: \"30a8c748-7ce1-43f3-a4ba-f414ec8ee93c\") " pod="kube-system/konnectivity-agent-lqzln"
Jul 28 19:35:17.409068 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408803    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca89023a-f6e3-4afd-949b-a33cc95a0f21-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.409068 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408829    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-var-lib-openvswitch\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.409068 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-log-socket\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.409068 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.409068 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-socket-dir\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.409068 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.408987    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l48m9\" (UniqueName: \"kubernetes.io/projected/ca89023a-f6e3-4afd-949b-a33cc95a0f21-kube-api-access-l48m9\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.409068 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-run-netns\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.409068 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409060    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b867cce9-9377-4d64-8d38-5eccbac5c2aa-ovn-node-metrics-cert\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409092    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-host\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-run-netns\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409141    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-run-multus-certs\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31a203ac-b139-4b22-a764-b90bf128794e-hosts-file\") pod \"node-resolver-xwflf\" (UID: \"31a203ac-b139-4b22-a764-b90bf128794e\") " pod="openshift-dns/node-resolver-xwflf"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409197    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-var-lib-kubelet\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30a8c748-7ce1-43f3-a4ba-f414ec8ee93c-konnectivity-ca\") pod \"konnectivity-agent-lqzln\" (UID: \"30a8c748-7ce1-43f3-a4ba-f414ec8ee93c\") " pod="kube-system/konnectivity-agent-lqzln"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409256    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca89023a-f6e3-4afd-949b-a33cc95a0f21-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca89023a-f6e3-4afd-949b-a33cc95a0f21-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84l85\" (UniqueName: \"kubernetes.io/projected/191fd4a7-d59c-4959-a921-d2e794b4e026-kube-api-access-84l85\") pod \"network-metrics-daemon-8jk5c\" (UID: \"191fd4a7-d59c-4959-a921-d2e794b4e026\") " pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-kubernetes\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409387    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-sysctl-conf\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88m76\" (UniqueName: \"kubernetes.io/projected/31a203ac-b139-4b22-a764-b90bf128794e-kube-api-access-88m76\") pod \"node-resolver-xwflf\" (UID: \"31a203ac-b139-4b22-a764-b90bf128794e\") " pod="openshift-dns/node-resolver-xwflf"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca89023a-f6e3-4afd-949b-a33cc95a0f21-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-systemd-units\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.409569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-run-systemd\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-systemd\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409549    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-run\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-os-release\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409645    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-var-lib-cni-multus\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409673    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8969\" (UniqueName: \"kubernetes.io/projected/5c1c9e47-fe52-4009-b91f-4a1b3a5d448c-kube-api-access-t8969\") pod \"node-ca-wjwd5\" (UID: \"5c1c9e47-fe52-4009-b91f-4a1b3a5d448c\") " pod="openshift-image-registry/node-ca-wjwd5"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-multus-cni-dir\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-hostroot\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-run-ovn\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-cni-bin\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca89023a-f6e3-4afd-949b-a33cc95a0f21-cnibin\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca89023a-f6e3-4afd-949b-a33cc95a0f21-os-release\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-kubelet\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409951    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs\") pod \"network-metrics-daemon-8jk5c\" (UID: \"191fd4a7-d59c-4959-a921-d2e794b4e026\") " pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.409975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-sysconfig\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410001    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln7d4\" (UniqueName: \"kubernetes.io/projected/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-kube-api-access-ln7d4\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.410364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-modprobe-d\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-multus-socket-dir-parent\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b867cce9-9377-4d64-8d38-5eccbac5c2aa-env-overrides\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410140    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trm5f\" (UniqueName: \"kubernetes.io/projected/b867cce9-9377-4d64-8d38-5eccbac5c2aa-kube-api-access-trm5f\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410165    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fabe97c-4acb-494b-a90a-6394af60b9d3-tmp\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410194    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-etc-kubernetes\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410222    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-tuned\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31a203ac-b139-4b22-a764-b90bf128794e-tmp-dir\") pod \"node-resolver-xwflf\" (UID: \"31a203ac-b139-4b22-a764-b90bf128794e\") " pod="openshift-dns/node-resolver-xwflf"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-sys\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410301    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-var-lib-cni-bin\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-cni-netd\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-lib-modules\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410425    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lztv9\" (UniqueName: \"kubernetes.io/projected/5fabe97c-4acb-494b-a90a-6394af60b9d3-kube-api-access-lztv9\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-system-cni-dir\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410485    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-var-lib-kubelet\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c1c9e47-fe52-4009-b91f-4a1b3a5d448c-host\") pod \"node-ca-wjwd5\" (UID: \"5c1c9e47-fe52-4009-b91f-4a1b3a5d448c\") " pod="openshift-image-registry/node-ca-wjwd5"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410540    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgnh9\" (UniqueName: \"kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9\") pod \"network-check-target-hgp4z\" (UID: \"629cd422-6046-4ea3-a44c-f6827df3a514\") " pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:17.411218 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-device-dir\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.412151 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-sys-fs\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.412151 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-cnibin\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.412151 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-run-k8s-cni-cncf-io\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.412151 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.410983    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca89023a-f6e3-4afd-949b-a33cc95a0f21-system-cni-dir\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.428250 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.428225    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7k6d7"
Jul 28 19:35:17.437213 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.436597    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7k6d7"
Jul 28 19:35:17.492394 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.492366    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 19:35:17.511579 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-multus-cni-dir\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.511579 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-hostroot\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.511801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bef46927-f6b3-455d-9bbf-6e8115466f16-host-slash\") pod \"iptables-alerter-dkcs2\" (UID: \"bef46927-f6b3-455d-9bbf-6e8115466f16\") " pod="openshift-network-operator/iptables-alerter-dkcs2"
Jul 28 19:35:17.511801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511620    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-run-ovn\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.511801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-cni-bin\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.511801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca89023a-f6e3-4afd-949b-a33cc95a0f21-cnibin\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.511801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca89023a-f6e3-4afd-949b-a33cc95a0f21-os-release\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.511801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-kubelet\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.511801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs\") pod \"network-metrics-daemon-8jk5c\" (UID: \"191fd4a7-d59c-4959-a921-d2e794b4e026\") " pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:17.511801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-sysconfig\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.511801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511736    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.511801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln7d4\" (UniqueName: \"kubernetes.io/projected/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-kube-api-access-ln7d4\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.511801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9w7c\" (UniqueName: \"kubernetes.io/projected/bef46927-f6b3-455d-9bbf-6e8115466f16-kube-api-access-t9w7c\") pod \"iptables-alerter-dkcs2\" (UID: \"bef46927-f6b3-455d-9bbf-6e8115466f16\") " pod="openshift-network-operator/iptables-alerter-dkcs2"
Jul 28 19:35:17.511801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511785    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-modprobe-d\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.511801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-multus-socket-dir-parent\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b867cce9-9377-4d64-8d38-5eccbac5c2aa-env-overrides\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trm5f\" (UniqueName: \"kubernetes.io/projected/b867cce9-9377-4d64-8d38-5eccbac5c2aa-kube-api-access-trm5f\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fabe97c-4acb-494b-a90a-6394af60b9d3-tmp\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511882    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-etc-kubernetes\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-tuned\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31a203ac-b139-4b22-a764-b90bf128794e-tmp-dir\") pod \"node-resolver-xwflf\" (UID: \"31a203ac-b139-4b22-a764-b90bf128794e\") " pod="openshift-dns/node-resolver-xwflf"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511936    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-sys\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511955    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-var-lib-cni-bin\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-cni-netd\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-lib-modules\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.511999    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lztv9\" (UniqueName: \"kubernetes.io/projected/5fabe97c-4acb-494b-a90a-6394af60b9d3-kube-api-access-lztv9\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-system-cni-dir\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512030    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-var-lib-kubelet\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512046    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c1c9e47-fe52-4009-b91f-4a1b3a5d448c-host\") pod \"node-ca-wjwd5\" (UID: \"5c1c9e47-fe52-4009-b91f-4a1b3a5d448c\") " pod="openshift-image-registry/node-ca-wjwd5"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgnh9\" (UniqueName: \"kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9\") pod \"network-check-target-hgp4z\" (UID: \"629cd422-6046-4ea3-a44c-f6827df3a514\") " pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:17.512492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512079    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-device-dir\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-sys-fs\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512108    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-cnibin\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-run-k8s-cni-cncf-io\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512139    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e3f57e8-e5e3-446b-bca9-fddbef67f811-kubelet-config\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512162    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca89023a-f6e3-4afd-949b-a33cc95a0f21-system-cni-dir\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5c1c9e47-fe52-4009-b91f-4a1b3a5d448c-serviceca\") pod \"node-ca-wjwd5\" (UID: \"5c1c9e47-fe52-4009-b91f-4a1b3a5d448c\") " pod="openshift-image-registry/node-ca-wjwd5"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-etc-openvswitch\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-run-openvswitch\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b867cce9-9377-4d64-8d38-5eccbac5c2aa-ovnkube-config\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-sysctl-d\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-registration-dir\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhbvw\" (UniqueName: \"kubernetes.io/projected/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-kube-api-access-lhbvw\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-slash\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-node-log\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b867cce9-9377-4d64-8d38-5eccbac5c2aa-ovnkube-script-lib\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-etc-selinux\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.513359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-cni-binary-copy\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512376    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-multus-conf-dir\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512391    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-multus-daemon-config\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30a8c748-7ce1-43f3-a4ba-f414ec8ee93c-agent-certs\") pod \"konnectivity-agent-lqzln\" (UID: \"30a8c748-7ce1-43f3-a4ba-f414ec8ee93c\") " pod="kube-system/konnectivity-agent-lqzln"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512424    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca89023a-f6e3-4afd-949b-a33cc95a0f21-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-var-lib-openvswitch\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-log-socket\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-socket-dir\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bef46927-f6b3-455d-9bbf-6e8115466f16-iptables-alerter-script\") pod \"iptables-alerter-dkcs2\" (UID: \"bef46927-f6b3-455d-9bbf-6e8115466f16\") " pod="openshift-network-operator/iptables-alerter-dkcs2"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l48m9\" (UniqueName: \"kubernetes.io/projected/ca89023a-f6e3-4afd-949b-a33cc95a0f21-kube-api-access-l48m9\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-run-netns\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b867cce9-9377-4d64-8d38-5eccbac5c2aa-ovn-node-metrics-cert\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-host\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-run-netns\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512608    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-run-multus-certs\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31a203ac-b139-4b22-a764-b90bf128794e-hosts-file\") pod \"node-resolver-xwflf\" (UID: \"31a203ac-b139-4b22-a764-b90bf128794e\") " pod="openshift-dns/node-resolver-xwflf"
Jul 28 19:35:17.514231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e3f57e8-e5e3-446b-bca9-fddbef67f811-dbus\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512692    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-var-lib-kubelet\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30a8c748-7ce1-43f3-a4ba-f414ec8ee93c-konnectivity-ca\") pod \"konnectivity-agent-lqzln\" (UID: \"30a8c748-7ce1-43f3-a4ba-f414ec8ee93c\") " pod="kube-system/konnectivity-agent-lqzln"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca89023a-f6e3-4afd-949b-a33cc95a0f21-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca89023a-f6e3-4afd-949b-a33cc95a0f21-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-sys-fs\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512859    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84l85\" (UniqueName: \"kubernetes.io/projected/191fd4a7-d59c-4959-a921-d2e794b4e026-kube-api-access-84l85\") pod \"network-metrics-daemon-8jk5c\" (UID: \"191fd4a7-d59c-4959-a921-d2e794b4e026\") " pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-kubernetes\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512929    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-cnibin\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512934    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-sysctl-conf\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.512969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88m76\" (UniqueName: \"kubernetes.io/projected/31a203ac-b139-4b22-a764-b90bf128794e-kube-api-access-88m76\") pod \"node-resolver-xwflf\" (UID: \"31a203ac-b139-4b22-a764-b90bf128794e\") " pod="openshift-dns/node-resolver-xwflf"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca89023a-f6e3-4afd-949b-a33cc95a0f21-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-systemd-units\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513058    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-sysctl-conf\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513059    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-run-systemd\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.515150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513098    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-run-systemd\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513137    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-hostroot\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-run-ovn\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-cni-bin\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513239    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca89023a-f6e3-4afd-949b-a33cc95a0f21-cnibin\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca89023a-f6e3-4afd-949b-a33cc95a0f21-os-release\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513319    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-multus-cni-dir\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513322    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-run-k8s-cni-cncf-io\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513337    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-kubelet\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca89023a-f6e3-4afd-949b-a33cc95a0f21-system-cni-dir\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513393    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513439    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-sysconfig\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513442    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-etc-openvswitch\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513531    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-run-openvswitch\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-socket-dir\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513612    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-registration-dir\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513887    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5c1c9e47-fe52-4009-b91f-4a1b3a5d448c-serviceca\") pod \"node-ca-wjwd5\" (UID: \"5c1c9e47-fe52-4009-b91f-4a1b3a5d448c\") " pod="openshift-image-registry/node-ca-wjwd5"
Jul 28 19:35:17.516018 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:17.514031    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.513101    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-systemd\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.514414    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-systemd\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.514460    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-host\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.514469    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-device-dir\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.514509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-kubernetes\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.514514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-run-netns\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.514545    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-run-multus-certs\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.514603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31a203ac-b139-4b22-a764-b90bf128794e-hosts-file\") pod \"node-resolver-xwflf\" (UID: \"31a203ac-b139-4b22-a764-b90bf128794e\") " pod="openshift-dns/node-resolver-xwflf"
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.514662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-run\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.514693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-os-release\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.514720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-var-lib-cni-multus\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.514748    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8969\" (UniqueName: \"kubernetes.io/projected/5c1c9e47-fe52-4009-b91f-4a1b3a5d448c-kube-api-access-t8969\") pod \"node-ca-wjwd5\" (UID: \"5c1c9e47-fe52-4009-b91f-4a1b3a5d448c\") " pod="openshift-image-registry/node-ca-wjwd5"
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:17.515750    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs podName:191fd4a7-d59c-4959-a921-d2e794b4e026 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:18.015695729 +0000 UTC m=+3.037991318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs") pod "network-metrics-daemon-8jk5c" (UID: "191fd4a7-d59c-4959-a921-d2e794b4e026") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.516212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca89023a-f6e3-4afd-949b-a33cc95a0f21-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.516288    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-var-lib-cni-bin\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.516919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.516339    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-var-lib-openvswitch\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.517741 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.517072    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca89023a-f6e3-4afd-949b-a33cc95a0f21-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.517741 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.517145    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-var-lib-kubelet\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.517741 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.517191    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c1c9e47-fe52-4009-b91f-4a1b3a5d448c-host\") pod \"node-ca-wjwd5\" (UID: \"5c1c9e47-fe52-4009-b91f-4a1b3a5d448c\") " pod="openshift-image-registry/node-ca-wjwd5"
Jul 28 19:35:17.517741 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.517525    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-sysctl-d\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.518392 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.518143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b867cce9-9377-4d64-8d38-5eccbac5c2aa-ovnkube-config\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.518392 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.518237    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-slash\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.518392 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.518284    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-node-log\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.519273 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.518754    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 19:35:17.519273 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.518807    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b867cce9-9377-4d64-8d38-5eccbac5c2aa-ovnkube-script-lib\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.519273 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.518885    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-etc-selinux\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.519273 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.519161    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-modprobe-d\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.519273 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.519208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31a203ac-b139-4b22-a764-b90bf128794e-tmp-dir\") pod \"node-resolver-xwflf\" (UID: \"31a203ac-b139-4b22-a764-b90bf128794e\") " pod="openshift-dns/node-resolver-xwflf"
Jul 28 19:35:17.519273 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.519229    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-multus-socket-dir-parent\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.519687 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.519508    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b867cce9-9377-4d64-8d38-5eccbac5c2aa-env-overrides\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.519687 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.519517    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-var-lib-kubelet\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.519687 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.519572    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-multus-conf-dir\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.520120 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.520094    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-multus-daemon-config\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.520215 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.520196    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-system-cni-dir\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.520730 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.520701    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-cni-binary-copy\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.520816 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.520773    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-run\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.520869 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.520844    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-os-release\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.520910 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.520894    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-host-var-lib-cni-multus\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.521380 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.521341    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca89023a-f6e3-4afd-949b-a33cc95a0f21-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.521593 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.521447    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-log-socket\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.521593 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.521525    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-systemd-units\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.521913 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.521874    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca89023a-f6e3-4afd-949b-a33cc95a0f21-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.522000 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.521989    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-sys\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.522088 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.522037    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-cni-netd\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.522155 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.522115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/30a8c748-7ce1-43f3-a4ba-f414ec8ee93c-konnectivity-ca\") pod \"konnectivity-agent-lqzln\" (UID: \"30a8c748-7ce1-43f3-a4ba-f414ec8ee93c\") " pod="kube-system/konnectivity-agent-lqzln"
Jul 28 19:35:17.522789 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.522555    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-etc-kubernetes\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.523511 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.523489    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fabe97c-4acb-494b-a90a-6394af60b9d3-lib-modules\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.523737 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.523717    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b867cce9-9377-4d64-8d38-5eccbac5c2aa-host-run-netns\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.524277 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:17.524251    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:35:17.525242 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:17.525221    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:35:17.525329 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:17.525247    2563 projected.go:196] Error preparing data for projected volume kube-api-access-dgnh9 for pod openshift-network-diagnostics/network-check-target-hgp4z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:35:17.526474 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:17.525435    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9 podName:629cd422-6046-4ea3-a44c-f6827df3a514 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:18.025408071 +0000 UTC m=+3.047703658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dgnh9" (UniqueName: "kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9") pod "network-check-target-hgp4z" (UID: "629cd422-6046-4ea3-a44c-f6827df3a514") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:35:17.531581 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.531561    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8969\" (UniqueName: \"kubernetes.io/projected/5c1c9e47-fe52-4009-b91f-4a1b3a5d448c-kube-api-access-t8969\") pod \"node-ca-wjwd5\" (UID: \"5c1c9e47-fe52-4009-b91f-4a1b3a5d448c\") " pod="openshift-image-registry/node-ca-wjwd5"
Jul 28 19:35:17.531793 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.531700    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhbvw\" (UniqueName: \"kubernetes.io/projected/3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39-kube-api-access-lhbvw\") pod \"aws-ebs-csi-driver-node-2xkv6\" (UID: \"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.533145 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.533092    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln7d4\" (UniqueName: \"kubernetes.io/projected/7cb41ca2-fbbe-4747-a151-9e1d3d2172c2-kube-api-access-ln7d4\") pod \"multus-kp7xk\" (UID: \"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2\") " pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.534508 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.534455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84l85\" (UniqueName: \"kubernetes.io/projected/191fd4a7-d59c-4959-a921-d2e794b4e026-kube-api-access-84l85\") pod \"network-metrics-daemon-8jk5c\" (UID: \"191fd4a7-d59c-4959-a921-d2e794b4e026\") " pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:17.535129 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.535103    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l48m9\" (UniqueName: \"kubernetes.io/projected/ca89023a-f6e3-4afd-949b-a33cc95a0f21-kube-api-access-l48m9\") pod \"multus-additional-cni-plugins-gvbn2\" (UID: \"ca89023a-f6e3-4afd-949b-a33cc95a0f21\") " pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.535389 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.535367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5fabe97c-4acb-494b-a90a-6394af60b9d3-etc-tuned\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.535830 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.535790    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lztv9\" (UniqueName: \"kubernetes.io/projected/5fabe97c-4acb-494b-a90a-6394af60b9d3-kube-api-access-lztv9\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.536753 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.536734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fabe97c-4acb-494b-a90a-6394af60b9d3-tmp\") pod \"tuned-dm7p4\" (UID: \"5fabe97c-4acb-494b-a90a-6394af60b9d3\") " pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.536910 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.536828    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/30a8c748-7ce1-43f3-a4ba-f414ec8ee93c-agent-certs\") pod \"konnectivity-agent-lqzln\" (UID: \"30a8c748-7ce1-43f3-a4ba-f414ec8ee93c\") " pod="kube-system/konnectivity-agent-lqzln"
Jul 28 19:35:17.538086 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.538045    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trm5f\" (UniqueName: \"kubernetes.io/projected/b867cce9-9377-4d64-8d38-5eccbac5c2aa-kube-api-access-trm5f\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.539230 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.538856    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88m76\" (UniqueName: \"kubernetes.io/projected/31a203ac-b139-4b22-a764-b90bf128794e-kube-api-access-88m76\") pod \"node-resolver-xwflf\" (UID: \"31a203ac-b139-4b22-a764-b90bf128794e\") " pod="openshift-dns/node-resolver-xwflf"
Jul 28 19:35:17.539230 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.539193    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b867cce9-9377-4d64-8d38-5eccbac5c2aa-ovn-node-metrics-cert\") pod \"ovnkube-node-r2vvp\" (UID: \"b867cce9-9377-4d64-8d38-5eccbac5c2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.542732 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.542711    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:35:17.604935 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.604836    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal" event={"ID":"c42ef49a264502a7ba84c385b4bf7337","Type":"ContainerStarted","Data":"c092cf9dcfdc55536531893dff7be97d0b2a68a319ebd102ffda0960460200b7"}
Jul 28 19:35:17.606584 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.606504    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal" event={"ID":"709461260afadf7576f50f17fcd37505","Type":"ContainerStarted","Data":"22e2d5b6854ca7b5fd238d37c8c086934c370e9737cc60902db1736638551c81"}
Jul 28 19:35:17.616268 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.616189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e3f57e8-e5e3-446b-bca9-fddbef67f811-kubelet-config\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:17.616268 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.616235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bef46927-f6b3-455d-9bbf-6e8115466f16-iptables-alerter-script\") pod \"iptables-alerter-dkcs2\" (UID: \"bef46927-f6b3-455d-9bbf-6e8115466f16\") " pod="openshift-network-operator/iptables-alerter-dkcs2"
Jul 28 19:35:17.616460 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.616268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e3f57e8-e5e3-446b-bca9-fddbef67f811-dbus\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:17.616460 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.616305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bef46927-f6b3-455d-9bbf-6e8115466f16-host-slash\") pod \"iptables-alerter-dkcs2\" (UID: \"bef46927-f6b3-455d-9bbf-6e8115466f16\") " pod="openshift-network-operator/iptables-alerter-dkcs2"
Jul 28 19:35:17.616460 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.616346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9w7c\" (UniqueName: \"kubernetes.io/projected/bef46927-f6b3-455d-9bbf-6e8115466f16-kube-api-access-t9w7c\") pod \"iptables-alerter-dkcs2\" (UID: \"bef46927-f6b3-455d-9bbf-6e8115466f16\") " pod="openshift-network-operator/iptables-alerter-dkcs2"
Jul 28 19:35:17.616460 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.616369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:17.616697 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:17.616470    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:35:17.616697 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:17.616542    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret podName:3e3f57e8-e5e3-446b-bca9-fddbef67f811 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:18.116513844 +0000 UTC m=+3.138809411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret") pod "global-pull-secret-syncer-5lcrt" (UID: "3e3f57e8-e5e3-446b-bca9-fddbef67f811") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:35:17.616697 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.616638    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3e3f57e8-e5e3-446b-bca9-fddbef67f811-dbus\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:17.616866 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.616715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3e3f57e8-e5e3-446b-bca9-fddbef67f811-kubelet-config\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:17.616866 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.616738    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bef46927-f6b3-455d-9bbf-6e8115466f16-host-slash\") pod \"iptables-alerter-dkcs2\" (UID: \"bef46927-f6b3-455d-9bbf-6e8115466f16\") " pod="openshift-network-operator/iptables-alerter-dkcs2"
Jul 28 19:35:17.617348 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.617323    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bef46927-f6b3-455d-9bbf-6e8115466f16-iptables-alerter-script\") pod \"iptables-alerter-dkcs2\" (UID: \"bef46927-f6b3-455d-9bbf-6e8115466f16\") " pod="openshift-network-operator/iptables-alerter-dkcs2"
Jul 28 19:35:17.626723 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.626692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9w7c\" (UniqueName: \"kubernetes.io/projected/bef46927-f6b3-455d-9bbf-6e8115466f16-kube-api-access-t9w7c\") pod \"iptables-alerter-dkcs2\" (UID: \"bef46927-f6b3-455d-9bbf-6e8115466f16\") " pod="openshift-network-operator/iptables-alerter-dkcs2"
Jul 28 19:35:17.695961 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.695922    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dm7p4"
Jul 28 19:35:17.703612 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.703590    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xwflf"
Jul 28 19:35:17.713990 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.713965    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lqzln"
Jul 28 19:35:17.723045 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.723024    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gvbn2"
Jul 28 19:35:17.731078 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.731053    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wjwd5"
Jul 28 19:35:17.740006 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.739986    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:17.749806 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.749786    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6"
Jul 28 19:35:17.757772 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.757748    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kp7xk"
Jul 28 19:35:17.764356 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.764336    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:35:17.766439 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:17.766423    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dkcs2"
Jul 28 19:35:18.019800 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:18.019715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs\") pod \"network-metrics-daemon-8jk5c\" (UID: \"191fd4a7-d59c-4959-a921-d2e794b4e026\") " pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:18.019958 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:18.019849    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:35:18.019958 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:18.019915    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs podName:191fd4a7-d59c-4959-a921-d2e794b4e026 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:19.019897302 +0000 UTC m=+4.042192870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs") pod "network-metrics-daemon-8jk5c" (UID: "191fd4a7-d59c-4959-a921-d2e794b4e026") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:35:18.120529 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:18.120487    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgnh9\" (UniqueName: \"kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9\") pod \"network-check-target-hgp4z\" (UID: \"629cd422-6046-4ea3-a44c-f6827df3a514\") " pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:18.120745 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:18.120611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:18.120745 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:18.120687    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:35:18.120745 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:18.120709    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:35:18.120745 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:18.120709    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:35:18.120745 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:18.120720    2563 projected.go:196] Error preparing data for projected volume kube-api-access-dgnh9 for pod openshift-network-diagnostics/network-check-target-hgp4z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:35:18.121025 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:18.120793    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9 podName:629cd422-6046-4ea3-a44c-f6827df3a514 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:19.120771608 +0000 UTC m=+4.143067182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgnh9" (UniqueName: "kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9") pod "network-check-target-hgp4z" (UID: "629cd422-6046-4ea3-a44c-f6827df3a514") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:35:18.121025 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:18.120819    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret podName:3e3f57e8-e5e3-446b-bca9-fddbef67f811 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:19.120807637 +0000 UTC m=+4.143103223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret") pod "global-pull-secret-syncer-5lcrt" (UID: "3e3f57e8-e5e3-446b-bca9-fddbef67f811") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:35:18.439619 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:18.439180    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 19:30:18 +0000 UTC" deadline="2028-01-04 16:16:11.64964522 +0000 UTC"
Jul 28 19:35:18.439619 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:18.439230    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12596h40m53.210421279s"
Jul 28 19:35:18.598222 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:18.598194    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:18.598354 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:18.598306    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:18.627616 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:18.627581    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca89023a_f6e3_4afd_949b_a33cc95a0f21.slice/crio-4a46e30cacb43f65b28fb6df9d0abdc38dd1939ceb3ebee3e6af0b9fb6f0ddff WatchSource:0}: Error finding container 4a46e30cacb43f65b28fb6df9d0abdc38dd1939ceb3ebee3e6af0b9fb6f0ddff: Status 404 returned error can't find the container with id 4a46e30cacb43f65b28fb6df9d0abdc38dd1939ceb3ebee3e6af0b9fb6f0ddff
Jul 28 19:35:18.631328 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:18.630387    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a203ac_b139_4b22_a764_b90bf128794e.slice/crio-a45bb2ad478adf21a9e9bd750b4e4d830005a8a2d4052d2e091f7dd426ccacbb WatchSource:0}: Error finding container a45bb2ad478adf21a9e9bd750b4e4d830005a8a2d4052d2e091f7dd426ccacbb: Status 404 returned error can't find the container with id a45bb2ad478adf21a9e9bd750b4e4d830005a8a2d4052d2e091f7dd426ccacbb
Jul 28 19:35:18.633409 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:18.633356    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30a8c748_7ce1_43f3_a4ba_f414ec8ee93c.slice/crio-4fa0a34d4a12c726a44206972fa482188d2a0643e06288942fb10f53f602cc58 WatchSource:0}: Error finding container 4fa0a34d4a12c726a44206972fa482188d2a0643e06288942fb10f53f602cc58: Status 404 returned error can't find the container with id 4fa0a34d4a12c726a44206972fa482188d2a0643e06288942fb10f53f602cc58
Jul 28 19:35:18.634210 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:18.634138    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fabe97c_4acb_494b_a90a_6394af60b9d3.slice/crio-e26a1ee017ea58dcb787f54d7755c0890a84a8a0ddbe6f0f8317de3c97673add WatchSource:0}: Error finding container e26a1ee017ea58dcb787f54d7755c0890a84a8a0ddbe6f0f8317de3c97673add: Status 404 returned error can't find the container with id e26a1ee017ea58dcb787f54d7755c0890a84a8a0ddbe6f0f8317de3c97673add
Jul 28 19:35:18.635863 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:18.635827    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb867cce9_9377_4d64_8d38_5eccbac5c2aa.slice/crio-40624bd551e4fb67cec6738e560ed9234a42368af6bdf4fcf33bc1aa1df345c8 WatchSource:0}: Error finding container 40624bd551e4fb67cec6738e560ed9234a42368af6bdf4fcf33bc1aa1df345c8: Status 404 returned error can't find the container with id 40624bd551e4fb67cec6738e560ed9234a42368af6bdf4fcf33bc1aa1df345c8
Jul 28 19:35:18.641851 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:35:18.641831    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb41ca2_fbbe_4747_a151_9e1d3d2172c2.slice/crio-dff6cbd6c07cdb2b8172ed78f2540b048ba22918fdfa448ebc09168537c5b12e WatchSource:0}: Error finding container dff6cbd6c07cdb2b8172ed78f2540b048ba22918fdfa448ebc09168537c5b12e: Status 404 returned error can't find the container with id dff6cbd6c07cdb2b8172ed78f2540b048ba22918fdfa448ebc09168537c5b12e
Jul 28 19:35:18.866883 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:18.866669    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 19:35:19.030460 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.030334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs\") pod \"network-metrics-daemon-8jk5c\" (UID: \"191fd4a7-d59c-4959-a921-d2e794b4e026\") " pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:19.030658 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:19.030581    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:35:19.030729 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:19.030673    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs podName:191fd4a7-d59c-4959-a921-d2e794b4e026 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:21.030650581 +0000 UTC m=+6.052946172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs") pod "network-metrics-daemon-8jk5c" (UID: "191fd4a7-d59c-4959-a921-d2e794b4e026") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:35:19.131956 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.131053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:19.131956 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.131114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgnh9\" (UniqueName: \"kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9\") pod \"network-check-target-hgp4z\" (UID: \"629cd422-6046-4ea3-a44c-f6827df3a514\") " pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:19.131956 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:19.131294    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:35:19.131956 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:19.131315    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:35:19.131956 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:19.131329    2563 projected.go:196] Error preparing data for projected volume kube-api-access-dgnh9 for pod openshift-network-diagnostics/network-check-target-hgp4z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:35:19.131956 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:19.131392    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9 podName:629cd422-6046-4ea3-a44c-f6827df3a514 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:21.13137126 +0000 UTC m=+6.153666835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgnh9" (UniqueName: "kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9") pod "network-check-target-hgp4z" (UID: "629cd422-6046-4ea3-a44c-f6827df3a514") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:35:19.131956 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:19.131838    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:35:19.131956 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:19.131895    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret podName:3e3f57e8-e5e3-446b-bca9-fddbef67f811 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:21.131879396 +0000 UTC m=+6.154174968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret") pod "global-pull-secret-syncer-5lcrt" (UID: "3e3f57e8-e5e3-446b-bca9-fddbef67f811") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:35:19.439863 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.439739    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 19:30:18 +0000 UTC" deadline="2027-12-29 17:47:44.971762302 +0000 UTC"
Jul 28 19:35:19.439863 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.439809    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12454h12m25.531958261s"
Jul 28 19:35:19.601348 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.600566    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:19.601348 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:19.600731    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:19.601348 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.601186    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:19.601348 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:19.601285    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:19.619379 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.618435    2563 generic.go:356] "Generic (PLEG): container finished" podID="709461260afadf7576f50f17fcd37505" containerID="98f5522856fc486ca095ef0e9c4471c316fc020f20b5b5d49862520a58612d61" exitCode=0
Jul 28 19:35:19.619379 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.618525    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal" event={"ID":"709461260afadf7576f50f17fcd37505","Type":"ContainerDied","Data":"98f5522856fc486ca095ef0e9c4471c316fc020f20b5b5d49862520a58612d61"}
Jul 28 19:35:19.625835 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.625573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kp7xk" event={"ID":"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2","Type":"ContainerStarted","Data":"dff6cbd6c07cdb2b8172ed78f2540b048ba22918fdfa448ebc09168537c5b12e"}
Jul 28 19:35:19.629493 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.629427    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dkcs2" event={"ID":"bef46927-f6b3-455d-9bbf-6e8115466f16","Type":"ContainerStarted","Data":"812cd68f18ccb68e64e115843d8dd6139c0f29bfa098f82cea5bea22da9170a6"}
Jul 28 19:35:19.637111 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.637046    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wjwd5" event={"ID":"5c1c9e47-fe52-4009-b91f-4a1b3a5d448c","Type":"ContainerStarted","Data":"d55805cb688c8284e5384b45f0779833eeead687f0c472bbef7f924e975d1f1b"}
Jul 28 19:35:19.661175 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.661072    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lqzln" event={"ID":"30a8c748-7ce1-43f3-a4ba-f414ec8ee93c","Type":"ContainerStarted","Data":"4fa0a34d4a12c726a44206972fa482188d2a0643e06288942fb10f53f602cc58"}
Jul 28 19:35:19.671195 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.666601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xwflf" event={"ID":"31a203ac-b139-4b22-a764-b90bf128794e","Type":"ContainerStarted","Data":"a45bb2ad478adf21a9e9bd750b4e4d830005a8a2d4052d2e091f7dd426ccacbb"}
Jul 28 19:35:19.671195 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.670104    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dm7p4" event={"ID":"5fabe97c-4acb-494b-a90a-6394af60b9d3","Type":"ContainerStarted","Data":"e26a1ee017ea58dcb787f54d7755c0890a84a8a0ddbe6f0f8317de3c97673add"}
Jul 28 19:35:19.682184 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.682142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6" event={"ID":"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39","Type":"ContainerStarted","Data":"31d87639a77c81ec8d558f1af4c0a9389c246e4d94227658eb7ee35915365501"}
Jul 28 19:35:19.696084 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.696005    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp" event={"ID":"b867cce9-9377-4d64-8d38-5eccbac5c2aa","Type":"ContainerStarted","Data":"40624bd551e4fb67cec6738e560ed9234a42368af6bdf4fcf33bc1aa1df345c8"}
Jul 28 19:35:19.716743 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.712596    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvbn2" event={"ID":"ca89023a-f6e3-4afd-949b-a33cc95a0f21","Type":"ContainerStarted","Data":"4a46e30cacb43f65b28fb6df9d0abdc38dd1939ceb3ebee3e6af0b9fb6f0ddff"}
Jul 28 19:35:19.726569 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:19.726536    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal" event={"ID":"c42ef49a264502a7ba84c385b4bf7337","Type":"ContainerStarted","Data":"6355526a0e052fd00aedbefb3e822644dcba203967dec15644f814a50042019e"}
Jul 28 19:35:20.598083 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:20.598046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:20.598578 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:20.598201    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:20.747752 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:20.747701    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal" event={"ID":"709461260afadf7576f50f17fcd37505","Type":"ContainerStarted","Data":"165aaf6e17e2cc32bd1312771628b157c8c6e8259822f18ad56c0c96c0c7577b"}
Jul 28 19:35:20.763433 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:20.763371    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-52.ec2.internal" podStartSLOduration=3.763349811 podStartE2EDuration="3.763349811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:35:19.742973145 +0000 UTC m=+4.765268745" watchObservedRunningTime="2026-07-28 19:35:20.763349811 +0000 UTC m=+5.785645403"
Jul 28 19:35:21.048156 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:21.048062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs\") pod \"network-metrics-daemon-8jk5c\" (UID: \"191fd4a7-d59c-4959-a921-d2e794b4e026\") " pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:21.048317 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:21.048291    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:35:21.048398 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:21.048363    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs podName:191fd4a7-d59c-4959-a921-d2e794b4e026 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:25.048341759 +0000 UTC m=+10.070637335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs") pod "network-metrics-daemon-8jk5c" (UID: "191fd4a7-d59c-4959-a921-d2e794b4e026") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:35:21.149007 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:21.148964    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgnh9\" (UniqueName: \"kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9\") pod \"network-check-target-hgp4z\" (UID: \"629cd422-6046-4ea3-a44c-f6827df3a514\") " pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:21.149197 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:21.149061    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:21.149197 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:21.149177    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:35:21.149309 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:21.149241    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret podName:3e3f57e8-e5e3-446b-bca9-fddbef67f811 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:25.149221869 +0000 UTC m=+10.171517454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret") pod "global-pull-secret-syncer-5lcrt" (UID: "3e3f57e8-e5e3-446b-bca9-fddbef67f811") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:35:21.149728 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:21.149708    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:35:21.149830 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:21.149733    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:35:21.149830 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:21.149746    2563 projected.go:196] Error preparing data for projected volume kube-api-access-dgnh9 for pod openshift-network-diagnostics/network-check-target-hgp4z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:35:21.149830 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:21.149794    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9 podName:629cd422-6046-4ea3-a44c-f6827df3a514 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:25.14977767 +0000 UTC m=+10.172073239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgnh9" (UniqueName: "kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9") pod "network-check-target-hgp4z" (UID: "629cd422-6046-4ea3-a44c-f6827df3a514") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:35:21.601280 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:21.601211    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:21.601772 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:21.601351    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:21.601772 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:21.601766    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:21.601903 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:21.601869    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:22.598187 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:22.598148    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:22.598385 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:22.598288    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:23.598422 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:23.598331    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:23.598922 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:23.598485    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:23.598922 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:23.598642    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:23.598922 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:23.598748    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:24.597961 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:24.597921    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:24.598168 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:24.598053    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:25.086039 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:25.085617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs\") pod \"network-metrics-daemon-8jk5c\" (UID: \"191fd4a7-d59c-4959-a921-d2e794b4e026\") " pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:25.086039 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:25.085833    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:35:25.086039 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:25.085903    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs podName:191fd4a7-d59c-4959-a921-d2e794b4e026 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:33.085882315 +0000 UTC m=+18.108177902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs") pod "network-metrics-daemon-8jk5c" (UID: "191fd4a7-d59c-4959-a921-d2e794b4e026") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:35:25.186499 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:25.186457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgnh9\" (UniqueName: \"kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9\") pod \"network-check-target-hgp4z\" (UID: \"629cd422-6046-4ea3-a44c-f6827df3a514\") " pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:25.186792 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:25.186764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:25.186891 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:25.186794    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:35:25.186891 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:25.186837    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:35:25.186891 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:25.186854    2563 projected.go:196] Error preparing data for projected volume kube-api-access-dgnh9 for pod openshift-network-diagnostics/network-check-target-hgp4z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:35:25.186891 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:25.186883    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:35:25.187399 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:25.187374    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9 podName:629cd422-6046-4ea3-a44c-f6827df3a514 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:33.186895452 +0000 UTC m=+18.209191037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgnh9" (UniqueName: "kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9") pod "network-check-target-hgp4z" (UID: "629cd422-6046-4ea3-a44c-f6827df3a514") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:35:25.188191 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:25.187919    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret podName:3e3f57e8-e5e3-446b-bca9-fddbef67f811 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:33.187868816 +0000 UTC m=+18.210164401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret") pod "global-pull-secret-syncer-5lcrt" (UID: "3e3f57e8-e5e3-446b-bca9-fddbef67f811") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:35:25.600450 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:25.599780    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:25.600450 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:25.599891    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:25.600450 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:25.600295    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:25.600450 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:25.600401    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:26.598344 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:26.598167    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:26.598344 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:26.598311    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:27.598846 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:27.598064    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:27.598846 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:27.598232    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:27.598846 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:27.598585    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:27.598846 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:27.598686    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:28.598638 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:28.598393    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:28.598638 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:28.598520    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:29.598398 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:29.598362    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:29.598535 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:29.598487    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:29.598592 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:29.598534    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:29.598653 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:29.598636    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:30.598196 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:30.598169    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:30.598641 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:30.598266    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:31.598602 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:31.598575    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:31.599063 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:31.598614    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:31.599063 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:31.598694    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:31.599063 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:31.598814    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:32.598106 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:32.598071    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:32.598568 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:32.598521    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:33.148014 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:33.147970    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs\") pod \"network-metrics-daemon-8jk5c\" (UID: \"191fd4a7-d59c-4959-a921-d2e794b4e026\") " pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:33.148489 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:33.148140    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:35:33.148489 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:33.148223    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs podName:191fd4a7-d59c-4959-a921-d2e794b4e026 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:49.148200444 +0000 UTC m=+34.170496023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs") pod "network-metrics-daemon-8jk5c" (UID: "191fd4a7-d59c-4959-a921-d2e794b4e026") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:35:33.249201 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:33.249164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:33.249392 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:33.249221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgnh9\" (UniqueName: \"kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9\") pod \"network-check-target-hgp4z\" (UID: \"629cd422-6046-4ea3-a44c-f6827df3a514\") " pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:33.249392 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:33.249326    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:35:33.249392 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:33.249356    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:35:33.249392 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:33.249376    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:35:33.249392 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:33.249391    2563 projected.go:196] Error preparing data for projected volume kube-api-access-dgnh9 for pod openshift-network-diagnostics/network-check-target-hgp4z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:35:33.249641 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:33.249403    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret podName:3e3f57e8-e5e3-446b-bca9-fddbef67f811 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:49.249385454 +0000 UTC m=+34.271681035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret") pod "global-pull-secret-syncer-5lcrt" (UID: "3e3f57e8-e5e3-446b-bca9-fddbef67f811") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:35:33.249641 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:33.249435    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9 podName:629cd422-6046-4ea3-a44c-f6827df3a514 nodeName:}" failed. No retries permitted until 2026-07-28 19:35:49.249422362 +0000 UTC m=+34.271717928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgnh9" (UniqueName: "kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9") pod "network-check-target-hgp4z" (UID: "629cd422-6046-4ea3-a44c-f6827df3a514") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:35:33.598532 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:33.598455    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:33.598718 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:33.598587    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:33.598718 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:33.598639    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:33.598823 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:33.598738    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:34.598821 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:34.598785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:34.599269 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:34.598915    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:35.599131 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:35.599095    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:35.599597 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:35.599242    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:35.599597 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:35.599285    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:35.599597 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:35.599408    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:36.598700 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:36.598670    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:36.598867 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:36.598781    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:37.598821 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.598796    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:37.599130 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:37.598918    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:37.599195 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.599153    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:37.599298 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:37.599274    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:37.785844 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.785498    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp" event={"ID":"b867cce9-9377-4d64-8d38-5eccbac5c2aa","Type":"ContainerStarted","Data":"73ff78c29a4beaad123aad4be7e0e83dc742a1188ef137a52d8f5c029ae7340c"}
Jul 28 19:35:37.786001 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.785904    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp" event={"ID":"b867cce9-9377-4d64-8d38-5eccbac5c2aa","Type":"ContainerStarted","Data":"a94a0a29ecdb8c600398e15c57edc368e12ca5849b2032ff1d04729146fd8dcd"}
Jul 28 19:35:37.787005 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.786980    2563 generic.go:356] "Generic (PLEG): container finished" podID="ca89023a-f6e3-4afd-949b-a33cc95a0f21" containerID="7a90154cf79b5fba18c96683aec967347dffc259546c7716362fa9edb5ab8cd2" exitCode=0
Jul 28 19:35:37.787103 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.787036    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvbn2" event={"ID":"ca89023a-f6e3-4afd-949b-a33cc95a0f21","Type":"ContainerDied","Data":"7a90154cf79b5fba18c96683aec967347dffc259546c7716362fa9edb5ab8cd2"}
Jul 28 19:35:37.789049 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.789025    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kp7xk" event={"ID":"7cb41ca2-fbbe-4747-a151-9e1d3d2172c2","Type":"ContainerStarted","Data":"5008b7efaea07a274637114ee173f2c09ee743cad6ba1b6de56ff5ba43fb55f9"}
Jul 28 19:35:37.790762 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.790734    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wjwd5" event={"ID":"5c1c9e47-fe52-4009-b91f-4a1b3a5d448c","Type":"ContainerStarted","Data":"677ac6d680e09e85789a91e73d3cef65d83e23a83f6c57aaf6b27f7ba300dcd2"}
Jul 28 19:35:37.792622 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.792599    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lqzln" event={"ID":"30a8c748-7ce1-43f3-a4ba-f414ec8ee93c","Type":"ContainerStarted","Data":"a8a06d3ee90cba863313ff5aaf6d9dc1e383670e5677856eae32bd90b2c0b297"}
Jul 28 19:35:37.793790 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.793769    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xwflf" event={"ID":"31a203ac-b139-4b22-a764-b90bf128794e","Type":"ContainerStarted","Data":"ed9a3a8738b567c88dc29f4145b4a8c585433bcfb50d1af1e555aa4a1f68ada6"}
Jul 28 19:35:37.795358 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.795333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dm7p4" event={"ID":"5fabe97c-4acb-494b-a90a-6394af60b9d3","Type":"ContainerStarted","Data":"4e2ae3fd18bd88f459ed5996a1fda527799621906a365bcf4a90ff9b03c4650d"}
Jul 28 19:35:37.796734 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.796710    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6" event={"ID":"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39","Type":"ContainerStarted","Data":"750561df0f47d981c27ebbf6e6ffb0419d43945211c2c89affb946bffde02c7b"}
Jul 28 19:35:37.814269 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.811975    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-52.ec2.internal" podStartSLOduration=20.811951438 podStartE2EDuration="20.811951438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:35:20.771866315 +0000 UTC m=+5.794161909" watchObservedRunningTime="2026-07-28 19:35:37.811951438 +0000 UTC m=+22.834247027"
Jul 28 19:35:37.840395 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.840347    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dm7p4" podStartSLOduration=2.972446734 podStartE2EDuration="21.840331293s" totalImagesPullingTime="18.867884559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:35:37.827137281 +0000 UTC m=+22.849432954" watchObservedRunningTime="2026-07-28 19:35:37.840331293 +0000 UTC m=+22.862626889"
Jul 28 19:35:37.840513 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.840469    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xwflf" podStartSLOduration=2.97008305 podStartE2EDuration="21.840461998s" totalImagesPullingTime="18.870378948s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:35:37.840004762 +0000 UTC m=+22.862300351" watchObservedRunningTime="2026-07-28 19:35:37.840461998 +0000 UTC m=+22.862757587"
Jul 28 19:35:37.866850 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.866812    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wjwd5" podStartSLOduration=3.002557842 podStartE2EDuration="21.866796819s" totalImagesPullingTime="18.864238977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:35:37.866252127 +0000 UTC m=+22.888547716" watchObservedRunningTime="2026-07-28 19:35:37.866796819 +0000 UTC m=+22.889092406"
Jul 28 19:35:37.867097 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.867079    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lqzln" podStartSLOduration=10.703475022 podStartE2EDuration="21.867074429s" totalImagesPullingTime="11.163599407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:35:37.853058555 +0000 UTC m=+22.875354150" watchObservedRunningTime="2026-07-28 19:35:37.867074429 +0000 UTC m=+22.889370050"
Jul 28 19:35:37.885893 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:37.885858    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kp7xk" podStartSLOduration=2.985053142 podStartE2EDuration="21.885844084s" totalImagesPullingTime="18.900790942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:35:37.885558928 +0000 UTC m=+22.907854508" watchObservedRunningTime="2026-07-28 19:35:37.885844084 +0000 UTC m=+22.908139672"
Jul 28 19:35:38.353683 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:38.353595    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lqzln"
Jul 28 19:35:38.354234 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:38.354205    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lqzln"
Jul 28 19:35:38.598477 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:38.598446    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:38.598679 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:38.598588    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:38.803342 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:38.803303    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp" event={"ID":"b867cce9-9377-4d64-8d38-5eccbac5c2aa","Type":"ContainerStarted","Data":"e8a8736fc978398fe03bc40a4b4d89788d643041d5ccb2bfa393fd4d9f33a803"}
Jul 28 19:35:38.804264 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:38.803403    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp" event={"ID":"b867cce9-9377-4d64-8d38-5eccbac5c2aa","Type":"ContainerStarted","Data":"b97d180a06ca78cfde3920ad5602f847fe320b3357c35c4e11dad7425c94315d"}
Jul 28 19:35:38.804264 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:38.803454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp" event={"ID":"b867cce9-9377-4d64-8d38-5eccbac5c2aa","Type":"ContainerStarted","Data":"84f73ad9bf8fcfeb84cad01f7b4434bf777c147955994de4afad87b6dce2ec8e"}
Jul 28 19:35:38.804264 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:38.803501    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp" event={"ID":"b867cce9-9377-4d64-8d38-5eccbac5c2aa","Type":"ContainerStarted","Data":"58d238d942d25d410cc062dcb8cc58f4fb7f6f1e06ddf45c17901222c4399213"}
Jul 28 19:35:38.805208 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:38.805149    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dkcs2" event={"ID":"bef46927-f6b3-455d-9bbf-6e8115466f16","Type":"ContainerStarted","Data":"c774f798270f73c7bb8f25cc954b613657beabebe3be99f17e4dbe82042be15b"}
Jul 28 19:35:38.806418 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:38.806073    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lqzln"
Jul 28 19:35:38.806418 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:38.806380    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lqzln"
Jul 28 19:35:38.838894 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:38.838851    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dkcs2" podStartSLOduration=3.976392764 podStartE2EDuration="22.83883489s" totalImagesPullingTime="18.862442126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:35:38.821972688 +0000 UTC m=+23.844268277" watchObservedRunningTime="2026-07-28 19:35:38.83883489 +0000 UTC m=+23.861130478"
Jul 28 19:35:39.344353 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:39.344323    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 19:35:39.475948 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:39.475768    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T19:35:39.344347028Z","UUID":"e66dabe3-a801-45f5-8dde-8c633dc89436","Handler":null,"Name":"","Endpoint":""}
Jul 28 19:35:39.477390 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:39.477368    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 19:35:39.477512 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:39.477409    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 19:35:39.598958 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:39.598923    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:39.599187 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:39.599056    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:39.599187 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:39.599119    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:39.599314 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:39.599246    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:39.810442 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:39.810354    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6" event={"ID":"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39","Type":"ContainerStarted","Data":"88392a8fc27722f4d0713c4c52c9a71743a937d5a6fe97e9772e37a19f3c616d"}
Jul 28 19:35:40.333554 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:40.333512    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xwflf_31a203ac-b139-4b22-a764-b90bf128794e/dns-node-resolver/0.log"
Jul 28 19:35:40.598958 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:40.598884    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:40.599112 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:40.598997    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:41.310275 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:41.310245    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wjwd5_5c1c9e47-fe52-4009-b91f-4a1b3a5d448c/node-ca/0.log"
Jul 28 19:35:41.598363 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:41.598291    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:41.598514 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:41.598291    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:41.598514 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:41.598408    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:41.598653 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:41.598520    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:42.598570 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:42.598399    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:42.599070 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:42.598644    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:42.819415 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:42.819383    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6" event={"ID":"3d9d2f8d-f7c6-4b78-a589-eaf07a0fec39","Type":"ContainerStarted","Data":"2fe6152a0bc78fd41809688c5ec417f20978e3a1a8822fff0ff01f35f46903f3"}
Jul 28 19:35:42.825432 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:42.825400    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp" event={"ID":"b867cce9-9377-4d64-8d38-5eccbac5c2aa","Type":"ContainerStarted","Data":"0df8c315ba741b4afddd6f3f73400514cb4404547971cd3ced7e29badf172ce5"}
Jul 28 19:35:42.826962 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:42.826936    2563 generic.go:356] "Generic (PLEG): container finished" podID="ca89023a-f6e3-4afd-949b-a33cc95a0f21" containerID="cd847485c868a36949a809a5f6b8f6c14133bb3fed10e06b7c1e8b9bc23af979" exitCode=0
Jul 28 19:35:42.827065 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:42.826990    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvbn2" event={"ID":"ca89023a-f6e3-4afd-949b-a33cc95a0f21","Type":"ContainerDied","Data":"cd847485c868a36949a809a5f6b8f6c14133bb3fed10e06b7c1e8b9bc23af979"}
Jul 28 19:35:42.842497 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:42.842457    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xkv6" podStartSLOduration=3.800724033 podStartE2EDuration="26.842446004s" totalImagesPullingTime="23.041721971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:35:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:35:42.842149435 +0000 UTC m=+27.864445022" watchObservedRunningTime="2026-07-28 19:35:42.842446004 +0000 UTC m=+27.864741601"
Jul 28 19:35:43.598150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:43.598059    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:43.598312 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:43.598179    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:43.598312 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:43.598241    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:43.598428 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:43.598361    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:44.598137 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:44.597895    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:44.598749 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:44.598141    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:44.833819 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:44.833782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp" event={"ID":"b867cce9-9377-4d64-8d38-5eccbac5c2aa","Type":"ContainerStarted","Data":"80c009be4aa8019e5f9e3ce356a2e194e2c33728c7c1d093d1ad5abfd1152e1a"}
Jul 28 19:35:44.834032 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:44.834015    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:44.835897 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:44.835872    2563 generic.go:356] "Generic (PLEG): container finished" podID="ca89023a-f6e3-4afd-949b-a33cc95a0f21" containerID="5052781726e8ba47adb48beeb88dac2ff612540ce65b4bfd8c0f9099fd96e16d" exitCode=0
Jul 28 19:35:44.836020 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:44.835905    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvbn2" event={"ID":"ca89023a-f6e3-4afd-949b-a33cc95a0f21","Type":"ContainerDied","Data":"5052781726e8ba47adb48beeb88dac2ff612540ce65b4bfd8c0f9099fd96e16d"}
Jul 28 19:35:44.850763 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:44.850694    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:44.861875 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:44.861834    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp" podStartSLOduration=9.934672397 podStartE2EDuration="28.861821159s" totalImagesPullingTime="18.927148762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:35:44.860290453 +0000 UTC m=+29.882586053" watchObservedRunningTime="2026-07-28 19:35:44.861821159 +0000 UTC m=+29.884116782"
Jul 28 19:35:45.599709 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:45.599672    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:45.600149 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:45.599794    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:45.600149 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:45.599841    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:45.600149 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:45.599946    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:45.837957 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:45.837926    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:45.838133 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:45.838001    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:45.853249 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:45.853192    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:35:46.598591 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:46.598557    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:46.598737 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:46.598656    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:46.841618 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:46.841579    2563 generic.go:356] "Generic (PLEG): container finished" podID="ca89023a-f6e3-4afd-949b-a33cc95a0f21" containerID="1bd9524e7bc5fc1ca6741127db5778ceb38eefe3ec82b9a1313c475935b9a506" exitCode=0
Jul 28 19:35:46.841997 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:46.841672    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvbn2" event={"ID":"ca89023a-f6e3-4afd-949b-a33cc95a0f21","Type":"ContainerDied","Data":"1bd9524e7bc5fc1ca6741127db5778ceb38eefe3ec82b9a1313c475935b9a506"}
Jul 28 19:35:47.598590 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:47.598556    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:47.598767 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:47.598566    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:47.598767 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:47.598694    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:47.598866 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:47.598758    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:48.598161 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:48.598132    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:48.598632 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:48.598249    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:49.168973 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:49.168922    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs\") pod \"network-metrics-daemon-8jk5c\" (UID: \"191fd4a7-d59c-4959-a921-d2e794b4e026\") " pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:49.169145 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:49.169100    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:35:49.169204 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:49.169187    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs podName:191fd4a7-d59c-4959-a921-d2e794b4e026 nodeName:}" failed. No retries permitted until 2026-07-28 19:36:21.169166083 +0000 UTC m=+66.191461666 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs") pod "network-metrics-daemon-8jk5c" (UID: "191fd4a7-d59c-4959-a921-d2e794b4e026") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 19:35:49.269516 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:49.269482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgnh9\" (UniqueName: \"kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9\") pod \"network-check-target-hgp4z\" (UID: \"629cd422-6046-4ea3-a44c-f6827df3a514\") " pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:49.269675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:49.269581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:49.269736 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:49.269679    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 19:35:49.269736 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:49.269705    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 19:35:49.269736 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:49.269715    2563 projected.go:196] Error preparing data for projected volume kube-api-access-dgnh9 for pod openshift-network-diagnostics/network-check-target-hgp4z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:35:49.269831 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:49.269760    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9 podName:629cd422-6046-4ea3-a44c-f6827df3a514 nodeName:}" failed. No retries permitted until 2026-07-28 19:36:21.269745811 +0000 UTC m=+66.292041378 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgnh9" (UniqueName: "kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9") pod "network-check-target-hgp4z" (UID: "629cd422-6046-4ea3-a44c-f6827df3a514") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 19:35:49.269831 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:49.269681    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 19:35:49.269831 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:49.269811    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret podName:3e3f57e8-e5e3-446b-bca9-fddbef67f811 nodeName:}" failed. No retries permitted until 2026-07-28 19:36:21.269796096 +0000 UTC m=+66.292091677 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret") pod "global-pull-secret-syncer-5lcrt" (UID: "3e3f57e8-e5e3-446b-bca9-fddbef67f811") : object "kube-system"/"original-pull-secret" not registered
Jul 28 19:35:49.598811 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:49.598739    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:49.599223 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:49.598871    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:49.599223 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:49.598972    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:49.599223 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:49.599091    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:50.598094 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:50.598057    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:50.598259 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:50.598170    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:51.598874 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:51.598838    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:51.599344 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:51.598964    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:51.599344 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:51.599007    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:51.599344 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:51.599103    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:51.857486 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:51.857405    2563 generic.go:356] "Generic (PLEG): container finished" podID="ca89023a-f6e3-4afd-949b-a33cc95a0f21" containerID="5d6bbcfd3d31324fb422624a19ff7c039553d226caaadb14d2547afa7b2fc84d" exitCode=0
Jul 28 19:35:51.857486 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:51.857463    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvbn2" event={"ID":"ca89023a-f6e3-4afd-949b-a33cc95a0f21","Type":"ContainerDied","Data":"5d6bbcfd3d31324fb422624a19ff7c039553d226caaadb14d2547afa7b2fc84d"}
Jul 28 19:35:52.598356 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:52.598325    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:52.598502 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:52.598426    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:52.862358 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:52.862272    2563 generic.go:356] "Generic (PLEG): container finished" podID="ca89023a-f6e3-4afd-949b-a33cc95a0f21" containerID="608edcd24cf54ad5afb277738a3c37696dd37486a04dd49ea6232e084858085c" exitCode=0
Jul 28 19:35:52.862358 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:52.862328    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvbn2" event={"ID":"ca89023a-f6e3-4afd-949b-a33cc95a0f21","Type":"ContainerDied","Data":"608edcd24cf54ad5afb277738a3c37696dd37486a04dd49ea6232e084858085c"}
Jul 28 19:35:53.598283 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:53.598251    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:53.598452 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:53.598251    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:53.598452 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:53.598359    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:53.598521 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:53.598464    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:53.867592 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:53.867499    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvbn2" event={"ID":"ca89023a-f6e3-4afd-949b-a33cc95a0f21","Type":"ContainerStarted","Data":"a26885dc2f37bf80e9bd65614a95a5a62147ee63620cec4d66592afafa8d52a0"}
Jul 28 19:35:53.892500 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:53.892456    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gvbn2" podStartSLOduration=8.428512031 podStartE2EDuration="37.892442867s" totalImagesPullingTime="29.463930836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:35:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:35:53.892202679 +0000 UTC m=+38.914498271" watchObservedRunningTime="2026-07-28 19:35:53.892442867 +0000 UTC m=+38.914738455"
Jul 28 19:35:54.598492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:54.598444    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:54.598678 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:54.598577    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:55.599174 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:55.599001    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:55.599631 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:55.599231    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:55.599631 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:55.599070    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:55.599631 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:55.599301    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:56.598751 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:56.598721    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:56.598942 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:56.598831    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:57.598931 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:57.598899    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:57.599316 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:57.599011    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:57.599316 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:57.599075    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:57.599316 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:57.599186    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:35:58.597877 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:58.597841    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:35:58.598069 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:58.597947    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:35:59.598699 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:59.598664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:35:59.598699 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:35:59.598664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:35:59.599228 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:59.598792    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:35:59.599228 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:35:59.598897    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:36:00.598374 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:00.598340    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:36:00.598561 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:00.598440    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:36:01.598022 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:01.597988    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:36:01.598022 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:01.598017    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:36:01.598531 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:01.598133    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:36:01.598531 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:01.598263    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:36:02.598230 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:02.598199    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:36:02.598640 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:02.598291    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:36:03.598400 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:03.598364    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:36:03.598790 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:03.598367    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:36:03.598790 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:03.598484    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:36:03.598790 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:03.598556    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:36:04.561462 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:04.561420    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hgp4z"]
Jul 28 19:36:04.561641 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:04.561564    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:36:04.561706 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:04.561674    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:36:04.564598 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:04.564571    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5lcrt"]
Jul 28 19:36:04.564837 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:04.564817    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:36:04.564961 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:04.564925    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:36:04.565628 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:04.565321    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8jk5c"]
Jul 28 19:36:04.565628 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:04.565404    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:36:04.565628 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:04.565489    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:36:06.597931 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:06.597847    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:36:06.598534 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:06.597940    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:36:06.598534 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:06.597947    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:36:06.598534 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:06.597943    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hgp4z" podUID="629cd422-6046-4ea3-a44c-f6827df3a514"
Jul 28 19:36:06.598534 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:06.598027    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5lcrt" podUID="3e3f57e8-e5e3-446b-bca9-fddbef67f811"
Jul 28 19:36:06.598534 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:06.598101    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8jk5c" podUID="191fd4a7-d59c-4959-a921-d2e794b4e026"
Jul 28 19:36:08.272283 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.272261    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-52.ec2.internal" event="NodeReady"
Jul 28 19:36:08.272804 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.272406    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 19:36:08.318246 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.318193    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rlpcr"]
Jul 28 19:36:08.335357 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.335268    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4jwdx"]
Jul 28 19:36:08.337054 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.337029    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:08.341507 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.341482    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 19:36:08.341646 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.341557    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lt6xm\""
Jul 28 19:36:08.341930 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.341915    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 19:36:08.347057 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.347041    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rlpcr"]
Jul 28 19:36:08.347128 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.347070    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4jwdx"]
Jul 28 19:36:08.347167 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.347154    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4jwdx"
Jul 28 19:36:08.349735 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.349717    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 19:36:08.349831 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.349742    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 19:36:08.349831 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.349760    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 19:36:08.349831 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.349722    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cpl6j\""
Jul 28 19:36:08.353869 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.353851    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dzzb7"]
Jul 28 19:36:08.367677 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.367658    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dzzb7"]
Jul 28 19:36:08.367790 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.367738    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.370401 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.370380    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 19:36:08.370786 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.370773    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rtz66\""
Jul 28 19:36:08.371234 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.371216    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 19:36:08.371309 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.371246    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 19:36:08.371309 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.371220    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 19:36:08.403100 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.403073    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv7w9\" (UniqueName: \"kubernetes.io/projected/a1d182ea-87e0-4a68-9df6-dc75285ac107-kube-api-access-lv7w9\") pod \"insights-runtime-extractor-dzzb7\" (UID: \"a1d182ea-87e0-4a68-9df6-dc75285ac107\") " pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.403100 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.403101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1d182ea-87e0-4a68-9df6-dc75285ac107-crio-socket\") pod \"insights-runtime-extractor-dzzb7\" (UID: \"a1d182ea-87e0-4a68-9df6-dc75285ac107\") " pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.403242 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.403118    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf31643f-bcdc-4378-902e-760a2ea0ccf8-metrics-tls\") pod \"dns-default-rlpcr\" (UID: \"cf31643f-bcdc-4378-902e-760a2ea0ccf8\") " pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:08.403242 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.403196    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1d182ea-87e0-4a68-9df6-dc75285ac107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzzb7\" (UID: \"a1d182ea-87e0-4a68-9df6-dc75285ac107\") " pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.403242 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.403222    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlh6l\" (UniqueName: \"kubernetes.io/projected/3dcd9731-9461-4b95-b1ce-2cb8cfc61537-kube-api-access-qlh6l\") pod \"ingress-canary-4jwdx\" (UID: \"3dcd9731-9461-4b95-b1ce-2cb8cfc61537\") " pod="openshift-ingress-canary/ingress-canary-4jwdx"
Jul 28 19:36:08.403242 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.403237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rvzx\" (UniqueName: \"kubernetes.io/projected/cf31643f-bcdc-4378-902e-760a2ea0ccf8-kube-api-access-8rvzx\") pod \"dns-default-rlpcr\" (UID: \"cf31643f-bcdc-4378-902e-760a2ea0ccf8\") " pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:08.403366 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.403298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3dcd9731-9461-4b95-b1ce-2cb8cfc61537-cert\") pod \"ingress-canary-4jwdx\" (UID: \"3dcd9731-9461-4b95-b1ce-2cb8cfc61537\") " pod="openshift-ingress-canary/ingress-canary-4jwdx"
Jul 28 19:36:08.403366 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.403321    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1d182ea-87e0-4a68-9df6-dc75285ac107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzzb7\" (UID: \"a1d182ea-87e0-4a68-9df6-dc75285ac107\") " pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.403366 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.403339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf31643f-bcdc-4378-902e-760a2ea0ccf8-tmp-dir\") pod \"dns-default-rlpcr\" (UID: \"cf31643f-bcdc-4378-902e-760a2ea0ccf8\") " pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:08.403455 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.403368    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf31643f-bcdc-4378-902e-760a2ea0ccf8-config-volume\") pod \"dns-default-rlpcr\" (UID: \"cf31643f-bcdc-4378-902e-760a2ea0ccf8\") " pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:08.403455 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.403388    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1d182ea-87e0-4a68-9df6-dc75285ac107-data-volume\") pod \"insights-runtime-extractor-dzzb7\" (UID: \"a1d182ea-87e0-4a68-9df6-dc75285ac107\") " pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.504217 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.504181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlh6l\" (UniqueName: \"kubernetes.io/projected/3dcd9731-9461-4b95-b1ce-2cb8cfc61537-kube-api-access-qlh6l\") pod \"ingress-canary-4jwdx\" (UID: \"3dcd9731-9461-4b95-b1ce-2cb8cfc61537\") " pod="openshift-ingress-canary/ingress-canary-4jwdx"
Jul 28 19:36:08.504217 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.504220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rvzx\" (UniqueName: \"kubernetes.io/projected/cf31643f-bcdc-4378-902e-760a2ea0ccf8-kube-api-access-8rvzx\") pod \"dns-default-rlpcr\" (UID: \"cf31643f-bcdc-4378-902e-760a2ea0ccf8\") " pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:08.504481 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.504255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3dcd9731-9461-4b95-b1ce-2cb8cfc61537-cert\") pod \"ingress-canary-4jwdx\" (UID: \"3dcd9731-9461-4b95-b1ce-2cb8cfc61537\") " pod="openshift-ingress-canary/ingress-canary-4jwdx"
Jul 28 19:36:08.504481 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.504277    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1d182ea-87e0-4a68-9df6-dc75285ac107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzzb7\" (UID: \"a1d182ea-87e0-4a68-9df6-dc75285ac107\") " pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.504481 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.504299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf31643f-bcdc-4378-902e-760a2ea0ccf8-tmp-dir\") pod \"dns-default-rlpcr\" (UID: \"cf31643f-bcdc-4378-902e-760a2ea0ccf8\") " pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:08.504481 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.504339    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf31643f-bcdc-4378-902e-760a2ea0ccf8-config-volume\") pod \"dns-default-rlpcr\" (UID: \"cf31643f-bcdc-4378-902e-760a2ea0ccf8\") " pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:08.504481 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.504373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1d182ea-87e0-4a68-9df6-dc75285ac107-data-volume\") pod \"insights-runtime-extractor-dzzb7\" (UID: \"a1d182ea-87e0-4a68-9df6-dc75285ac107\") " pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.504481 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.504401    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv7w9\" (UniqueName: \"kubernetes.io/projected/a1d182ea-87e0-4a68-9df6-dc75285ac107-kube-api-access-lv7w9\") pod \"insights-runtime-extractor-dzzb7\" (UID: \"a1d182ea-87e0-4a68-9df6-dc75285ac107\") " pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.504481 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.504429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1d182ea-87e0-4a68-9df6-dc75285ac107-crio-socket\") pod \"insights-runtime-extractor-dzzb7\" (UID: \"a1d182ea-87e0-4a68-9df6-dc75285ac107\") " pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.504481 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.504457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf31643f-bcdc-4378-902e-760a2ea0ccf8-metrics-tls\") pod \"dns-default-rlpcr\" (UID: \"cf31643f-bcdc-4378-902e-760a2ea0ccf8\") " pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:08.504902 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.504509    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1d182ea-87e0-4a68-9df6-dc75285ac107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzzb7\" (UID: \"a1d182ea-87e0-4a68-9df6-dc75285ac107\") " pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.504902 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.504719    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1d182ea-87e0-4a68-9df6-dc75285ac107-crio-socket\") pod \"insights-runtime-extractor-dzzb7\" (UID: \"a1d182ea-87e0-4a68-9df6-dc75285ac107\") " pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.504902 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.504737    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf31643f-bcdc-4378-902e-760a2ea0ccf8-tmp-dir\") pod \"dns-default-rlpcr\" (UID: \"cf31643f-bcdc-4378-902e-760a2ea0ccf8\") " pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:08.504902 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.504762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1d182ea-87e0-4a68-9df6-dc75285ac107-data-volume\") pod \"insights-runtime-extractor-dzzb7\" (UID: \"a1d182ea-87e0-4a68-9df6-dc75285ac107\") " pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.505170 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.505149    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf31643f-bcdc-4378-902e-760a2ea0ccf8-config-volume\") pod \"dns-default-rlpcr\" (UID: \"cf31643f-bcdc-4378-902e-760a2ea0ccf8\") " pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:08.508231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.508126    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1d182ea-87e0-4a68-9df6-dc75285ac107-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dzzb7\" (UID: \"a1d182ea-87e0-4a68-9df6-dc75285ac107\") " pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.508341 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.508131    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf31643f-bcdc-4378-902e-760a2ea0ccf8-metrics-tls\") pod \"dns-default-rlpcr\" (UID: \"cf31643f-bcdc-4378-902e-760a2ea0ccf8\") " pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:08.508341 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.508215    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3dcd9731-9461-4b95-b1ce-2cb8cfc61537-cert\") pod \"ingress-canary-4jwdx\" (UID: \"3dcd9731-9461-4b95-b1ce-2cb8cfc61537\") " pod="openshift-ingress-canary/ingress-canary-4jwdx"
Jul 28 19:36:08.511923 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.511901    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rvzx\" (UniqueName: \"kubernetes.io/projected/cf31643f-bcdc-4378-902e-760a2ea0ccf8-kube-api-access-8rvzx\") pod \"dns-default-rlpcr\" (UID: \"cf31643f-bcdc-4378-902e-760a2ea0ccf8\") " pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:08.512268 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.512243    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1d182ea-87e0-4a68-9df6-dc75285ac107-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dzzb7\" (UID: \"a1d182ea-87e0-4a68-9df6-dc75285ac107\") " pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.512534 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.512514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv7w9\" (UniqueName: \"kubernetes.io/projected/a1d182ea-87e0-4a68-9df6-dc75285ac107-kube-api-access-lv7w9\") pod \"insights-runtime-extractor-dzzb7\" (UID: \"a1d182ea-87e0-4a68-9df6-dc75285ac107\") " pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.512670 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.512636    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlh6l\" (UniqueName: \"kubernetes.io/projected/3dcd9731-9461-4b95-b1ce-2cb8cfc61537-kube-api-access-qlh6l\") pod \"ingress-canary-4jwdx\" (UID: \"3dcd9731-9461-4b95-b1ce-2cb8cfc61537\") " pod="openshift-ingress-canary/ingress-canary-4jwdx"
Jul 28 19:36:08.598592 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.598484    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:36:08.598592 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.598484    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:36:08.598820 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.598484    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:36:08.601354 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.601321    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 19:36:08.601469 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.601349    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 19:36:08.601469 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.601424    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 19:36:08.601469 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.601437    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jglff\""
Jul 28 19:36:08.601469 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.601441    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 19:36:08.601699 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.601492    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vbfhc\""
Jul 28 19:36:08.646902 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.646872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:08.654970 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.654952    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4jwdx"
Jul 28 19:36:08.676153 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.676133    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dzzb7"
Jul 28 19:36:08.856358 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.856282    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4jwdx"]
Jul 28 19:36:08.859257 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.859039    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rlpcr"]
Jul 28 19:36:08.861379 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:36:08.861355    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dcd9731_9461_4b95_b1ce_2cb8cfc61537.slice/crio-fe9875d2069de3179cf2cc2f7d1c6949cad9b264423fe1361ad87bd1704a8757 WatchSource:0}: Error finding container fe9875d2069de3179cf2cc2f7d1c6949cad9b264423fe1361ad87bd1704a8757: Status 404 returned error can't find the container with id fe9875d2069de3179cf2cc2f7d1c6949cad9b264423fe1361ad87bd1704a8757
Jul 28 19:36:08.862048 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:36:08.862025    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf31643f_bcdc_4378_902e_760a2ea0ccf8.slice/crio-c3509953561da7a4e5e05fbde5c0b1c9ff846d233fb7bb7818700e1726022eb6 WatchSource:0}: Error finding container c3509953561da7a4e5e05fbde5c0b1c9ff846d233fb7bb7818700e1726022eb6: Status 404 returned error can't find the container with id c3509953561da7a4e5e05fbde5c0b1c9ff846d233fb7bb7818700e1726022eb6
Jul 28 19:36:08.865207 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.865190    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dzzb7"]
Jul 28 19:36:08.874897 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:36:08.874873    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d182ea_87e0_4a68_9df6_dc75285ac107.slice/crio-dba3234dc0d42bc2ed4c245b36eb89f7e03276b4026dad0320a5b3a20b002e11 WatchSource:0}: Error finding container dba3234dc0d42bc2ed4c245b36eb89f7e03276b4026dad0320a5b3a20b002e11: Status 404 returned error can't find the container with id dba3234dc0d42bc2ed4c245b36eb89f7e03276b4026dad0320a5b3a20b002e11
Jul 28 19:36:08.899594 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.899564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4jwdx" event={"ID":"3dcd9731-9461-4b95-b1ce-2cb8cfc61537","Type":"ContainerStarted","Data":"fe9875d2069de3179cf2cc2f7d1c6949cad9b264423fe1361ad87bd1704a8757"}
Jul 28 19:36:08.900492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.900476    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rlpcr" event={"ID":"cf31643f-bcdc-4378-902e-760a2ea0ccf8","Type":"ContainerStarted","Data":"c3509953561da7a4e5e05fbde5c0b1c9ff846d233fb7bb7818700e1726022eb6"}
Jul 28 19:36:08.901603 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:08.901580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzzb7" event={"ID":"a1d182ea-87e0-4a68-9df6-dc75285ac107","Type":"ContainerStarted","Data":"dba3234dc0d42bc2ed4c245b36eb89f7e03276b4026dad0320a5b3a20b002e11"}
Jul 28 19:36:14.288794 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.288749    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ddd55ddd8-p4x9w"]
Jul 28 19:36:14.293921 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.293899    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.296349 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.296320    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 19:36:14.297392 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.297367    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dkbk4\""
Jul 28 19:36:14.297508 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.297401    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 19:36:14.297684 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.297658    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 19:36:14.297684 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.297681    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 19:36:14.297851 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.297763    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 19:36:14.297959 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.297928    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 19:36:14.298067 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.298017    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 19:36:14.303369 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.302014    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 19:36:14.303369 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.303126    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ddd55ddd8-p4x9w"]
Jul 28 19:36:14.351969 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.351932    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9lxl\" (UniqueName: \"kubernetes.io/projected/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-kube-api-access-m9lxl\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.352131 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.351999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-oauth-config\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.352131 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.352060    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-trusted-ca-bundle\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.352131 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.352113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-oauth-serving-cert\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.352242 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.352155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-serving-cert\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.352242 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.352181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-service-ca\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.352309 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.352254    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-config\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.453026 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.452992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-config\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.453026 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.453032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9lxl\" (UniqueName: \"kubernetes.io/projected/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-kube-api-access-m9lxl\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.453240 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.453079    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-oauth-config\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.453240 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.453096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-trusted-ca-bundle\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.453240 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.453113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-oauth-serving-cert\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.453240 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.453153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-serving-cert\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.453240 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.453174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-service-ca\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.453827 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.453777    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-config\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.453955 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.453834    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-service-ca\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.454111 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.454087    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-oauth-serving-cert\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.454460 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.454439    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-trusted-ca-bundle\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.457317 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.457297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-oauth-config\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.457403 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.457317    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-serving-cert\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.461619 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.461450    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9lxl\" (UniqueName: \"kubernetes.io/projected/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-kube-api-access-m9lxl\") pod \"console-7ddd55ddd8-p4x9w\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") " pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.607056 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.606964    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:14.821948 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.821911    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ddd55ddd8-p4x9w"]
Jul 28 19:36:14.829530 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:36:14.829492    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6dc9751_ed0e_48e6_bbc4_8bb1b0f7eff2.slice/crio-40286f89dc4e1caf4990e54d904c961f7e56bb26f42e8ea440a70b47fc7356b8 WatchSource:0}: Error finding container 40286f89dc4e1caf4990e54d904c961f7e56bb26f42e8ea440a70b47fc7356b8: Status 404 returned error can't find the container with id 40286f89dc4e1caf4990e54d904c961f7e56bb26f42e8ea440a70b47fc7356b8
Jul 28 19:36:14.918653 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.918618    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddd55ddd8-p4x9w" event={"ID":"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2","Type":"ContainerStarted","Data":"40286f89dc4e1caf4990e54d904c961f7e56bb26f42e8ea440a70b47fc7356b8"}
Jul 28 19:36:14.921102 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.921075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4jwdx" event={"ID":"3dcd9731-9461-4b95-b1ce-2cb8cfc61537","Type":"ContainerStarted","Data":"547fb3a3c4fadd031b49bed47efaeefebf2112d7ff9a04984b28aaaf38c46909"}
Jul 28 19:36:14.923522 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.923497    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rlpcr" event={"ID":"cf31643f-bcdc-4378-902e-760a2ea0ccf8","Type":"ContainerStarted","Data":"33f47aeb2087c17e3949a3c390489b287c46940b572dfc69b7e3efd0f6366668"}
Jul 28 19:36:14.923637 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.923559    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:14.923637 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.923584    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rlpcr" event={"ID":"cf31643f-bcdc-4378-902e-760a2ea0ccf8","Type":"ContainerStarted","Data":"3ae7c1337fe72d0310a4df8351e8048483959ae2b017aaf62a598610e8b5e9ae"}
Jul 28 19:36:14.925362 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.925341    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzzb7" event={"ID":"a1d182ea-87e0-4a68-9df6-dc75285ac107","Type":"ContainerStarted","Data":"9588d11da012731b8c047ad1f9024a46ce5ef80092f6b0bacdf218d237d6cb11"}
Jul 28 19:36:14.938612 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.938420    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4jwdx" podStartSLOduration=1.135265315 podStartE2EDuration="6.938408601s" totalImagesPullingTime="5.803143286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:14.937839369 +0000 UTC m=+59.960134958" watchObservedRunningTime="2026-07-28 19:36:14.938408601 +0000 UTC m=+59.960704189"
Jul 28 19:36:14.955641 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:14.955560    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rlpcr" podStartSLOduration=1.152964819 podStartE2EDuration="6.955518201s" totalImagesPullingTime="5.802553382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:14.954760855 +0000 UTC m=+59.977056446" watchObservedRunningTime="2026-07-28 19:36:14.955518201 +0000 UTC m=+59.977813791"
Jul 28 19:36:17.855761 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:17.855720    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r2vvp"
Jul 28 19:36:19.946597 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:19.946496    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzzb7" event={"ID":"a1d182ea-87e0-4a68-9df6-dc75285ac107","Type":"ContainerStarted","Data":"39c15a629fcca8f313f71f9c7a209dd7ab3edaf783b0dcf440d5bc0ceaaf1199"}
Jul 28 19:36:19.947901 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:19.947879    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddd55ddd8-p4x9w" event={"ID":"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2","Type":"ContainerStarted","Data":"8657541395eb02509091ca79b77eb56f23b25070ca869af25425640bd5f5e49b"}
Jul 28 19:36:19.966504 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:19.966466    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ddd55ddd8-p4x9w" podStartSLOduration=1.201708696 podStartE2EDuration="5.966453121s" totalImagesPullingTime="4.764744425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:19.965048196 +0000 UTC m=+64.987343795" watchObservedRunningTime="2026-07-28 19:36:19.966453121 +0000 UTC m=+64.988748687"
Jul 28 19:36:21.213150 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:21.213115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs\") pod \"network-metrics-daemon-8jk5c\" (UID: \"191fd4a7-d59c-4959-a921-d2e794b4e026\") " pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:36:21.215692 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:21.215667    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 19:36:21.227737 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:21.227708    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/191fd4a7-d59c-4959-a921-d2e794b4e026-metrics-certs\") pod \"network-metrics-daemon-8jk5c\" (UID: \"191fd4a7-d59c-4959-a921-d2e794b4e026\") " pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:36:21.314048 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:21.314010    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:36:21.314248 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:21.314071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgnh9\" (UniqueName: \"kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9\") pod \"network-check-target-hgp4z\" (UID: \"629cd422-6046-4ea3-a44c-f6827df3a514\") " pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:36:21.316558 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:21.316525    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 19:36:21.316558 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:21.316553    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 19:36:21.326773 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:21.326749    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 19:36:21.326882 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:21.326801    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3e3f57e8-e5e3-446b-bca9-fddbef67f811-original-pull-secret\") pod \"global-pull-secret-syncer-5lcrt\" (UID: \"3e3f57e8-e5e3-446b-bca9-fddbef67f811\") " pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:36:21.337125 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:21.337103    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgnh9\" (UniqueName: \"kubernetes.io/projected/629cd422-6046-4ea3-a44c-f6827df3a514-kube-api-access-dgnh9\") pod \"network-check-target-hgp4z\" (UID: \"629cd422-6046-4ea3-a44c-f6827df3a514\") " pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:36:21.510529 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:21.510500    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vbfhc\""
Jul 28 19:36:21.515601 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:21.515569    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jglff\""
Jul 28 19:36:21.518495 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:21.518473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8jk5c"
Jul 28 19:36:21.518643 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:21.518601    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5lcrt"
Jul 28 19:36:21.523777 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:21.523759    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:36:23.151078 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:23.151046    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8jk5c"]
Jul 28 19:36:23.158069 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:36:23.158044    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod191fd4a7_d59c_4959_a921_d2e794b4e026.slice/crio-1ce4aa58332344b5b6572edd87280dd141f68a22ca6ef62235829c2901a106be WatchSource:0}: Error finding container 1ce4aa58332344b5b6572edd87280dd141f68a22ca6ef62235829c2901a106be: Status 404 returned error can't find the container with id 1ce4aa58332344b5b6572edd87280dd141f68a22ca6ef62235829c2901a106be
Jul 28 19:36:23.166871 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:23.166837    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hgp4z"]
Jul 28 19:36:23.170365 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:36:23.170338    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629cd422_6046_4ea3_a44c_f6827df3a514.slice/crio-77dff07b0086a7950be38f354e5081a31e4fa1012eba919ca45f32bc008808f4 WatchSource:0}: Error finding container 77dff07b0086a7950be38f354e5081a31e4fa1012eba919ca45f32bc008808f4: Status 404 returned error can't find the container with id 77dff07b0086a7950be38f354e5081a31e4fa1012eba919ca45f32bc008808f4
Jul 28 19:36:23.181193 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:23.181141    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5lcrt"]
Jul 28 19:36:23.184298 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:36:23.184268    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e3f57e8_e5e3_446b_bca9_fddbef67f811.slice/crio-719c08f381f581a2cf30a1648e1279a35de1b06a67655314df5d05058b9877e1 WatchSource:0}: Error finding container 719c08f381f581a2cf30a1648e1279a35de1b06a67655314df5d05058b9877e1: Status 404 returned error can't find the container with id 719c08f381f581a2cf30a1648e1279a35de1b06a67655314df5d05058b9877e1
Jul 28 19:36:23.964843 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:23.964800    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8jk5c" event={"ID":"191fd4a7-d59c-4959-a921-d2e794b4e026","Type":"ContainerStarted","Data":"1ce4aa58332344b5b6572edd87280dd141f68a22ca6ef62235829c2901a106be"}
Jul 28 19:36:23.966313 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:23.966159    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5lcrt" event={"ID":"3e3f57e8-e5e3-446b-bca9-fddbef67f811","Type":"ContainerStarted","Data":"719c08f381f581a2cf30a1648e1279a35de1b06a67655314df5d05058b9877e1"}
Jul 28 19:36:23.969905 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:23.969871    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dzzb7" event={"ID":"a1d182ea-87e0-4a68-9df6-dc75285ac107","Type":"ContainerStarted","Data":"41db6bb3dbd16c979961609069d9b951c36c77d1843a1da261f902c155f1289f"}
Jul 28 19:36:23.972469 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:23.972434    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hgp4z" event={"ID":"629cd422-6046-4ea3-a44c-f6827df3a514","Type":"ContainerStarted","Data":"77dff07b0086a7950be38f354e5081a31e4fa1012eba919ca45f32bc008808f4"}
Jul 28 19:36:23.990166 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:23.990048    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dzzb7" podStartSLOduration=1.939894641 podStartE2EDuration="15.990027417s" totalImagesPullingTime="14.050132776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:36:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:23.988655971 +0000 UTC m=+69.010951563" watchObservedRunningTime="2026-07-28 19:36:23.990027417 +0000 UTC m=+69.012323007"
Jul 28 19:36:24.607980 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:24.607952    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:24.608434 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:24.608017    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:24.614342 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:24.614320    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:24.933559 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:24.933514    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rlpcr"
Jul 28 19:36:24.980508 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:24.980440    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8jk5c" event={"ID":"191fd4a7-d59c-4959-a921-d2e794b4e026","Type":"ContainerStarted","Data":"860151344b82bbc58ed5daf148a3c409ab82a9f173aabf6b5e7a3952bb56dbbd"}
Jul 28 19:36:24.980508 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:24.980503    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8jk5c" event={"ID":"191fd4a7-d59c-4959-a921-d2e794b4e026","Type":"ContainerStarted","Data":"e6b5bb8e5ecfb455ad6f43625bcd471724d015723d94886f1c83dfe195de728b"}
Jul 28 19:36:24.985937 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:24.985913    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:36:24.999519 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:24.999476    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8jk5c" podStartSLOduration=67.648041733 podStartE2EDuration="1m8.999462998s" totalImagesPullingTime="1.351421265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:24.998738899 +0000 UTC m=+70.021034488" watchObservedRunningTime="2026-07-28 19:36:24.999462998 +0000 UTC m=+70.021758586"
Jul 28 19:36:27.991944 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:27.991837    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hgp4z" event={"ID":"629cd422-6046-4ea3-a44c-f6827df3a514","Type":"ContainerStarted","Data":"2dea3ff3c892e4da39c20d19711b5b199b6345b88ead1a209f2077bd3922aa27"}
Jul 28 19:36:27.991944 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:27.991907    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:36:27.993165 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:27.993145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5lcrt" event={"ID":"3e3f57e8-e5e3-446b-bca9-fddbef67f811","Type":"ContainerStarted","Data":"e749743519fce812a68aa4543525058c2d24a85cab941fcd552cb81a594022b8"}
Jul 28 19:36:28.006771 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:28.006657    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hgp4z" podStartSLOduration=67.536041618 podStartE2EDuration="1m12.006642015s" totalImagesPullingTime="4.470600397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:28.006150644 +0000 UTC m=+73.028446251" watchObservedRunningTime="2026-07-28 19:36:28.006642015 +0000 UTC m=+73.028937603"
Jul 28 19:36:28.019515 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:28.019466    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5lcrt" podStartSLOduration=67.557705835 podStartE2EDuration="1m12.019449343s" totalImagesPullingTime="4.461743508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 19:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:28.019014195 +0000 UTC m=+73.041309784" watchObservedRunningTime="2026-07-28 19:36:28.019449343 +0000 UTC m=+73.041744932"
Jul 28 19:36:29.274854 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.274820    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"]
Jul 28 19:36:29.276955 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.276940    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"
Jul 28 19:36:29.280290 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.280265    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 19:36:29.280393 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.280289    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 28 19:36:29.280393 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.280339    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 19:36:29.280393 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.280266    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 28 19:36:29.280527 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.280393    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-djpww\""
Jul 28 19:36:29.280626 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.280613    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 19:36:29.287836 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.287816    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"]
Jul 28 19:36:29.371993 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.371931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1addcde-ec10-4b1d-b0b7-9e7c552d2b86-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-6t6d4\" (UID: \"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"
Jul 28 19:36:29.371993 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.371991    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1addcde-ec10-4b1d-b0b7-9e7c552d2b86-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-6t6d4\" (UID: \"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"
Jul 28 19:36:29.372317 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.372017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1addcde-ec10-4b1d-b0b7-9e7c552d2b86-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-6t6d4\" (UID: \"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"
Jul 28 19:36:29.372317 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.372035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5gm9\" (UniqueName: \"kubernetes.io/projected/c1addcde-ec10-4b1d-b0b7-9e7c552d2b86-kube-api-access-g5gm9\") pod \"prometheus-operator-84d69f794d-6t6d4\" (UID: \"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"
Jul 28 19:36:29.472798 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.472763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1addcde-ec10-4b1d-b0b7-9e7c552d2b86-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-6t6d4\" (UID: \"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"
Jul 28 19:36:29.472798 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.472801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1addcde-ec10-4b1d-b0b7-9e7c552d2b86-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-6t6d4\" (UID: \"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"
Jul 28 19:36:29.473022 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.472833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1addcde-ec10-4b1d-b0b7-9e7c552d2b86-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-6t6d4\" (UID: \"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"
Jul 28 19:36:29.473022 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.472866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5gm9\" (UniqueName: \"kubernetes.io/projected/c1addcde-ec10-4b1d-b0b7-9e7c552d2b86-kube-api-access-g5gm9\") pod \"prometheus-operator-84d69f794d-6t6d4\" (UID: \"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"
Jul 28 19:36:29.473022 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:29.472995    2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 28 19:36:29.473171 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:29.473069    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1addcde-ec10-4b1d-b0b7-9e7c552d2b86-prometheus-operator-tls podName:c1addcde-ec10-4b1d-b0b7-9e7c552d2b86 nodeName:}" failed. No retries permitted until 2026-07-28 19:36:29.973050189 +0000 UTC m=+74.995345758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c1addcde-ec10-4b1d-b0b7-9e7c552d2b86-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-6t6d4" (UID: "c1addcde-ec10-4b1d-b0b7-9e7c552d2b86") : secret "prometheus-operator-tls" not found
Jul 28 19:36:29.477224 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.473425    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1addcde-ec10-4b1d-b0b7-9e7c552d2b86-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-6t6d4\" (UID: \"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"
Jul 28 19:36:29.477224 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.475043    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1addcde-ec10-4b1d-b0b7-9e7c552d2b86-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-6t6d4\" (UID: \"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"
Jul 28 19:36:29.484425 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.484402    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5gm9\" (UniqueName: \"kubernetes.io/projected/c1addcde-ec10-4b1d-b0b7-9e7c552d2b86-kube-api-access-g5gm9\") pod \"prometheus-operator-84d69f794d-6t6d4\" (UID: \"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"
Jul 28 19:36:29.977022 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.976987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1addcde-ec10-4b1d-b0b7-9e7c552d2b86-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-6t6d4\" (UID: \"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"
Jul 28 19:36:29.979261 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:29.979242    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1addcde-ec10-4b1d-b0b7-9e7c552d2b86-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-6t6d4\" (UID: \"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"
Jul 28 19:36:30.185560 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:30.185504    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"
Jul 28 19:36:30.307279 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:30.307249    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-6t6d4"]
Jul 28 19:36:30.309920 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:36:30.309897    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1addcde_ec10_4b1d_b0b7_9e7c552d2b86.slice/crio-61dc996612aa75aecb1d2e02c1303277ca566c94b261f695c7003c9b3c283d7f WatchSource:0}: Error finding container 61dc996612aa75aecb1d2e02c1303277ca566c94b261f695c7003c9b3c283d7f: Status 404 returned error can't find the container with id 61dc996612aa75aecb1d2e02c1303277ca566c94b261f695c7003c9b3c283d7f
Jul 28 19:36:31.002264 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:31.002233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4" event={"ID":"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86","Type":"ContainerStarted","Data":"61dc996612aa75aecb1d2e02c1303277ca566c94b261f695c7003c9b3c283d7f"}
Jul 28 19:36:32.007185 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:32.007145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4" event={"ID":"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86","Type":"ContainerStarted","Data":"d17e09be099ff4b2f29967da2cf135fb9d1c2379c058241615bcdfba3c3f81f0"}
Jul 28 19:36:32.007607 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:32.007235    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4" event={"ID":"c1addcde-ec10-4b1d-b0b7-9e7c552d2b86","Type":"ContainerStarted","Data":"fa4a97bf314df470e028e88f228bb29bc8dd623009745516dc87b1bab945a34c"}
Jul 28 19:36:32.026556 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:32.026505    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-6t6d4" podStartSLOduration=1.732425524 podStartE2EDuration="3.02649107s" totalImagesPullingTime="1.294065546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:32.025341255 +0000 UTC m=+77.047636843" watchObservedRunningTime="2026-07-28 19:36:32.02649107 +0000 UTC m=+77.048786657"
Jul 28 19:36:33.680306 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.680267    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j9prd"]
Jul 28 19:36:33.682598 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.682579    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.685257 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.685241    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 19:36:33.685533 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.685519    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 19:36:33.685853 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.685835    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 19:36:33.687595 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.687578    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8dtwl\""
Jul 28 19:36:33.804634 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.804601    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/783ae030-92bb-4dda-81cd-56873afb6b9a-root\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.804634 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.804633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-textfile\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.804837 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.804658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/783ae030-92bb-4dda-81cd-56873afb6b9a-sys\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.804837 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.804684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.804837 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.804768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/783ae030-92bb-4dda-81cd-56873afb6b9a-metrics-client-ca\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.804837 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.804796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-wtmp\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.804837 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.804813    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.804837 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.804840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-tls\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.805034 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.804884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x4wj\" (UniqueName: \"kubernetes.io/projected/783ae030-92bb-4dda-81cd-56873afb6b9a-kube-api-access-5x4wj\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.905992 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.905962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/783ae030-92bb-4dda-81cd-56873afb6b9a-metrics-client-ca\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.906157 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.906002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-wtmp\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.906157 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.906020    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.906157 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.906041    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-tls\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.906293 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.906174    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-wtmp\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.906293 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.906239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x4wj\" (UniqueName: \"kubernetes.io/projected/783ae030-92bb-4dda-81cd-56873afb6b9a-kube-api-access-5x4wj\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.906293 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:33.906264    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 19:36:33.906293 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.906277    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/783ae030-92bb-4dda-81cd-56873afb6b9a-root\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.906464 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.906304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-textfile\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.906464 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:33.906342    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-tls podName:783ae030-92bb-4dda-81cd-56873afb6b9a nodeName:}" failed. No retries permitted until 2026-07-28 19:36:34.406320874 +0000 UTC m=+79.428616452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-tls") pod "node-exporter-j9prd" (UID: "783ae030-92bb-4dda-81cd-56873afb6b9a") : secret "node-exporter-tls" not found
Jul 28 19:36:33.906464 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.906368    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/783ae030-92bb-4dda-81cd-56873afb6b9a-root\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.906464 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.906389    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/783ae030-92bb-4dda-81cd-56873afb6b9a-sys\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.906464 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.906421    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.906705 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.906513    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/783ae030-92bb-4dda-81cd-56873afb6b9a-sys\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.906705 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.906588    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-textfile\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.906705 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.906619    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/783ae030-92bb-4dda-81cd-56873afb6b9a-metrics-client-ca\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.906705 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.906682    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.908604 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.908581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:33.914036 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:33.914011    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x4wj\" (UniqueName: \"kubernetes.io/projected/783ae030-92bb-4dda-81cd-56873afb6b9a-kube-api-access-5x4wj\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:34.409871 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.409836    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-tls\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:34.412145 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.412113    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/783ae030-92bb-4dda-81cd-56873afb6b9a-node-exporter-tls\") pod \"node-exporter-j9prd\" (UID: \"783ae030-92bb-4dda-81cd-56873afb6b9a\") " pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:34.590814 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.590764    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j9prd"
Jul 28 19:36:34.601440 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:36:34.601408    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod783ae030_92bb_4dda_81cd_56873afb6b9a.slice/crio-a62285453c8962694eba159901b3a9f30376aa4091ac484b1c9425774b550744 WatchSource:0}: Error finding container a62285453c8962694eba159901b3a9f30376aa4091ac484b1c9425774b550744: Status 404 returned error can't find the container with id a62285453c8962694eba159901b3a9f30376aa4091ac484b1c9425774b550744
Jul 28 19:36:34.737077 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.736990    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 19:36:34.739835 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.739812    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.742811 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.742777    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 28 19:36:34.743163 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.743147    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 28 19:36:34.743294 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.743272    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 28 19:36:34.743402 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.743319    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 28 19:36:34.743402 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.743237    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 28 19:36:34.743402 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.743252    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-z2h56\""
Jul 28 19:36:34.743579 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.743276    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 28 19:36:34.743579 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.743317    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 28 19:36:34.743579 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.743198    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 28 19:36:34.743579 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.743484    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 28 19:36:34.755725 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.755703    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 19:36:34.812470 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.812437    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-config-out\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.812470 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.812473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.812704 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.812503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-web-config\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.812704 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.812525    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.812704 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.812586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8sqc\" (UniqueName: \"kubernetes.io/projected/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-kube-api-access-r8sqc\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.812704 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.812614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.812704 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.812673    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.812859 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.812745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.812859 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.812766    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.812859 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.812783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.812859 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.812806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.812859 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.812827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.812859 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.812852    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.913920 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.913881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-web-config\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.913920 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.913920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.914163 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.913948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8sqc\" (UniqueName: \"kubernetes.io/projected/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-kube-api-access-r8sqc\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.914163 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.914084    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.914163 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.914133    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.914317 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.914262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.914317 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.914302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.914411 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.914328    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.914411 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.914354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.914411 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.914385    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.914581 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.914429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.914581 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.914446    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.914581 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.914476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-config-out\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.914581 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.914501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.915056 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:34.914922    2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 28 19:36:34.915056 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:34.914999    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-main-tls podName:1ca56512-8ecf-4dff-8f93-388dc9c65fe0 nodeName:}" failed. No retries permitted until 2026-07-28 19:36:35.414978746 +0000 UTC m=+80.437274314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1ca56512-8ecf-4dff-8f93-388dc9c65fe0") : secret "alertmanager-main-tls" not found
Jul 28 19:36:34.915056 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.915017    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.915298 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.915261    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.917107 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.917046    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.917230 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.917195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-web-config\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.917327 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.917306    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-config-out\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.917601 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.917582    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.917686 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.917659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.917760 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.917746    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.917943 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.917923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.918839 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.918819    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:34.922996 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:34.922975    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8sqc\" (UniqueName: \"kubernetes.io/projected/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-kube-api-access-r8sqc\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:35.019973 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:35.019935    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9prd" event={"ID":"783ae030-92bb-4dda-81cd-56873afb6b9a","Type":"ContainerStarted","Data":"a62285453c8962694eba159901b3a9f30376aa4091ac484b1c9425774b550744"}
Jul 28 19:36:35.419398 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:35.419319    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:35.419554 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:35.419486    2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 28 19:36:35.419606 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:35.419593    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-main-tls podName:1ca56512-8ecf-4dff-8f93-388dc9c65fe0 nodeName:}" failed. No retries permitted until 2026-07-28 19:36:36.419572412 +0000 UTC m=+81.441867983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1ca56512-8ecf-4dff-8f93-388dc9c65fe0") : secret "alertmanager-main-tls" not found
Jul 28 19:36:36.025381 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:36.025345    2563 generic.go:356] "Generic (PLEG): container finished" podID="783ae030-92bb-4dda-81cd-56873afb6b9a" containerID="9afca8c7f02f6179e7941c60f85bc69b16b04381afa8bf3ba89b40d769c8830f" exitCode=0
Jul 28 19:36:36.025778 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:36.025423    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9prd" event={"ID":"783ae030-92bb-4dda-81cd-56873afb6b9a","Type":"ContainerDied","Data":"9afca8c7f02f6179e7941c60f85bc69b16b04381afa8bf3ba89b40d769c8830f"}
Jul 28 19:36:36.426775 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:36.426691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:36.432122 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:36.432099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ca56512-8ecf-4dff-8f93-388dc9c65fe0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ca56512-8ecf-4dff-8f93-388dc9c65fe0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:36.553529 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:36.553490    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 19:36:36.692758 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:36.692618    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 19:36:36.695050 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:36:36.695027    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca56512_8ecf_4dff_8f93_388dc9c65fe0.slice/crio-5c1d08fc0c2bbe67334153ed61aea346def75c0b1b4c4aa0a752b90330975c6f WatchSource:0}: Error finding container 5c1d08fc0c2bbe67334153ed61aea346def75c0b1b4c4aa0a752b90330975c6f: Status 404 returned error can't find the container with id 5c1d08fc0c2bbe67334153ed61aea346def75c0b1b4c4aa0a752b90330975c6f
Jul 28 19:36:37.030846 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:37.030812    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9prd" event={"ID":"783ae030-92bb-4dda-81cd-56873afb6b9a","Type":"ContainerStarted","Data":"cfc515e6f629916f1e0166bea618a63f5a23282efaf34d85662a54d0c5731f78"}
Jul 28 19:36:37.031299 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:37.030862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j9prd" event={"ID":"783ae030-92bb-4dda-81cd-56873afb6b9a","Type":"ContainerStarted","Data":"db7ef9fed9a1b59cc8e2c4ba01747f564e399798a2b4996fa4e40ac966d20143"}
Jul 28 19:36:37.032109 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:37.032087    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ca56512-8ecf-4dff-8f93-388dc9c65fe0","Type":"ContainerStarted","Data":"5c1d08fc0c2bbe67334153ed61aea346def75c0b1b4c4aa0a752b90330975c6f"}
Jul 28 19:36:37.050951 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:37.050516    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j9prd" podStartSLOduration=3.144293859 podStartE2EDuration="4.050495939s" totalImagesPullingTime="842.679524ms" totalInitContainerRuntime="63.522556ms" isStatefulPod=true podCreationTimestamp="2026-07-28 19:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:37.048287134 +0000 UTC m=+82.070582722" watchObservedRunningTime="2026-07-28 19:36:37.050495939 +0000 UTC m=+82.072791530"
Jul 28 19:36:38.036945 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.036913    2563 generic.go:356] "Generic (PLEG): container finished" podID="1ca56512-8ecf-4dff-8f93-388dc9c65fe0" containerID="dcb947c16fca0c78bd02f1ca6be99375bdf152855c1f3519c68c1e6660c9dec4" exitCode=0
Jul 28 19:36:38.037362 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.036999    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ca56512-8ecf-4dff-8f93-388dc9c65fe0","Type":"ContainerDied","Data":"dcb947c16fca0c78bd02f1ca6be99375bdf152855c1f3519c68c1e6660c9dec4"}
Jul 28 19:36:38.044411 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.044392    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7c6c74894d-ccx9h"]
Jul 28 19:36:38.046213 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.046195    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.048791 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.048759    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 28 19:36:38.048888 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.048820    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fbubfdp4asku9\""
Jul 28 19:36:38.048888 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.048820    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-chjsb\""
Jul 28 19:36:38.049778 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.049763    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 19:36:38.049837 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.049796    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 28 19:36:38.049837 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.049812    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 28 19:36:38.059119 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.059101    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c6c74894d-ccx9h"]
Jul 28 19:36:38.138051 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.138020    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fc36288a-b8d0-475b-9640-42bda1b1b5a0-metrics-server-audit-profiles\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.138311 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.138109    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mws96\" (UniqueName: \"kubernetes.io/projected/fc36288a-b8d0-475b-9640-42bda1b1b5a0-kube-api-access-mws96\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.138311 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.138162    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fc36288a-b8d0-475b-9640-42bda1b1b5a0-audit-log\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.138311 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.138256    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fc36288a-b8d0-475b-9640-42bda1b1b5a0-secret-metrics-server-tls\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.138311 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.138294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fc36288a-b8d0-475b-9640-42bda1b1b5a0-secret-metrics-server-client-certs\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.138646 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.138618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc36288a-b8d0-475b-9640-42bda1b1b5a0-client-ca-bundle\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.138921 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.138740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc36288a-b8d0-475b-9640-42bda1b1b5a0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.239502 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.239470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fc36288a-b8d0-475b-9640-42bda1b1b5a0-secret-metrics-server-tls\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.239502 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.239505    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fc36288a-b8d0-475b-9640-42bda1b1b5a0-secret-metrics-server-client-certs\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.239726 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.239533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc36288a-b8d0-475b-9640-42bda1b1b5a0-client-ca-bundle\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.239726 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.239591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc36288a-b8d0-475b-9640-42bda1b1b5a0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.239787 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.239761    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fc36288a-b8d0-475b-9640-42bda1b1b5a0-metrics-server-audit-profiles\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.239823 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.239798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mws96\" (UniqueName: \"kubernetes.io/projected/fc36288a-b8d0-475b-9640-42bda1b1b5a0-kube-api-access-mws96\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.239861 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.239841    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fc36288a-b8d0-475b-9640-42bda1b1b5a0-audit-log\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.240255 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.240227    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fc36288a-b8d0-475b-9640-42bda1b1b5a0-audit-log\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.240428 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.240406    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc36288a-b8d0-475b-9640-42bda1b1b5a0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.240595 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.240579    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fc36288a-b8d0-475b-9640-42bda1b1b5a0-metrics-server-audit-profiles\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.242037 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.242017    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fc36288a-b8d0-475b-9640-42bda1b1b5a0-secret-metrics-server-tls\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.242123 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.242097    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fc36288a-b8d0-475b-9640-42bda1b1b5a0-secret-metrics-server-client-certs\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.242195 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.242141    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fc36288a-b8d0-475b-9640-42bda1b1b5a0-client-ca-bundle\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.251318 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.251297    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mws96\" (UniqueName: \"kubernetes.io/projected/fc36288a-b8d0-475b-9640-42bda1b1b5a0-kube-api-access-mws96\") pod \"metrics-server-7c6c74894d-ccx9h\" (UID: \"fc36288a-b8d0-475b-9640-42bda1b1b5a0\") " pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.354905 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.354821    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:38.420392 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.420359    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-b6767"]
Jul 28 19:36:38.422562 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.422527    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b6767"
Jul 28 19:36:38.425795 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.425756    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 28 19:36:38.426675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.426419    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7zl9v\""
Jul 28 19:36:38.427375 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.427352    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fccc6c886-vvjnp"]
Jul 28 19:36:38.429328 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.429305    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.439897 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.439226    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-b6767"]
Jul 28 19:36:38.443891 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.443870    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fccc6c886-vvjnp"]
Jul 28 19:36:38.491583 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.491552    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c6c74894d-ccx9h"]
Jul 28 19:36:38.494378 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:36:38.494349    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc36288a_b8d0_475b_9640_42bda1b1b5a0.slice/crio-4b5135cea157afbcf3cbcc10432664db145fdc9e51a3d6a3edb799666020e35e WatchSource:0}: Error finding container 4b5135cea157afbcf3cbcc10432664db145fdc9e51a3d6a3edb799666020e35e: Status 404 returned error can't find the container with id 4b5135cea157afbcf3cbcc10432664db145fdc9e51a3d6a3edb799666020e35e
Jul 28 19:36:38.542114 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.542079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed144203-56d4-4aef-9d87-c4a7c5004895-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-b6767\" (UID: \"ed144203-56d4-4aef-9d87-c4a7c5004895\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b6767"
Jul 28 19:36:38.542114 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.542117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-serving-cert\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.542287 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.542137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-config\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.542287 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.542159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-service-ca\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.542287 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.542192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmmb2\" (UniqueName: \"kubernetes.io/projected/ed144203-56d4-4aef-9d87-c4a7c5004895-kube-api-access-xmmb2\") pod \"monitoring-plugin-68b7fc9574-b6767\" (UID: \"ed144203-56d4-4aef-9d87-c4a7c5004895\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b6767"
Jul 28 19:36:38.542287 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.542217    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-oauth-serving-cert\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.542287 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.542231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-trusted-ca-bundle\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.542438 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.542317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxkvr\" (UniqueName: \"kubernetes.io/projected/6f590b5f-c4e9-4a97-8970-745f4e43e41b-kube-api-access-wxkvr\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.542438 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.542351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-oauth-config\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.643605 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.643513    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxkvr\" (UniqueName: \"kubernetes.io/projected/6f590b5f-c4e9-4a97-8970-745f4e43e41b-kube-api-access-wxkvr\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.643605 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.643567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-oauth-config\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.643605 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.643605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed144203-56d4-4aef-9d87-c4a7c5004895-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-b6767\" (UID: \"ed144203-56d4-4aef-9d87-c4a7c5004895\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b6767"
Jul 28 19:36:38.643860 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.643631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-serving-cert\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.643860 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.643659    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-config\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.643860 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.643699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-service-ca\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.643860 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.643728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmmb2\" (UniqueName: \"kubernetes.io/projected/ed144203-56d4-4aef-9d87-c4a7c5004895-kube-api-access-xmmb2\") pod \"monitoring-plugin-68b7fc9574-b6767\" (UID: \"ed144203-56d4-4aef-9d87-c4a7c5004895\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b6767"
Jul 28 19:36:38.643860 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.643750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-oauth-serving-cert\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.643860 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:38.643766    2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 28 19:36:38.643860 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:36:38.643836    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed144203-56d4-4aef-9d87-c4a7c5004895-monitoring-plugin-cert podName:ed144203-56d4-4aef-9d87-c4a7c5004895 nodeName:}" failed. No retries permitted until 2026-07-28 19:36:39.143816735 +0000 UTC m=+84.166112301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ed144203-56d4-4aef-9d87-c4a7c5004895-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-b6767" (UID: "ed144203-56d4-4aef-9d87-c4a7c5004895") : secret "monitoring-plugin-cert" not found
Jul 28 19:36:38.644172 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.643771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-trusted-ca-bundle\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.644651 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.644605    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-oauth-serving-cert\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.644651 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.644612    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-config\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.644651 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.644645    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-trusted-ca-bundle\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.645068 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.645051    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-service-ca\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.646486 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.646466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-serving-cert\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.646793 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.646766    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-oauth-config\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.654290 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.654269    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxkvr\" (UniqueName: \"kubernetes.io/projected/6f590b5f-c4e9-4a97-8970-745f4e43e41b-kube-api-access-wxkvr\") pod \"console-5fccc6c886-vvjnp\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") " pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.654470 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.654450    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmmb2\" (UniqueName: \"kubernetes.io/projected/ed144203-56d4-4aef-9d87-c4a7c5004895-kube-api-access-xmmb2\") pod \"monitoring-plugin-68b7fc9574-b6767\" (UID: \"ed144203-56d4-4aef-9d87-c4a7c5004895\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b6767"
Jul 28 19:36:38.739313 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.739282    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:38.901019 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.900934    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fccc6c886-vvjnp"]
Jul 28 19:36:38.904753 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:36:38.904724    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f590b5f_c4e9_4a97_8970_745f4e43e41b.slice/crio-722a910364a46f00fa2405ad1519710c9d368e7963c7acf63b6ddbe9e60c9925 WatchSource:0}: Error finding container 722a910364a46f00fa2405ad1519710c9d368e7963c7acf63b6ddbe9e60c9925: Status 404 returned error can't find the container with id 722a910364a46f00fa2405ad1519710c9d368e7963c7acf63b6ddbe9e60c9925
Jul 28 19:36:38.913784 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.913761    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"]
Jul 28 19:36:38.916148 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.916127    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:38.918645 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.918623    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 28 19:36:38.918940 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.918874    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 28 19:36:38.919885 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.919399    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 28 19:36:38.919885 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.919588    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2jq7n\""
Jul 28 19:36:38.919885 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.919708    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 28 19:36:38.922403 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.922364    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 28 19:36:38.926402 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.926383    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 28 19:36:38.932220 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:38.932196    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"]
Jul 28 19:36:39.045378 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.044863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fccc6c886-vvjnp" event={"ID":"6f590b5f-c4e9-4a97-8970-745f4e43e41b","Type":"ContainerStarted","Data":"100eb99f5e28d99c39e72645bab099b659382b9a2d1c52a37e48c46d32223902"}
Jul 28 19:36:39.045378 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.044942    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fccc6c886-vvjnp" event={"ID":"6f590b5f-c4e9-4a97-8970-745f4e43e41b","Type":"ContainerStarted","Data":"722a910364a46f00fa2405ad1519710c9d368e7963c7acf63b6ddbe9e60c9925"}
Jul 28 19:36:39.046615 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.046585    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h" event={"ID":"fc36288a-b8d0-475b-9640-42bda1b1b5a0","Type":"ContainerStarted","Data":"4b5135cea157afbcf3cbcc10432664db145fdc9e51a3d6a3edb799666020e35e"}
Jul 28 19:36:39.049433 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.049347    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13f5d9a4-fbce-4145-8fb7-33b782c6c888-metrics-client-ca\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.049433 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.049409    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/13f5d9a4-fbce-4145-8fb7-33b782c6c888-telemeter-client-tls\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.049639 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.049437    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13f5d9a4-fbce-4145-8fb7-33b782c6c888-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.049639 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.049473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/13f5d9a4-fbce-4145-8fb7-33b782c6c888-secret-telemeter-client\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.049639 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.049500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/13f5d9a4-fbce-4145-8fb7-33b782c6c888-federate-client-tls\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.049639 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.049528    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9d9p\" (UniqueName: \"kubernetes.io/projected/13f5d9a4-fbce-4145-8fb7-33b782c6c888-kube-api-access-r9d9p\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.049639 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.049597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f5d9a4-fbce-4145-8fb7-33b782c6c888-serving-certs-ca-bundle\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.049639 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.049618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f5d9a4-fbce-4145-8fb7-33b782c6c888-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.063764 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.063712    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fccc6c886-vvjnp" podStartSLOduration=1.063692249 podStartE2EDuration="1.063692249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:36:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:39.061637932 +0000 UTC m=+84.083933522" watchObservedRunningTime="2026-07-28 19:36:39.063692249 +0000 UTC m=+84.085987840"
Jul 28 19:36:39.150513 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.150474    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f5d9a4-fbce-4145-8fb7-33b782c6c888-serving-certs-ca-bundle\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.150705 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.150525    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f5d9a4-fbce-4145-8fb7-33b782c6c888-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.150705 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.150643    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13f5d9a4-fbce-4145-8fb7-33b782c6c888-metrics-client-ca\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.150705 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.150676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed144203-56d4-4aef-9d87-c4a7c5004895-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-b6767\" (UID: \"ed144203-56d4-4aef-9d87-c4a7c5004895\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b6767"
Jul 28 19:36:39.150705 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.150691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/13f5d9a4-fbce-4145-8fb7-33b782c6c888-telemeter-client-tls\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.150916 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.150717    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13f5d9a4-fbce-4145-8fb7-33b782c6c888-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.150916 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.150776    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/13f5d9a4-fbce-4145-8fb7-33b782c6c888-secret-telemeter-client\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.150916 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.150806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/13f5d9a4-fbce-4145-8fb7-33b782c6c888-federate-client-tls\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.150916 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.150859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9d9p\" (UniqueName: \"kubernetes.io/projected/13f5d9a4-fbce-4145-8fb7-33b782c6c888-kube-api-access-r9d9p\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.151600 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.151268    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f5d9a4-fbce-4145-8fb7-33b782c6c888-serving-certs-ca-bundle\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.151600 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.151326    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13f5d9a4-fbce-4145-8fb7-33b782c6c888-metrics-client-ca\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.151600 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.151571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13f5d9a4-fbce-4145-8fb7-33b782c6c888-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.154233 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.154189    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/13f5d9a4-fbce-4145-8fb7-33b782c6c888-secret-telemeter-client\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.154233 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.154227    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/13f5d9a4-fbce-4145-8fb7-33b782c6c888-telemeter-client-tls\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.154650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.154622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed144203-56d4-4aef-9d87-c4a7c5004895-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-b6767\" (UID: \"ed144203-56d4-4aef-9d87-c4a7c5004895\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b6767"
Jul 28 19:36:39.154834 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.154812    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/13f5d9a4-fbce-4145-8fb7-33b782c6c888-federate-client-tls\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.154928 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.154908    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13f5d9a4-fbce-4145-8fb7-33b782c6c888-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.159985 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.159954    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9d9p\" (UniqueName: \"kubernetes.io/projected/13f5d9a4-fbce-4145-8fb7-33b782c6c888-kube-api-access-r9d9p\") pod \"telemeter-client-f8968b8f6-8wvhd\" (UID: \"13f5d9a4-fbce-4145-8fb7-33b782c6c888\") " pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.228606 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.228574    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"
Jul 28 19:36:39.332207 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:39.332178    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b6767"
Jul 28 19:36:40.209947 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:40.209378    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f8968b8f6-8wvhd"]
Jul 28 19:36:40.213845 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:36:40.213804    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f5d9a4_fbce_4145_8fb7_33b782c6c888.slice/crio-5da891ba827d00015c9ee2905529ee37d7fb2a75dd727334fb257165fa1c044f WatchSource:0}: Error finding container 5da891ba827d00015c9ee2905529ee37d7fb2a75dd727334fb257165fa1c044f: Status 404 returned error can't find the container with id 5da891ba827d00015c9ee2905529ee37d7fb2a75dd727334fb257165fa1c044f
Jul 28 19:36:40.232590 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:40.231822    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-b6767"]
Jul 28 19:36:40.233449 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:36:40.233393    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded144203_56d4_4aef_9d87_c4a7c5004895.slice/crio-5f9ffaf4f70994de27dc13c2094414c0adc5f447151e7a367db60b8ee34cd3bd WatchSource:0}: Error finding container 5f9ffaf4f70994de27dc13c2094414c0adc5f447151e7a367db60b8ee34cd3bd: Status 404 returned error can't find the container with id 5f9ffaf4f70994de27dc13c2094414c0adc5f447151e7a367db60b8ee34cd3bd
Jul 28 19:36:41.060715 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:41.060675    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h" event={"ID":"fc36288a-b8d0-475b-9640-42bda1b1b5a0","Type":"ContainerStarted","Data":"73867ae64e3448fa50f319b05c50e47f15f85b35907d5a60715817bdf82d0575"}
Jul 28 19:36:41.062833 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:41.062750    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd" event={"ID":"13f5d9a4-fbce-4145-8fb7-33b782c6c888","Type":"ContainerStarted","Data":"5da891ba827d00015c9ee2905529ee37d7fb2a75dd727334fb257165fa1c044f"}
Jul 28 19:36:41.065330 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:41.065260    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b6767" event={"ID":"ed144203-56d4-4aef-9d87-c4a7c5004895","Type":"ContainerStarted","Data":"5f9ffaf4f70994de27dc13c2094414c0adc5f447151e7a367db60b8ee34cd3bd"}
Jul 28 19:36:41.069585 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:41.069560    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ca56512-8ecf-4dff-8f93-388dc9c65fe0","Type":"ContainerStarted","Data":"b7b8f5ccc6750fada0ddce1908996d86efd7713a50f5000a24b9bb3569b79d28"}
Jul 28 19:36:41.069710 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:41.069614    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ca56512-8ecf-4dff-8f93-388dc9c65fe0","Type":"ContainerStarted","Data":"15af245edd27fb1b2d4881f9484f1653cec7d9a324c79a4ba1aa5e292a3ad9a2"}
Jul 28 19:36:41.069710 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:41.069640    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ca56512-8ecf-4dff-8f93-388dc9c65fe0","Type":"ContainerStarted","Data":"7f19a8d6ab2b49588d88a662cf36798c7f88f42a56bd5261ef50046c5e32c76b"}
Jul 28 19:36:41.069710 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:41.069664    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ca56512-8ecf-4dff-8f93-388dc9c65fe0","Type":"ContainerStarted","Data":"c472cf288e359be7083d40919cb03730c8766a835b30bd9c58818d8755d18104"}
Jul 28 19:36:41.069710 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:41.069690    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ca56512-8ecf-4dff-8f93-388dc9c65fe0","Type":"ContainerStarted","Data":"9f142bf9883439036c1e6a15976a4c73e42e1efeb85c7f2b3d4bf8dde25e61ae"}
Jul 28 19:36:41.083517 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:41.083463    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h" podStartSLOduration=1.570370891 podStartE2EDuration="3.083440182s" totalImagesPullingTime="1.513069291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:41.080769449 +0000 UTC m=+86.103065038" watchObservedRunningTime="2026-07-28 19:36:41.083440182 +0000 UTC m=+86.105735776"
Jul 28 19:36:42.080015 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:42.079973    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ca56512-8ecf-4dff-8f93-388dc9c65fe0","Type":"ContainerStarted","Data":"4af926f38949e34068c7103447e259d0099414d7fc90f2b56482cf8cb6ff36ee"}
Jul 28 19:36:42.108066 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:42.108001    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.352654509 podStartE2EDuration="8.107982074s" totalImagesPullingTime="3.739533947s" totalInitContainerRuntime="15.793618ms" isStatefulPod=false podCreationTimestamp="2026-07-28 19:36:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:42.107652223 +0000 UTC m=+87.129947811" watchObservedRunningTime="2026-07-28 19:36:42.107982074 +0000 UTC m=+87.130277662"
Jul 28 19:36:43.089092 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:43.089060    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd" event={"ID":"13f5d9a4-fbce-4145-8fb7-33b782c6c888","Type":"ContainerStarted","Data":"a06f067761a8fcf486b2177d12c993a4d8fb41cb69f7ef4e78524d1a2dbffeb3"}
Jul 28 19:36:43.089515 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:43.089138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd" event={"ID":"13f5d9a4-fbce-4145-8fb7-33b782c6c888","Type":"ContainerStarted","Data":"0f7ad54e6bae81428ea78b8cf80a19f5a9f18942bf1d9f37dc7c9261d4dbeeb5"}
Jul 28 19:36:43.089515 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:43.089163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd" event={"ID":"13f5d9a4-fbce-4145-8fb7-33b782c6c888","Type":"ContainerStarted","Data":"517046a9535814b066abbb92c16dec47db28e0393fbd297ec4f9bcafd2faed20"}
Jul 28 19:36:43.090716 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:43.090693    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b6767" event={"ID":"ed144203-56d4-4aef-9d87-c4a7c5004895","Type":"ContainerStarted","Data":"882469cfce0508d534172eab9bbf0e39d6465db15304bf44d5ce2e68655175d2"}
Jul 28 19:36:43.091050 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:43.091032    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b6767"
Jul 28 19:36:43.095912 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:43.095891    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b6767"
Jul 28 19:36:43.113664 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:43.113624    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-f8968b8f6-8wvhd" podStartSLOduration=3.024759921 podStartE2EDuration="5.113610563s" totalImagesPullingTime="2.088850642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:43.112328656 +0000 UTC m=+88.134624268" watchObservedRunningTime="2026-07-28 19:36:43.113610563 +0000 UTC m=+88.135906151"
Jul 28 19:36:43.129424 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:43.129387    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b6767" podStartSLOduration=3.064923411 podStartE2EDuration="5.129373185s" totalImagesPullingTime="2.064449774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:43.128590497 +0000 UTC m=+88.150886114" watchObservedRunningTime="2026-07-28 19:36:43.129373185 +0000 UTC m=+88.151668772"
Jul 28 19:36:43.947325 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:43.947285    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fccc6c886-vvjnp"]
Jul 28 19:36:43.977555 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:43.977510    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-576d98d5b5-wzffl"]
Jul 28 19:36:43.979673 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:43.979653    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:43.990337 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:43.990314    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-576d98d5b5-wzffl"]
Jul 28 19:36:44.096181 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.096149    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-trusted-ca-bundle\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.096644 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.096196    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-serving-cert\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.096644 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.096226    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-oauth-serving-cert\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.096644 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.096266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbw7p\" (UniqueName: \"kubernetes.io/projected/fcbe4dea-0781-465e-81a2-971aa81dc7d4-kube-api-access-vbw7p\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.096644 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.096291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-service-ca\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.096644 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.096319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-config\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.096644 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.096354    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-oauth-config\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.197603 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.197491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-oauth-config\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.197603 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.197582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-trusted-ca-bundle\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.197603 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.197605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-serving-cert\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.197864 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.197726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-oauth-serving-cert\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.198142 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.198114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbw7p\" (UniqueName: \"kubernetes.io/projected/fcbe4dea-0781-465e-81a2-971aa81dc7d4-kube-api-access-vbw7p\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.198437 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.198186    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-service-ca\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.198437 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.198232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-config\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.198622 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.198495    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-oauth-serving-cert\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.198622 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.198513    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-trusted-ca-bundle\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.199079 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.199057    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-service-ca\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.199181 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.199112    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-config\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.200112 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.200088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-serving-cert\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.200223 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.200203    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-oauth-config\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.205904 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.205882    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbw7p\" (UniqueName: \"kubernetes.io/projected/fcbe4dea-0781-465e-81a2-971aa81dc7d4-kube-api-access-vbw7p\") pod \"console-576d98d5b5-wzffl\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") " pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.289118 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.289074    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:44.435059 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:44.435027    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-576d98d5b5-wzffl"]
Jul 28 19:36:44.438049 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:36:44.438024    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcbe4dea_0781_465e_81a2_971aa81dc7d4.slice/crio-e463c46857932209a113c20f09953562eee264698434eac76f910b4a2b2a92b2 WatchSource:0}: Error finding container e463c46857932209a113c20f09953562eee264698434eac76f910b4a2b2a92b2: Status 404 returned error can't find the container with id e463c46857932209a113c20f09953562eee264698434eac76f910b4a2b2a92b2
Jul 28 19:36:45.100424 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:45.100318    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576d98d5b5-wzffl" event={"ID":"fcbe4dea-0781-465e-81a2-971aa81dc7d4","Type":"ContainerStarted","Data":"127936dc1db955ac4f16fdd185750da0d061c78037b91d0ea96d5f46a517564e"}
Jul 28 19:36:45.100424 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:45.100377    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576d98d5b5-wzffl" event={"ID":"fcbe4dea-0781-465e-81a2-971aa81dc7d4","Type":"ContainerStarted","Data":"e463c46857932209a113c20f09953562eee264698434eac76f910b4a2b2a92b2"}
Jul 28 19:36:48.739693 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:48.739656    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:36:54.290303 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:54.290263    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:54.290712 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:54.290342    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:54.294877 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:54.294854    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:54.313677 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:54.313631    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-576d98d5b5-wzffl" podStartSLOduration=11.313616818 podStartE2EDuration="11.313616818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:36:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:36:45.11875626 +0000 UTC m=+90.141051862" watchObservedRunningTime="2026-07-28 19:36:54.313616818 +0000 UTC m=+99.335912397"
Jul 28 19:36:55.142832 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:55.142803    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:36:55.189114 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:55.189084    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ddd55ddd8-p4x9w"]
Jul 28 19:36:58.355154 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:58.355119    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:58.355530 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:58.355180    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:36:58.999146 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:36:58.999114    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hgp4z"
Jul 28 19:37:08.968056 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:08.968014    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5fccc6c886-vvjnp" podUID="6f590b5f-c4e9-4a97-8970-745f4e43e41b" containerName="console" containerID="cri-o://100eb99f5e28d99c39e72645bab099b659382b9a2d1c52a37e48c46d32223902" gracePeriod=15
Jul 28 19:37:09.194918 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.194883    2563 generic.go:356] "Generic (PLEG): container finished" podID="6f590b5f-c4e9-4a97-8970-745f4e43e41b" containerID="100eb99f5e28d99c39e72645bab099b659382b9a2d1c52a37e48c46d32223902" exitCode=0
Jul 28 19:37:09.195059 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.194949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fccc6c886-vvjnp" event={"ID":"6f590b5f-c4e9-4a97-8970-745f4e43e41b","Type":"ContainerDied","Data":"100eb99f5e28d99c39e72645bab099b659382b9a2d1c52a37e48c46d32223902"}
Jul 28 19:37:09.212087 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.212068    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:37:09.295103 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.295072    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-service-ca\") pod \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") "
Jul 28 19:37:09.295281 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.295108    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-trusted-ca-bundle\") pod \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") "
Jul 28 19:37:09.295281 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.295129    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxkvr\" (UniqueName: \"kubernetes.io/projected/6f590b5f-c4e9-4a97-8970-745f4e43e41b-kube-api-access-wxkvr\") pod \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") "
Jul 28 19:37:09.295281 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.295158    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-oauth-serving-cert\") pod \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") "
Jul 28 19:37:09.295281 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.295252    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-oauth-config\") pod \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") "
Jul 28 19:37:09.295498 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.295354    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-config\") pod \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") "
Jul 28 19:37:09.295498 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.295390    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-serving-cert\") pod \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\" (UID: \"6f590b5f-c4e9-4a97-8970-745f4e43e41b\") "
Jul 28 19:37:09.295631 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.295524    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-service-ca" (OuterVolumeSpecName: "service-ca") pod "6f590b5f-c4e9-4a97-8970-745f4e43e41b" (UID: "6f590b5f-c4e9-4a97-8970-745f4e43e41b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:37:09.295688 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.295663    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-service-ca\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:37:09.295688 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.295581    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6f590b5f-c4e9-4a97-8970-745f4e43e41b" (UID: "6f590b5f-c4e9-4a97-8970-745f4e43e41b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:37:09.295793 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.295756    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-config" (OuterVolumeSpecName: "console-config") pod "6f590b5f-c4e9-4a97-8970-745f4e43e41b" (UID: "6f590b5f-c4e9-4a97-8970-745f4e43e41b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:37:09.295975 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.295948    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6f590b5f-c4e9-4a97-8970-745f4e43e41b" (UID: "6f590b5f-c4e9-4a97-8970-745f4e43e41b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:37:09.297458 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.297430    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6f590b5f-c4e9-4a97-8970-745f4e43e41b" (UID: "6f590b5f-c4e9-4a97-8970-745f4e43e41b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:37:09.297568 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.297474    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f590b5f-c4e9-4a97-8970-745f4e43e41b-kube-api-access-wxkvr" (OuterVolumeSpecName: "kube-api-access-wxkvr") pod "6f590b5f-c4e9-4a97-8970-745f4e43e41b" (UID: "6f590b5f-c4e9-4a97-8970-745f4e43e41b"). InnerVolumeSpecName "kube-api-access-wxkvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:37:09.297568 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.297476    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6f590b5f-c4e9-4a97-8970-745f4e43e41b" (UID: "6f590b5f-c4e9-4a97-8970-745f4e43e41b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:37:09.396378 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.396340    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-config\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:37:09.396378 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.396370    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-serving-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:37:09.396378 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.396383    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-trusted-ca-bundle\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:37:09.396626 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.396394    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxkvr\" (UniqueName: \"kubernetes.io/projected/6f590b5f-c4e9-4a97-8970-745f4e43e41b-kube-api-access-wxkvr\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:37:09.396626 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.396406    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f590b5f-c4e9-4a97-8970-745f4e43e41b-oauth-serving-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:37:09.396626 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:09.396419    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f590b5f-c4e9-4a97-8970-745f4e43e41b-console-oauth-config\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:37:10.202524 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:10.202496    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fccc6c886-vvjnp"
Jul 28 19:37:10.202524 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:10.202516    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fccc6c886-vvjnp" event={"ID":"6f590b5f-c4e9-4a97-8970-745f4e43e41b","Type":"ContainerDied","Data":"722a910364a46f00fa2405ad1519710c9d368e7963c7acf63b6ddbe9e60c9925"}
Jul 28 19:37:10.203011 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:10.202595    2563 scope.go:117] "RemoveContainer" containerID="100eb99f5e28d99c39e72645bab099b659382b9a2d1c52a37e48c46d32223902"
Jul 28 19:37:10.224773 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:10.224747    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fccc6c886-vvjnp"]
Jul 28 19:37:10.233114 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:10.233090    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fccc6c886-vvjnp"]
Jul 28 19:37:11.603011 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:11.602977    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f590b5f-c4e9-4a97-8970-745f4e43e41b" path="/var/lib/kubelet/pods/6f590b5f-c4e9-4a97-8970-745f4e43e41b/volumes"
Jul 28 19:37:18.360921 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:18.360889    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:37:18.364527 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:18.364510    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7c6c74894d-ccx9h"
Jul 28 19:37:20.210903 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.210832    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7ddd55ddd8-p4x9w" podUID="f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2" containerName="console" containerID="cri-o://8657541395eb02509091ca79b77eb56f23b25070ca869af25425640bd5f5e49b" gracePeriod=15
Jul 28 19:37:20.457940 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.457911    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:37:20.581790 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.581760    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-trusted-ca-bundle\") pod \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") "
Jul 28 19:37:20.581976 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.581828    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-oauth-config\") pod \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") "
Jul 28 19:37:20.581976 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.581888    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9lxl\" (UniqueName: \"kubernetes.io/projected/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-kube-api-access-m9lxl\") pod \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") "
Jul 28 19:37:20.581976 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.581917    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-oauth-serving-cert\") pod \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") "
Jul 28 19:37:20.581976 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.581939    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-config\") pod \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") "
Jul 28 19:37:20.581976 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.581975    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-serving-cert\") pod \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") "
Jul 28 19:37:20.582231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.582006    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-service-ca\") pod \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\" (UID: \"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2\") "
Jul 28 19:37:20.582231 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.582187    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2" (UID: "f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:37:20.582336 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.582262    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2" (UID: "f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:37:20.582336 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.582277    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-trusted-ca-bundle\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:37:20.582336 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.582304    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-config" (OuterVolumeSpecName: "console-config") pod "f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2" (UID: "f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:37:20.582552 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.582518    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-service-ca" (OuterVolumeSpecName: "service-ca") pod "f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2" (UID: "f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:37:20.584281 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.584245    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2" (UID: "f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:37:20.584673 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.584646    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2" (UID: "f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:37:20.584794 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.584682    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-kube-api-access-m9lxl" (OuterVolumeSpecName: "kube-api-access-m9lxl") pod "f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2" (UID: "f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2"). InnerVolumeSpecName "kube-api-access-m9lxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:37:20.682952 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.682913    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-oauth-config\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:37:20.682952 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.682952    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9lxl\" (UniqueName: \"kubernetes.io/projected/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-kube-api-access-m9lxl\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:37:20.683139 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.682968    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-oauth-serving-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:37:20.683139 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.682983    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-config\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:37:20.683139 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.682998    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-console-serving-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:37:20.683139 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:20.683013    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2-service-ca\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:37:21.249575 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:21.246218    2563 generic.go:356] "Generic (PLEG): container finished" podID="f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2" containerID="8657541395eb02509091ca79b77eb56f23b25070ca869af25425640bd5f5e49b" exitCode=0
Jul 28 19:37:21.249575 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:21.246331    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddd55ddd8-p4x9w" event={"ID":"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2","Type":"ContainerDied","Data":"8657541395eb02509091ca79b77eb56f23b25070ca869af25425640bd5f5e49b"}
Jul 28 19:37:21.249575 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:21.246382    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddd55ddd8-p4x9w" event={"ID":"f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2","Type":"ContainerDied","Data":"40286f89dc4e1caf4990e54d904c961f7e56bb26f42e8ea440a70b47fc7356b8"}
Jul 28 19:37:21.249575 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:21.246412    2563 scope.go:117] "RemoveContainer" containerID="8657541395eb02509091ca79b77eb56f23b25070ca869af25425640bd5f5e49b"
Jul 28 19:37:21.249575 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:21.246610    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddd55ddd8-p4x9w"
Jul 28 19:37:21.258495 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:21.258479    2563 scope.go:117] "RemoveContainer" containerID="8657541395eb02509091ca79b77eb56f23b25070ca869af25425640bd5f5e49b"
Jul 28 19:37:21.258880 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:37:21.258857    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8657541395eb02509091ca79b77eb56f23b25070ca869af25425640bd5f5e49b\": container with ID starting with 8657541395eb02509091ca79b77eb56f23b25070ca869af25425640bd5f5e49b not found: ID does not exist" containerID="8657541395eb02509091ca79b77eb56f23b25070ca869af25425640bd5f5e49b"
Jul 28 19:37:21.258953 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:21.258889    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8657541395eb02509091ca79b77eb56f23b25070ca869af25425640bd5f5e49b"} err="failed to get container status \"8657541395eb02509091ca79b77eb56f23b25070ca869af25425640bd5f5e49b\": rpc error: code = NotFound desc = could not find container \"8657541395eb02509091ca79b77eb56f23b25070ca869af25425640bd5f5e49b\": container with ID starting with 8657541395eb02509091ca79b77eb56f23b25070ca869af25425640bd5f5e49b not found: ID does not exist"
Jul 28 19:37:21.268984 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:21.268957    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ddd55ddd8-p4x9w"]
Jul 28 19:37:21.272730 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:21.272704    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7ddd55ddd8-p4x9w"]
Jul 28 19:37:21.605998 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:21.605913    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2" path="/var/lib/kubelet/pods/f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2/volumes"
Jul 28 19:37:49.991242 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:49.991208    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65f576bd69-fxttf"]
Jul 28 19:37:49.991721 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:49.991482    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2" containerName="console"
Jul 28 19:37:49.991721 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:49.991495    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2" containerName="console"
Jul 28 19:37:49.991721 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:49.991502    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f590b5f-c4e9-4a97-8970-745f4e43e41b" containerName="console"
Jul 28 19:37:49.991721 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:49.991507    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f590b5f-c4e9-4a97-8970-745f4e43e41b" containerName="console"
Jul 28 19:37:49.991721 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:49.991582    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6dc9751-ed0e-48e6-bbc4-8bb1b0f7eff2" containerName="console"
Jul 28 19:37:49.991721 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:49.991592    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f590b5f-c4e9-4a97-8970-745f4e43e41b" containerName="console"
Jul 28 19:37:49.995276 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:49.995259    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.008071 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.008045    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f576bd69-fxttf"]
Jul 28 19:37:50.109497 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.109463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-trusted-ca-bundle\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.109497 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.109504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-oauth-config\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.109738 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.109526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-config\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.109738 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.109608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jltqp\" (UniqueName: \"kubernetes.io/projected/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-kube-api-access-jltqp\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.109738 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.109686    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-serving-cert\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.109738 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.109705    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-service-ca\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.109738 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.109735    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-oauth-serving-cert\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.210492 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.210450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-oauth-config\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.210675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.210499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-config\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.210675 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.210531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jltqp\" (UniqueName: \"kubernetes.io/projected/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-kube-api-access-jltqp\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.210791 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.210693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-serving-cert\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.210791 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.210737    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-service-ca\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.210791 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.210770    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-oauth-serving-cert\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.210924 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.210816    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-trusted-ca-bundle\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.211400 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.211375    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-config\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.211512 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.211377    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-service-ca\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.211627 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.211600    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-oauth-serving-cert\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.211730 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.211712    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-trusted-ca-bundle\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.213043 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.213018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-serving-cert\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.213134 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.213065    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-oauth-config\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.219103 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.219082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jltqp\" (UniqueName: \"kubernetes.io/projected/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-kube-api-access-jltqp\") pod \"console-65f576bd69-fxttf\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") " pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.304114 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.304082    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:37:50.430845 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:50.430807    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f576bd69-fxttf"]
Jul 28 19:37:50.433594 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:37:50.433566    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292a37d0_f519_4fc0_bc6a_03b84bfcd2e3.slice/crio-c8578dd2b507259ed4850a50e031ec3bba5e955e06b67e5b7b6058a5d032d1f6 WatchSource:0}: Error finding container c8578dd2b507259ed4850a50e031ec3bba5e955e06b67e5b7b6058a5d032d1f6: Status 404 returned error can't find the container with id c8578dd2b507259ed4850a50e031ec3bba5e955e06b67e5b7b6058a5d032d1f6
Jul 28 19:37:51.355082 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:51.355045    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f576bd69-fxttf" event={"ID":"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3","Type":"ContainerStarted","Data":"3e989b718b449dfe5b2175efbce9c3792ad5fde75c2252da61b5078276a22c0f"}
Jul 28 19:37:51.355502 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:51.355093    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f576bd69-fxttf" event={"ID":"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3","Type":"ContainerStarted","Data":"c8578dd2b507259ed4850a50e031ec3bba5e955e06b67e5b7b6058a5d032d1f6"}
Jul 28 19:37:51.374377 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:37:51.374329    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65f576bd69-fxttf" podStartSLOduration=2.374313248 podStartE2EDuration="2.374313248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:37:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:37:51.373278332 +0000 UTC m=+156.395573920" watchObservedRunningTime="2026-07-28 19:37:51.374313248 +0000 UTC m=+156.396608836"
Jul 28 19:38:00.305141 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:00.305088    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:38:00.305141 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:00.305159    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:38:00.309826 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:00.309801    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:38:00.390120 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:00.390093    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:38:00.437507 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:00.437473    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-576d98d5b5-wzffl"]
Jul 28 19:38:25.456629 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.456573    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-576d98d5b5-wzffl" podUID="fcbe4dea-0781-465e-81a2-971aa81dc7d4" containerName="console" containerID="cri-o://127936dc1db955ac4f16fdd185750da0d061c78037b91d0ea96d5f46a517564e" gracePeriod=15
Jul 28 19:38:25.702803 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.702783    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:38:25.783996 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.783963    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-config\") pod \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") "
Jul 28 19:38:25.783996 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.784000    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-oauth-serving-cert\") pod \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") "
Jul 28 19:38:25.784239 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.784032    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-trusted-ca-bundle\") pod \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") "
Jul 28 19:38:25.784239 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.784056    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-serving-cert\") pod \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") "
Jul 28 19:38:25.784239 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.784126    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-oauth-config\") pod \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") "
Jul 28 19:38:25.784239 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.784169    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-service-ca\") pod \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") "
Jul 28 19:38:25.784239 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.784203    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbw7p\" (UniqueName: \"kubernetes.io/projected/fcbe4dea-0781-465e-81a2-971aa81dc7d4-kube-api-access-vbw7p\") pod \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\" (UID: \"fcbe4dea-0781-465e-81a2-971aa81dc7d4\") "
Jul 28 19:38:25.784530 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.784462    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fcbe4dea-0781-465e-81a2-971aa81dc7d4" (UID: "fcbe4dea-0781-465e-81a2-971aa81dc7d4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:38:25.784671 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.784375    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-config" (OuterVolumeSpecName: "console-config") pod "fcbe4dea-0781-465e-81a2-971aa81dc7d4" (UID: "fcbe4dea-0781-465e-81a2-971aa81dc7d4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:38:25.784671 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.784569    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-service-ca" (OuterVolumeSpecName: "service-ca") pod "fcbe4dea-0781-465e-81a2-971aa81dc7d4" (UID: "fcbe4dea-0781-465e-81a2-971aa81dc7d4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:38:25.784746 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.784682    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fcbe4dea-0781-465e-81a2-971aa81dc7d4" (UID: "fcbe4dea-0781-465e-81a2-971aa81dc7d4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:38:25.786386 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.786349    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fcbe4dea-0781-465e-81a2-971aa81dc7d4" (UID: "fcbe4dea-0781-465e-81a2-971aa81dc7d4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:38:25.786386 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.786357    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcbe4dea-0781-465e-81a2-971aa81dc7d4-kube-api-access-vbw7p" (OuterVolumeSpecName: "kube-api-access-vbw7p") pod "fcbe4dea-0781-465e-81a2-971aa81dc7d4" (UID: "fcbe4dea-0781-465e-81a2-971aa81dc7d4"). InnerVolumeSpecName "kube-api-access-vbw7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:38:25.786507 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.786428    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fcbe4dea-0781-465e-81a2-971aa81dc7d4" (UID: "fcbe4dea-0781-465e-81a2-971aa81dc7d4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:38:25.885588 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.885556    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-config\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:38:25.885588 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.885584    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-oauth-serving-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:38:25.885588 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.885593    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-trusted-ca-bundle\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:38:25.885801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.885601    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-serving-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:38:25.885801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.885609    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcbe4dea-0781-465e-81a2-971aa81dc7d4-console-oauth-config\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:38:25.885801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.885617    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcbe4dea-0781-465e-81a2-971aa81dc7d4-service-ca\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:38:25.885801 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:25.885625    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbw7p\" (UniqueName: \"kubernetes.io/projected/fcbe4dea-0781-465e-81a2-971aa81dc7d4-kube-api-access-vbw7p\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:38:26.480008 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:26.479975    2563 generic.go:356] "Generic (PLEG): container finished" podID="fcbe4dea-0781-465e-81a2-971aa81dc7d4" containerID="127936dc1db955ac4f16fdd185750da0d061c78037b91d0ea96d5f46a517564e" exitCode=0
Jul 28 19:38:26.480388 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:26.480011    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576d98d5b5-wzffl" event={"ID":"fcbe4dea-0781-465e-81a2-971aa81dc7d4","Type":"ContainerDied","Data":"127936dc1db955ac4f16fdd185750da0d061c78037b91d0ea96d5f46a517564e"}
Jul 28 19:38:26.480388 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:26.480028    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-576d98d5b5-wzffl"
Jul 28 19:38:26.480388 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:26.480059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-576d98d5b5-wzffl" event={"ID":"fcbe4dea-0781-465e-81a2-971aa81dc7d4","Type":"ContainerDied","Data":"e463c46857932209a113c20f09953562eee264698434eac76f910b4a2b2a92b2"}
Jul 28 19:38:26.480388 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:26.480079    2563 scope.go:117] "RemoveContainer" containerID="127936dc1db955ac4f16fdd185750da0d061c78037b91d0ea96d5f46a517564e"
Jul 28 19:38:26.488636 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:26.488552    2563 scope.go:117] "RemoveContainer" containerID="127936dc1db955ac4f16fdd185750da0d061c78037b91d0ea96d5f46a517564e"
Jul 28 19:38:26.488854 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:38:26.488836    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"127936dc1db955ac4f16fdd185750da0d061c78037b91d0ea96d5f46a517564e\": container with ID starting with 127936dc1db955ac4f16fdd185750da0d061c78037b91d0ea96d5f46a517564e not found: ID does not exist" containerID="127936dc1db955ac4f16fdd185750da0d061c78037b91d0ea96d5f46a517564e"
Jul 28 19:38:26.488922 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:26.488865    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"127936dc1db955ac4f16fdd185750da0d061c78037b91d0ea96d5f46a517564e"} err="failed to get container status \"127936dc1db955ac4f16fdd185750da0d061c78037b91d0ea96d5f46a517564e\": rpc error: code = NotFound desc = could not find container \"127936dc1db955ac4f16fdd185750da0d061c78037b91d0ea96d5f46a517564e\": container with ID starting with 127936dc1db955ac4f16fdd185750da0d061c78037b91d0ea96d5f46a517564e not found: ID does not exist"
Jul 28 19:38:26.500562 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:26.500525    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-576d98d5b5-wzffl"]
Jul 28 19:38:26.504285 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:26.504265    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-576d98d5b5-wzffl"]
Jul 28 19:38:27.602949 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:38:27.602911    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcbe4dea-0781-465e-81a2-971aa81dc7d4" path="/var/lib/kubelet/pods/fcbe4dea-0781-465e-81a2-971aa81dc7d4/volumes"
Jul 28 19:39:15.509192 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.509160    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"]
Jul 28 19:39:15.509572 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.509558    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcbe4dea-0781-465e-81a2-971aa81dc7d4" containerName="console"
Jul 28 19:39:15.509616 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.509576    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcbe4dea-0781-465e-81a2-971aa81dc7d4" containerName="console"
Jul 28 19:39:15.509658 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.509641    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcbe4dea-0781-465e-81a2-971aa81dc7d4" containerName="console"
Jul 28 19:39:15.513960 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.513937    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"
Jul 28 19:39:15.517903 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.517884    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 19:39:15.518954 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.518934    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q2hqq\""
Jul 28 19:39:15.519062 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.518940    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 19:39:15.523989 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.523968    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"]
Jul 28 19:39:15.568774 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.568734    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pzhz\" (UniqueName: \"kubernetes.io/projected/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-kube-api-access-4pzhz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8\" (UID: \"f4ef89ef-7192-4bb3-90a1-3f6f8961753b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"
Jul 28 19:39:15.568961 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.568789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8\" (UID: \"f4ef89ef-7192-4bb3-90a1-3f6f8961753b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"
Jul 28 19:39:15.568961 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.568849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8\" (UID: \"f4ef89ef-7192-4bb3-90a1-3f6f8961753b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"
Jul 28 19:39:15.669821 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.669735    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8\" (UID: \"f4ef89ef-7192-4bb3-90a1-3f6f8961753b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"
Jul 28 19:39:15.669962 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.669827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pzhz\" (UniqueName: \"kubernetes.io/projected/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-kube-api-access-4pzhz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8\" (UID: \"f4ef89ef-7192-4bb3-90a1-3f6f8961753b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"
Jul 28 19:39:15.669962 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.669864    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8\" (UID: \"f4ef89ef-7192-4bb3-90a1-3f6f8961753b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"
Jul 28 19:39:15.670190 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.670169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8\" (UID: \"f4ef89ef-7192-4bb3-90a1-3f6f8961753b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"
Jul 28 19:39:15.670190 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.670183    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8\" (UID: \"f4ef89ef-7192-4bb3-90a1-3f6f8961753b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"
Jul 28 19:39:15.678652 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.678625    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pzhz\" (UniqueName: \"kubernetes.io/projected/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-kube-api-access-4pzhz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8\" (UID: \"f4ef89ef-7192-4bb3-90a1-3f6f8961753b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"
Jul 28 19:39:15.824683 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.824632    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"
Jul 28 19:39:15.953308 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:15.953283    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"]
Jul 28 19:39:15.955849 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:39:15.955819    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ef89ef_7192_4bb3_90a1_3f6f8961753b.slice/crio-b6df03156e4294780c9bb233436c47cc875f72909fb6de61c229bef44f956625 WatchSource:0}: Error finding container b6df03156e4294780c9bb233436c47cc875f72909fb6de61c229bef44f956625: Status 404 returned error can't find the container with id b6df03156e4294780c9bb233436c47cc875f72909fb6de61c229bef44f956625
Jul 28 19:39:16.658289 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:16.658253    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8" event={"ID":"f4ef89ef-7192-4bb3-90a1-3f6f8961753b","Type":"ContainerStarted","Data":"b6df03156e4294780c9bb233436c47cc875f72909fb6de61c229bef44f956625"}
Jul 28 19:39:22.682144 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:22.682064    2563 generic.go:356] "Generic (PLEG): container finished" podID="f4ef89ef-7192-4bb3-90a1-3f6f8961753b" containerID="43a73a51f09a971e9fc85a351519cb27e7fd37812e81f1d00d90503342b1547a" exitCode=0
Jul 28 19:39:22.682144 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:22.682111    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8" event={"ID":"f4ef89ef-7192-4bb3-90a1-3f6f8961753b","Type":"ContainerDied","Data":"43a73a51f09a971e9fc85a351519cb27e7fd37812e81f1d00d90503342b1547a"}
Jul 28 19:39:24.692555 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:24.692514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8" event={"ID":"f4ef89ef-7192-4bb3-90a1-3f6f8961753b","Type":"ContainerStarted","Data":"fb2b5f6854ba9670a70c968168e73503977cb179537c9ed32ead6f9cf58619f3"}
Jul 28 19:39:25.697091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:25.697061    2563 generic.go:356] "Generic (PLEG): container finished" podID="f4ef89ef-7192-4bb3-90a1-3f6f8961753b" containerID="fb2b5f6854ba9670a70c968168e73503977cb179537c9ed32ead6f9cf58619f3" exitCode=0
Jul 28 19:39:25.697440 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:25.697149    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8" event={"ID":"f4ef89ef-7192-4bb3-90a1-3f6f8961753b","Type":"ContainerDied","Data":"fb2b5f6854ba9670a70c968168e73503977cb179537c9ed32ead6f9cf58619f3"}
Jul 28 19:39:32.725856 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:32.725765    2563 generic.go:356] "Generic (PLEG): container finished" podID="f4ef89ef-7192-4bb3-90a1-3f6f8961753b" containerID="5cadc8c04d675bd8b6845f16467c1cdea77d78f88e01f5e749add415ab109cb7" exitCode=0
Jul 28 19:39:32.725856 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:32.725844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8" event={"ID":"f4ef89ef-7192-4bb3-90a1-3f6f8961753b","Type":"ContainerDied","Data":"5cadc8c04d675bd8b6845f16467c1cdea77d78f88e01f5e749add415ab109cb7"}
Jul 28 19:39:33.850141 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:33.850121    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"
Jul 28 19:39:33.932204 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:33.932178    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-bundle\") pod \"f4ef89ef-7192-4bb3-90a1-3f6f8961753b\" (UID: \"f4ef89ef-7192-4bb3-90a1-3f6f8961753b\") "
Jul 28 19:39:33.932351 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:33.932219    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-util\") pod \"f4ef89ef-7192-4bb3-90a1-3f6f8961753b\" (UID: \"f4ef89ef-7192-4bb3-90a1-3f6f8961753b\") "
Jul 28 19:39:33.932351 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:33.932279    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pzhz\" (UniqueName: \"kubernetes.io/projected/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-kube-api-access-4pzhz\") pod \"f4ef89ef-7192-4bb3-90a1-3f6f8961753b\" (UID: \"f4ef89ef-7192-4bb3-90a1-3f6f8961753b\") "
Jul 28 19:39:33.933033 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:33.933001    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-bundle" (OuterVolumeSpecName: "bundle") pod "f4ef89ef-7192-4bb3-90a1-3f6f8961753b" (UID: "f4ef89ef-7192-4bb3-90a1-3f6f8961753b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:39:33.934381 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:33.934359    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-kube-api-access-4pzhz" (OuterVolumeSpecName: "kube-api-access-4pzhz") pod "f4ef89ef-7192-4bb3-90a1-3f6f8961753b" (UID: "f4ef89ef-7192-4bb3-90a1-3f6f8961753b"). InnerVolumeSpecName "kube-api-access-4pzhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:39:33.936877 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:33.936851    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-util" (OuterVolumeSpecName: "util") pod "f4ef89ef-7192-4bb3-90a1-3f6f8961753b" (UID: "f4ef89ef-7192-4bb3-90a1-3f6f8961753b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:39:34.032897 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:34.032856    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-util\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:39:34.032897 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:34.032895    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pzhz\" (UniqueName: \"kubernetes.io/projected/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-kube-api-access-4pzhz\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:39:34.032897 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:34.032907    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4ef89ef-7192-4bb3-90a1-3f6f8961753b-bundle\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:39:34.733909 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:34.733882    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8"
Jul 28 19:39:34.733909 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:34.733886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vftx8" event={"ID":"f4ef89ef-7192-4bb3-90a1-3f6f8961753b","Type":"ContainerDied","Data":"b6df03156e4294780c9bb233436c47cc875f72909fb6de61c229bef44f956625"}
Jul 28 19:39:34.734100 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:34.733936    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6df03156e4294780c9bb233436c47cc875f72909fb6de61c229bef44f956625"
Jul 28 19:39:38.523750 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.523675    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jqpgj"]
Jul 28 19:39:38.524099 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.523917    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ef89ef-7192-4bb3-90a1-3f6f8961753b" containerName="extract"
Jul 28 19:39:38.524099 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.523927    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ef89ef-7192-4bb3-90a1-3f6f8961753b" containerName="extract"
Jul 28 19:39:38.524099 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.523937    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ef89ef-7192-4bb3-90a1-3f6f8961753b" containerName="pull"
Jul 28 19:39:38.524099 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.523942    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ef89ef-7192-4bb3-90a1-3f6f8961753b" containerName="pull"
Jul 28 19:39:38.524099 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.523954    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ef89ef-7192-4bb3-90a1-3f6f8961753b" containerName="util"
Jul 28 19:39:38.524099 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.523961    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ef89ef-7192-4bb3-90a1-3f6f8961753b" containerName="util"
Jul 28 19:39:38.524099 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.524006    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ef89ef-7192-4bb3-90a1-3f6f8961753b" containerName="extract"
Jul 28 19:39:38.526509 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.526494    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jqpgj"
Jul 28 19:39:38.529294 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.529274    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 28 19:39:38.529409 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.529344    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mthkc\""
Jul 28 19:39:38.529566 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.529552    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 28 19:39:38.544873 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.544854    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jqpgj"]
Jul 28 19:39:38.665051 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.665021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzz9t\" (UniqueName: \"kubernetes.io/projected/ce71eb8e-5bc5-4d3a-a631-2cc5a6b03c20-kube-api-access-qzz9t\") pod \"cert-manager-operator-controller-manager-55c444bf86-jqpgj\" (UID: \"ce71eb8e-5bc5-4d3a-a631-2cc5a6b03c20\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jqpgj"
Jul 28 19:39:38.665203 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.665081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce71eb8e-5bc5-4d3a-a631-2cc5a6b03c20-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jqpgj\" (UID: \"ce71eb8e-5bc5-4d3a-a631-2cc5a6b03c20\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jqpgj"
Jul 28 19:39:38.765384 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.765355    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzz9t\" (UniqueName: \"kubernetes.io/projected/ce71eb8e-5bc5-4d3a-a631-2cc5a6b03c20-kube-api-access-qzz9t\") pod \"cert-manager-operator-controller-manager-55c444bf86-jqpgj\" (UID: \"ce71eb8e-5bc5-4d3a-a631-2cc5a6b03c20\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jqpgj"
Jul 28 19:39:38.765565 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.765414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce71eb8e-5bc5-4d3a-a631-2cc5a6b03c20-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jqpgj\" (UID: \"ce71eb8e-5bc5-4d3a-a631-2cc5a6b03c20\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jqpgj"
Jul 28 19:39:38.765775 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.765760    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce71eb8e-5bc5-4d3a-a631-2cc5a6b03c20-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jqpgj\" (UID: \"ce71eb8e-5bc5-4d3a-a631-2cc5a6b03c20\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jqpgj"
Jul 28 19:39:38.776785 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.776739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzz9t\" (UniqueName: \"kubernetes.io/projected/ce71eb8e-5bc5-4d3a-a631-2cc5a6b03c20-kube-api-access-qzz9t\") pod \"cert-manager-operator-controller-manager-55c444bf86-jqpgj\" (UID: \"ce71eb8e-5bc5-4d3a-a631-2cc5a6b03c20\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jqpgj"
Jul 28 19:39:38.835436 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.835408    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jqpgj"
Jul 28 19:39:38.967265 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:38.967186    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jqpgj"]
Jul 28 19:39:38.969680 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:39:38.969653    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce71eb8e_5bc5_4d3a_a631_2cc5a6b03c20.slice/crio-c5dcbb109dbb5c84551c3d525d6e36b0da5452afa47e8cd86c907daafcfa8e66 WatchSource:0}: Error finding container c5dcbb109dbb5c84551c3d525d6e36b0da5452afa47e8cd86c907daafcfa8e66: Status 404 returned error can't find the container with id c5dcbb109dbb5c84551c3d525d6e36b0da5452afa47e8cd86c907daafcfa8e66
Jul 28 19:39:39.752631 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:39.752598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jqpgj" event={"ID":"ce71eb8e-5bc5-4d3a-a631-2cc5a6b03c20","Type":"ContainerStarted","Data":"c5dcbb109dbb5c84551c3d525d6e36b0da5452afa47e8cd86c907daafcfa8e66"}
Jul 28 19:39:41.763265 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:41.763229    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jqpgj" event={"ID":"ce71eb8e-5bc5-4d3a-a631-2cc5a6b03c20","Type":"ContainerStarted","Data":"c963d8c68217bd13465db75cf48bb518087be0413190a5c2521ea7ebdd79606e"}
Jul 28 19:39:41.789807 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:41.789762    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jqpgj" podStartSLOduration=1.5276428979999999 podStartE2EDuration="3.789746108s" totalImagesPullingTime="2.26210321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:39:41.788521329 +0000 UTC m=+266.810816953" watchObservedRunningTime="2026-07-28 19:39:41.789746108 +0000 UTC m=+266.812041696"
Jul 28 19:39:42.812105 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:42.812073    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"]
Jul 28 19:39:42.815581 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:42.815566    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"
Jul 28 19:39:42.818158 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:42.818137    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 19:39:42.818158 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:42.818137    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 19:39:42.819114 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:42.819098    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q2hqq\""
Jul 28 19:39:42.826228 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:42.826208    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"]
Jul 28 19:39:42.902248 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:42.902223    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j522\" (UniqueName: \"kubernetes.io/projected/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-kube-api-access-2j522\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv\" (UID: \"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"
Jul 28 19:39:42.902371 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:42.902253    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv\" (UID: \"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"
Jul 28 19:39:42.902371 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:42.902305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv\" (UID: \"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"
Jul 28 19:39:43.003605 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:43.003576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j522\" (UniqueName: \"kubernetes.io/projected/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-kube-api-access-2j522\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv\" (UID: \"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"
Jul 28 19:39:43.003754 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:43.003611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv\" (UID: \"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"
Jul 28 19:39:43.003754 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:43.003671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv\" (UID: \"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"
Jul 28 19:39:43.004013 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:43.003995    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv\" (UID: \"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"
Jul 28 19:39:43.004051 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:43.004033    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv\" (UID: \"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"
Jul 28 19:39:43.011703 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:43.011680    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j522\" (UniqueName: \"kubernetes.io/projected/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-kube-api-access-2j522\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv\" (UID: \"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"
Jul 28 19:39:43.124359 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:43.124290    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"
Jul 28 19:39:43.267743 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:43.267719    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"]
Jul 28 19:39:43.269295 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:39:43.269271    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa1cf81_a05f_4bf6_ac65_3e2f65ef0bed.slice/crio-05dddac172f85fc60b337644dbfd6a0b60a15067ebc8d91319d721623ff92d0f WatchSource:0}: Error finding container 05dddac172f85fc60b337644dbfd6a0b60a15067ebc8d91319d721623ff92d0f: Status 404 returned error can't find the container with id 05dddac172f85fc60b337644dbfd6a0b60a15067ebc8d91319d721623ff92d0f
Jul 28 19:39:43.773145 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:43.773112    2563 generic.go:356] "Generic (PLEG): container finished" podID="afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed" containerID="073018704c6cc115eb68629d51cf886d65bd926edefb0ae5a40a00e4e08b79d6" exitCode=0
Jul 28 19:39:43.773317 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:43.773199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv" event={"ID":"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed","Type":"ContainerDied","Data":"073018704c6cc115eb68629d51cf886d65bd926edefb0ae5a40a00e4e08b79d6"}
Jul 28 19:39:43.773317 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:43.773249    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv" event={"ID":"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed","Type":"ContainerStarted","Data":"05dddac172f85fc60b337644dbfd6a0b60a15067ebc8d91319d721623ff92d0f"}
Jul 28 19:39:44.405085 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:44.402415    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nft9n"]
Jul 28 19:39:44.406761 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:44.406737    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nft9n"
Jul 28 19:39:44.409365 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:44.409342    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 28 19:39:44.409365 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:44.409356    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 28 19:39:44.409516 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:44.409488    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6kzxz\""
Jul 28 19:39:44.413099 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:44.413078    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nft9n"]
Jul 28 19:39:44.514881 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:44.514846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v22bm\" (UniqueName: \"kubernetes.io/projected/be53aa2e-bebe-43b6-889f-b93c458bcf52-kube-api-access-v22bm\") pod \"cert-manager-cainjector-559cdd8c87-nft9n\" (UID: \"be53aa2e-bebe-43b6-889f-b93c458bcf52\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nft9n"
Jul 28 19:39:44.514881 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:44.514883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be53aa2e-bebe-43b6-889f-b93c458bcf52-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nft9n\" (UID: \"be53aa2e-bebe-43b6-889f-b93c458bcf52\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nft9n"
Jul 28 19:39:44.615686 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:44.615637    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be53aa2e-bebe-43b6-889f-b93c458bcf52-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nft9n\" (UID: \"be53aa2e-bebe-43b6-889f-b93c458bcf52\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nft9n"
Jul 28 19:39:44.615865 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:44.615764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v22bm\" (UniqueName: \"kubernetes.io/projected/be53aa2e-bebe-43b6-889f-b93c458bcf52-kube-api-access-v22bm\") pod \"cert-manager-cainjector-559cdd8c87-nft9n\" (UID: \"be53aa2e-bebe-43b6-889f-b93c458bcf52\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nft9n"
Jul 28 19:39:44.628711 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:44.628652    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be53aa2e-bebe-43b6-889f-b93c458bcf52-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nft9n\" (UID: \"be53aa2e-bebe-43b6-889f-b93c458bcf52\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nft9n"
Jul 28 19:39:44.628711 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:44.628666    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v22bm\" (UniqueName: \"kubernetes.io/projected/be53aa2e-bebe-43b6-889f-b93c458bcf52-kube-api-access-v22bm\") pod \"cert-manager-cainjector-559cdd8c87-nft9n\" (UID: \"be53aa2e-bebe-43b6-889f-b93c458bcf52\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nft9n"
Jul 28 19:39:44.725897 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:44.725819    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nft9n"
Jul 28 19:39:44.874127 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:44.874099    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nft9n"]
Jul 28 19:39:44.876511 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:39:44.876482    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe53aa2e_bebe_43b6_889f_b93c458bcf52.slice/crio-8af7206d1dc847a541ce1b2c92c29e1d7e1eeaae24a1e07638724b1c94a4b05f WatchSource:0}: Error finding container 8af7206d1dc847a541ce1b2c92c29e1d7e1eeaae24a1e07638724b1c94a4b05f: Status 404 returned error can't find the container with id 8af7206d1dc847a541ce1b2c92c29e1d7e1eeaae24a1e07638724b1c94a4b05f
Jul 28 19:39:45.783392 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:45.783356    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nft9n" event={"ID":"be53aa2e-bebe-43b6-889f-b93c458bcf52","Type":"ContainerStarted","Data":"8af7206d1dc847a541ce1b2c92c29e1d7e1eeaae24a1e07638724b1c94a4b05f"}
Jul 28 19:39:46.789487 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:46.789453    2563 generic.go:356] "Generic (PLEG): container finished" podID="afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed" containerID="3ec2a9a98ea3419373870935750fcdc431f51b8e410d3a27b026ffdeaac90b6a" exitCode=0
Jul 28 19:39:46.789948 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:46.789570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv" event={"ID":"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed","Type":"ContainerDied","Data":"3ec2a9a98ea3419373870935750fcdc431f51b8e410d3a27b026ffdeaac90b6a"}
Jul 28 19:39:47.796565 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:47.796509    2563 generic.go:356] "Generic (PLEG): container finished" podID="afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed" containerID="411d1f8fbbfea272f414b681b8b6870235fedb6045b405cd5766ded428463f25" exitCode=0
Jul 28 19:39:47.796959 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:47.796582    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv" event={"ID":"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed","Type":"ContainerDied","Data":"411d1f8fbbfea272f414b681b8b6870235fedb6045b405cd5766ded428463f25"}
Jul 28 19:39:48.802667 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:48.802628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nft9n" event={"ID":"be53aa2e-bebe-43b6-889f-b93c458bcf52","Type":"ContainerStarted","Data":"d6a480245d2c4b1bafda16bb522f7445e2e9d587ae7ec4ed6d8e44d3ffeccb2f"}
Jul 28 19:39:48.805594 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:48.805556    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p7pf9"]
Jul 28 19:39:48.809335 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:48.809318    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p7pf9"
Jul 28 19:39:48.811631 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:48.811613    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gpslf\""
Jul 28 19:39:48.819528 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:48.819506    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p7pf9"]
Jul 28 19:39:48.822061 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:48.822018    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nft9n" podStartSLOduration=1.774129269 podStartE2EDuration="4.822004552s" totalImagesPullingTime="3.047875283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:39:48.821093404 +0000 UTC m=+273.843388993" watchObservedRunningTime="2026-07-28 19:39:48.822004552 +0000 UTC m=+273.844300139"
Jul 28 19:39:48.935589 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:48.935567    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"
Jul 28 19:39:48.958364 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:48.958338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6zzt\" (UniqueName: \"kubernetes.io/projected/a7ec5a45-24f9-4a2a-a0dc-f1423923fd1d-kube-api-access-l6zzt\") pod \"cert-manager-webhook-6486ffd997-p7pf9\" (UID: \"a7ec5a45-24f9-4a2a-a0dc-f1423923fd1d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p7pf9"
Jul 28 19:39:48.958527 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:48.958507    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7ec5a45-24f9-4a2a-a0dc-f1423923fd1d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p7pf9\" (UID: \"a7ec5a45-24f9-4a2a-a0dc-f1423923fd1d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p7pf9"
Jul 28 19:39:49.059083 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.058993    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j522\" (UniqueName: \"kubernetes.io/projected/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-kube-api-access-2j522\") pod \"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed\" (UID: \"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed\") "
Jul 28 19:39:49.059083 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.059039    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-util\") pod \"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed\" (UID: \"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed\") "
Jul 28 19:39:49.059299 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.059122    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-bundle\") pod \"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed\" (UID: \"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed\") "
Jul 28 19:39:49.059299 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.059207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7ec5a45-24f9-4a2a-a0dc-f1423923fd1d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p7pf9\" (UID: \"a7ec5a45-24f9-4a2a-a0dc-f1423923fd1d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p7pf9"
Jul 28 19:39:49.059299 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.059238    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6zzt\" (UniqueName: \"kubernetes.io/projected/a7ec5a45-24f9-4a2a-a0dc-f1423923fd1d-kube-api-access-l6zzt\") pod \"cert-manager-webhook-6486ffd997-p7pf9\" (UID: \"a7ec5a45-24f9-4a2a-a0dc-f1423923fd1d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p7pf9"
Jul 28 19:39:49.059593 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.059567    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-bundle" (OuterVolumeSpecName: "bundle") pod "afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed" (UID: "afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:39:49.061595 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.061566    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-kube-api-access-2j522" (OuterVolumeSpecName: "kube-api-access-2j522") pod "afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed" (UID: "afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed"). InnerVolumeSpecName "kube-api-access-2j522". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:39:49.064318 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.064298    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-util" (OuterVolumeSpecName: "util") pod "afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed" (UID: "afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:39:49.067148 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.067128    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7ec5a45-24f9-4a2a-a0dc-f1423923fd1d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p7pf9\" (UID: \"a7ec5a45-24f9-4a2a-a0dc-f1423923fd1d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p7pf9"
Jul 28 19:39:49.067232 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.067149    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6zzt\" (UniqueName: \"kubernetes.io/projected/a7ec5a45-24f9-4a2a-a0dc-f1423923fd1d-kube-api-access-l6zzt\") pod \"cert-manager-webhook-6486ffd997-p7pf9\" (UID: \"a7ec5a45-24f9-4a2a-a0dc-f1423923fd1d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p7pf9"
Jul 28 19:39:49.118165 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.118126    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p7pf9"
Jul 28 19:39:49.160702 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.160666    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j522\" (UniqueName: \"kubernetes.io/projected/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-kube-api-access-2j522\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:39:49.160702 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.160702    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-util\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:39:49.160859 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.160719    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed-bundle\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:39:49.241599 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.241572    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p7pf9"]
Jul 28 19:39:49.243796 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:39:49.243772    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7ec5a45_24f9_4a2a_a0dc_f1423923fd1d.slice/crio-3dbd9ab156525a61525a9ae46aef16f6e839212ef61792a571a9b21b8f4624e2 WatchSource:0}: Error finding container 3dbd9ab156525a61525a9ae46aef16f6e839212ef61792a571a9b21b8f4624e2: Status 404 returned error can't find the container with id 3dbd9ab156525a61525a9ae46aef16f6e839212ef61792a571a9b21b8f4624e2
Jul 28 19:39:49.808091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.808050    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p7pf9" event={"ID":"a7ec5a45-24f9-4a2a-a0dc-f1423923fd1d","Type":"ContainerStarted","Data":"2bf97117f3ffc4469496b72cfe233af3856869fde0f82c05cf73162139411236"}
Jul 28 19:39:49.808498 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.808098    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p7pf9" event={"ID":"a7ec5a45-24f9-4a2a-a0dc-f1423923fd1d","Type":"ContainerStarted","Data":"3dbd9ab156525a61525a9ae46aef16f6e839212ef61792a571a9b21b8f4624e2"}
Jul 28 19:39:49.808498 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.808122    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p7pf9"
Jul 28 19:39:49.809924 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.809905    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv"
Jul 28 19:39:49.810041 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.809936    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2pkbv" event={"ID":"afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed","Type":"ContainerDied","Data":"05dddac172f85fc60b337644dbfd6a0b60a15067ebc8d91319d721623ff92d0f"}
Jul 28 19:39:49.810041 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.809963    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05dddac172f85fc60b337644dbfd6a0b60a15067ebc8d91319d721623ff92d0f"
Jul 28 19:39:49.824963 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:49.824917    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-p7pf9" podStartSLOduration=1.824904581 podStartE2EDuration="1.824904581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:39:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:39:49.823854291 +0000 UTC m=+274.846149880" watchObservedRunningTime="2026-07-28 19:39:49.824904581 +0000 UTC m=+274.847200168"
Jul 28 19:39:55.569245 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.569214    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-btddl"]
Jul 28 19:39:55.569711 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.569475    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed" containerName="extract"
Jul 28 19:39:55.569711 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.569485    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed" containerName="extract"
Jul 28 19:39:55.569711 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.569494    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed" containerName="util"
Jul 28 19:39:55.569711 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.569500    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed" containerName="util"
Jul 28 19:39:55.569711 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.569510    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed" containerName="pull"
Jul 28 19:39:55.569711 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.569515    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed" containerName="pull"
Jul 28 19:39:55.569711 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.569576    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa1cf81-a05f-4bf6-ac65-3e2f65ef0bed" containerName="extract"
Jul 28 19:39:55.574349 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.574332    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-btddl"
Jul 28 19:39:55.576881 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.576858    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 19:39:55.576881 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.576876    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 19:39:55.577879 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.577865    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-hx54s\""
Jul 28 19:39:55.581496 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.581328    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-btddl"]
Jul 28 19:39:55.714021 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.713986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2f5019b-a0aa-48a2-8425-326ac4cdd7e2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-btddl\" (UID: \"d2f5019b-a0aa-48a2-8425-326ac4cdd7e2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-btddl"
Jul 28 19:39:55.714189 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.714059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8dqr\" (UniqueName: \"kubernetes.io/projected/d2f5019b-a0aa-48a2-8425-326ac4cdd7e2-kube-api-access-w8dqr\") pod \"openshift-lws-operator-fd8ccff4c-btddl\" (UID: \"d2f5019b-a0aa-48a2-8425-326ac4cdd7e2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-btddl"
Jul 28 19:39:55.814905 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.814866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2f5019b-a0aa-48a2-8425-326ac4cdd7e2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-btddl\" (UID: \"d2f5019b-a0aa-48a2-8425-326ac4cdd7e2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-btddl"
Jul 28 19:39:55.815095 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.814942    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8dqr\" (UniqueName: \"kubernetes.io/projected/d2f5019b-a0aa-48a2-8425-326ac4cdd7e2-kube-api-access-w8dqr\") pod \"openshift-lws-operator-fd8ccff4c-btddl\" (UID: \"d2f5019b-a0aa-48a2-8425-326ac4cdd7e2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-btddl"
Jul 28 19:39:55.815285 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.815265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2f5019b-a0aa-48a2-8425-326ac4cdd7e2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-btddl\" (UID: \"d2f5019b-a0aa-48a2-8425-326ac4cdd7e2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-btddl"
Jul 28 19:39:55.815567 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.815531    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p7pf9"
Jul 28 19:39:55.822790 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.822739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8dqr\" (UniqueName: \"kubernetes.io/projected/d2f5019b-a0aa-48a2-8425-326ac4cdd7e2-kube-api-access-w8dqr\") pod \"openshift-lws-operator-fd8ccff4c-btddl\" (UID: \"d2f5019b-a0aa-48a2-8425-326ac4cdd7e2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-btddl"
Jul 28 19:39:55.883637 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:55.883611    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-btddl"
Jul 28 19:39:56.010002 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:56.009984    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-btddl"]
Jul 28 19:39:56.012484 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:39:56.012459    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2f5019b_a0aa_48a2_8425_326ac4cdd7e2.slice/crio-8ad815d6da8cca3116f6288241f737bf0a67032fbd13134a6b47ed07ee01443c WatchSource:0}: Error finding container 8ad815d6da8cca3116f6288241f737bf0a67032fbd13134a6b47ed07ee01443c: Status 404 returned error can't find the container with id 8ad815d6da8cca3116f6288241f737bf0a67032fbd13134a6b47ed07ee01443c
Jul 28 19:39:56.838343 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:39:56.838314    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-btddl" event={"ID":"d2f5019b-a0aa-48a2-8425-326ac4cdd7e2","Type":"ContainerStarted","Data":"8ad815d6da8cca3116f6288241f737bf0a67032fbd13134a6b47ed07ee01443c"}
Jul 28 19:40:01.860513 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:01.860480    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-btddl" event={"ID":"d2f5019b-a0aa-48a2-8425-326ac4cdd7e2","Type":"ContainerStarted","Data":"dd0986be62040717a2b386133838b8272fb7f562a068ba6193bdc36f18f9abc2"}
Jul 28 19:40:01.878416 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:01.878363    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-btddl" podStartSLOduration=2.054369827 podStartE2EDuration="6.878349633s" totalImagesPullingTime="4.823979806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:39:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:40:01.87675264 +0000 UTC m=+286.899048241" watchObservedRunningTime="2026-07-28 19:40:01.878349633 +0000 UTC m=+286.900645220"
Jul 28 19:40:02.546883 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:02.546847    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5cbvz"]
Jul 28 19:40:02.549324 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:02.549306    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5cbvz"
Jul 28 19:40:02.552106 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:02.552091    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ccmx5\""
Jul 28 19:40:02.561759 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:02.561735    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37709182-c1c9-4699-a2ed-9a984620c00f-bound-sa-token\") pod \"cert-manager-55b4d954d5-5cbvz\" (UID: \"37709182-c1c9-4699-a2ed-9a984620c00f\") " pod="cert-manager/cert-manager-55b4d954d5-5cbvz"
Jul 28 19:40:02.561853 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:02.561776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdqb4\" (UniqueName: \"kubernetes.io/projected/37709182-c1c9-4699-a2ed-9a984620c00f-kube-api-access-mdqb4\") pod \"cert-manager-55b4d954d5-5cbvz\" (UID: \"37709182-c1c9-4699-a2ed-9a984620c00f\") " pod="cert-manager/cert-manager-55b4d954d5-5cbvz"
Jul 28 19:40:02.564242 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:02.564224    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5cbvz"]
Jul 28 19:40:02.663020 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:02.662992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37709182-c1c9-4699-a2ed-9a984620c00f-bound-sa-token\") pod \"cert-manager-55b4d954d5-5cbvz\" (UID: \"37709182-c1c9-4699-a2ed-9a984620c00f\") " pod="cert-manager/cert-manager-55b4d954d5-5cbvz"
Jul 28 19:40:02.663205 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:02.663049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdqb4\" (UniqueName: \"kubernetes.io/projected/37709182-c1c9-4699-a2ed-9a984620c00f-kube-api-access-mdqb4\") pod \"cert-manager-55b4d954d5-5cbvz\" (UID: \"37709182-c1c9-4699-a2ed-9a984620c00f\") " pod="cert-manager/cert-manager-55b4d954d5-5cbvz"
Jul 28 19:40:02.673404 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:02.673380    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdqb4\" (UniqueName: \"kubernetes.io/projected/37709182-c1c9-4699-a2ed-9a984620c00f-kube-api-access-mdqb4\") pod \"cert-manager-55b4d954d5-5cbvz\" (UID: \"37709182-c1c9-4699-a2ed-9a984620c00f\") " pod="cert-manager/cert-manager-55b4d954d5-5cbvz"
Jul 28 19:40:02.673508 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:02.673497    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37709182-c1c9-4699-a2ed-9a984620c00f-bound-sa-token\") pod \"cert-manager-55b4d954d5-5cbvz\" (UID: \"37709182-c1c9-4699-a2ed-9a984620c00f\") " pod="cert-manager/cert-manager-55b4d954d5-5cbvz"
Jul 28 19:40:02.858001 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:02.857924    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-5cbvz"
Jul 28 19:40:02.996842 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:02.996810    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-5cbvz"]
Jul 28 19:40:02.999223 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:40:02.999192    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37709182_c1c9_4699_a2ed_9a984620c00f.slice/crio-479fbfec1e130757b83059953f1829d357908a534772eeeb2d605e0bf49a435b WatchSource:0}: Error finding container 479fbfec1e130757b83059953f1829d357908a534772eeeb2d605e0bf49a435b: Status 404 returned error can't find the container with id 479fbfec1e130757b83059953f1829d357908a534772eeeb2d605e0bf49a435b
Jul 28 19:40:03.870532 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:03.870492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5cbvz" event={"ID":"37709182-c1c9-4699-a2ed-9a984620c00f","Type":"ContainerStarted","Data":"7cf9f153489d360aa2da424d1b124922a95112d6a2d2f415895f45f893186eb6"}
Jul 28 19:40:03.870532 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:03.870554    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-5cbvz" event={"ID":"37709182-c1c9-4699-a2ed-9a984620c00f","Type":"ContainerStarted","Data":"479fbfec1e130757b83059953f1829d357908a534772eeeb2d605e0bf49a435b"}
Jul 28 19:40:03.886791 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:03.886741    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-5cbvz" podStartSLOduration=1.8867267189999999 podStartE2EDuration="1.886726719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:40:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:40:03.885249486 +0000 UTC m=+288.907545075" watchObservedRunningTime="2026-07-28 19:40:03.886726719 +0000 UTC m=+288.909022306"
Jul 28 19:40:06.213501 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.213471    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"]
Jul 28 19:40:06.227686 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.227658    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"]
Jul 28 19:40:06.227807 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.227786    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"
Jul 28 19:40:06.230591 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.230528    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 19:40:06.230716 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.230642    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 19:40:06.231639 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.231618    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q2hqq\""
Jul 28 19:40:06.293868 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.293843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m644l\" (UniqueName: \"kubernetes.io/projected/333af051-2743-4551-a67c-401823a7b893-kube-api-access-m644l\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj\" (UID: \"333af051-2743-4551-a67c-401823a7b893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"
Jul 28 19:40:06.293985 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.293876    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/333af051-2743-4551-a67c-401823a7b893-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj\" (UID: \"333af051-2743-4551-a67c-401823a7b893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"
Jul 28 19:40:06.293985 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.293894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/333af051-2743-4551-a67c-401823a7b893-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj\" (UID: \"333af051-2743-4551-a67c-401823a7b893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"
Jul 28 19:40:06.394578 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.394523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m644l\" (UniqueName: \"kubernetes.io/projected/333af051-2743-4551-a67c-401823a7b893-kube-api-access-m644l\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj\" (UID: \"333af051-2743-4551-a67c-401823a7b893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"
Jul 28 19:40:06.394724 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.394593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/333af051-2743-4551-a67c-401823a7b893-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj\" (UID: \"333af051-2743-4551-a67c-401823a7b893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"
Jul 28 19:40:06.394724 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.394623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/333af051-2743-4551-a67c-401823a7b893-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj\" (UID: \"333af051-2743-4551-a67c-401823a7b893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"
Jul 28 19:40:06.394970 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.394949    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/333af051-2743-4551-a67c-401823a7b893-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj\" (UID: \"333af051-2743-4551-a67c-401823a7b893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"
Jul 28 19:40:06.395033 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.395016    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/333af051-2743-4551-a67c-401823a7b893-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj\" (UID: \"333af051-2743-4551-a67c-401823a7b893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"
Jul 28 19:40:06.402736 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.402707    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m644l\" (UniqueName: \"kubernetes.io/projected/333af051-2743-4551-a67c-401823a7b893-kube-api-access-m644l\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj\" (UID: \"333af051-2743-4551-a67c-401823a7b893\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"
Jul 28 19:40:06.537266 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.537229    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"
Jul 28 19:40:06.678026 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.677961    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"]
Jul 28 19:40:06.680366 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:40:06.680340    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod333af051_2743_4551_a67c_401823a7b893.slice/crio-6e0b1c4cf91491da36c1fb3394d36b7e356d36a7705e98965029a1ee36aaf32d WatchSource:0}: Error finding container 6e0b1c4cf91491da36c1fb3394d36b7e356d36a7705e98965029a1ee36aaf32d: Status 404 returned error can't find the container with id 6e0b1c4cf91491da36c1fb3394d36b7e356d36a7705e98965029a1ee36aaf32d
Jul 28 19:40:06.884634 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.884598    2563 generic.go:356] "Generic (PLEG): container finished" podID="333af051-2743-4551-a67c-401823a7b893" containerID="9acbb908eed0ca74b36a4123a69b0f96352b7d508ddf2ac2f5f867947dab8bae" exitCode=0
Jul 28 19:40:06.884805 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.884671    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj" event={"ID":"333af051-2743-4551-a67c-401823a7b893","Type":"ContainerDied","Data":"9acbb908eed0ca74b36a4123a69b0f96352b7d508ddf2ac2f5f867947dab8bae"}
Jul 28 19:40:06.884805 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:06.884729    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj" event={"ID":"333af051-2743-4551-a67c-401823a7b893","Type":"ContainerStarted","Data":"6e0b1c4cf91491da36c1fb3394d36b7e356d36a7705e98965029a1ee36aaf32d"}
Jul 28 19:40:08.894371 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:08.894336    2563 generic.go:356] "Generic (PLEG): container finished" podID="333af051-2743-4551-a67c-401823a7b893" containerID="bbc0a2fef2f53f99c8d0abb5eb9f9e30307088791b7a12a7d75862fba18a75b3" exitCode=0
Jul 28 19:40:08.894775 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:08.894395    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj" event={"ID":"333af051-2743-4551-a67c-401823a7b893","Type":"ContainerDied","Data":"bbc0a2fef2f53f99c8d0abb5eb9f9e30307088791b7a12a7d75862fba18a75b3"}
Jul 28 19:40:09.900995 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:09.900963    2563 generic.go:356] "Generic (PLEG): container finished" podID="333af051-2743-4551-a67c-401823a7b893" containerID="ebe9abef7b9501f1cece21d7667ad1e2f0a4dbde6c0facd42d602cda363d235e" exitCode=0
Jul 28 19:40:09.901352 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:09.901005    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj" event={"ID":"333af051-2743-4551-a67c-401823a7b893","Type":"ContainerDied","Data":"ebe9abef7b9501f1cece21d7667ad1e2f0a4dbde6c0facd42d602cda363d235e"}
Jul 28 19:40:11.034108 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:11.034085    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"
Jul 28 19:40:11.131529 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:11.131495    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/333af051-2743-4551-a67c-401823a7b893-bundle\") pod \"333af051-2743-4551-a67c-401823a7b893\" (UID: \"333af051-2743-4551-a67c-401823a7b893\") "
Jul 28 19:40:11.131529 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:11.131532    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/333af051-2743-4551-a67c-401823a7b893-util\") pod \"333af051-2743-4551-a67c-401823a7b893\" (UID: \"333af051-2743-4551-a67c-401823a7b893\") "
Jul 28 19:40:11.131776 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:11.131605    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m644l\" (UniqueName: \"kubernetes.io/projected/333af051-2743-4551-a67c-401823a7b893-kube-api-access-m644l\") pod \"333af051-2743-4551-a67c-401823a7b893\" (UID: \"333af051-2743-4551-a67c-401823a7b893\") "
Jul 28 19:40:11.132356 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:11.132325    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/333af051-2743-4551-a67c-401823a7b893-bundle" (OuterVolumeSpecName: "bundle") pod "333af051-2743-4551-a67c-401823a7b893" (UID: "333af051-2743-4551-a67c-401823a7b893"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:40:11.133701 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:11.133673    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/333af051-2743-4551-a67c-401823a7b893-kube-api-access-m644l" (OuterVolumeSpecName: "kube-api-access-m644l") pod "333af051-2743-4551-a67c-401823a7b893" (UID: "333af051-2743-4551-a67c-401823a7b893"). InnerVolumeSpecName "kube-api-access-m644l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:40:11.137280 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:11.137257    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/333af051-2743-4551-a67c-401823a7b893-util" (OuterVolumeSpecName: "util") pod "333af051-2743-4551-a67c-401823a7b893" (UID: "333af051-2743-4551-a67c-401823a7b893"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:40:11.232645 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:11.232571    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/333af051-2743-4551-a67c-401823a7b893-bundle\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:40:11.232645 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:11.232598    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/333af051-2743-4551-a67c-401823a7b893-util\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:40:11.232645 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:11.232607    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m644l\" (UniqueName: \"kubernetes.io/projected/333af051-2743-4551-a67c-401823a7b893-kube-api-access-m644l\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:40:11.911115 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:11.911026    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj" event={"ID":"333af051-2743-4551-a67c-401823a7b893","Type":"ContainerDied","Data":"6e0b1c4cf91491da36c1fb3394d36b7e356d36a7705e98965029a1ee36aaf32d"}
Jul 28 19:40:11.911115 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:11.911069    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affxslj"
Jul 28 19:40:11.911115 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:11.911082    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e0b1c4cf91491da36c1fb3394d36b7e356d36a7705e98965029a1ee36aaf32d"
Jul 28 19:40:15.415982 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:15.415954    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 19:40:23.420525 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.420494    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"]
Jul 28 19:40:23.424530 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.420796    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="333af051-2743-4551-a67c-401823a7b893" containerName="pull"
Jul 28 19:40:23.424530 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.420807    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="333af051-2743-4551-a67c-401823a7b893" containerName="pull"
Jul 28 19:40:23.424530 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.420813    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="333af051-2743-4551-a67c-401823a7b893" containerName="extract"
Jul 28 19:40:23.424530 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.420818    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="333af051-2743-4551-a67c-401823a7b893" containerName="extract"
Jul 28 19:40:23.424530 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.420825    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="333af051-2743-4551-a67c-401823a7b893" containerName="util"
Jul 28 19:40:23.424530 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.420831    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="333af051-2743-4551-a67c-401823a7b893" containerName="util"
Jul 28 19:40:23.424530 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.420900    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="333af051-2743-4551-a67c-401823a7b893" containerName="extract"
Jul 28 19:40:23.424808 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.424576    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.437580 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.437562    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 19:40:23.437696 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.437586    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 19:40:23.437696 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.437658    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k8nwg\""
Jul 28 19:40:23.437861 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.437848    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 19:40:23.437904 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.437869    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 19:40:23.457401 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.457380    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"]
Jul 28 19:40:23.536225 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.536194    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/765ce775-7f76-49b0-a6e8-5b3d983674a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f4d69945-pklc4\" (UID: \"765ce775-7f76-49b0-a6e8-5b3d983674a8\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.536378 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.536244    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/765ce775-7f76-49b0-a6e8-5b3d983674a8-manifests\") pod \"opendatahub-operator-controller-manager-5f4d69945-pklc4\" (UID: \"765ce775-7f76-49b0-a6e8-5b3d983674a8\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.536378 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.536293    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfq2b\" (UniqueName: \"kubernetes.io/projected/765ce775-7f76-49b0-a6e8-5b3d983674a8-kube-api-access-sfq2b\") pod \"opendatahub-operator-controller-manager-5f4d69945-pklc4\" (UID: \"765ce775-7f76-49b0-a6e8-5b3d983674a8\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.536378 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.536352    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/765ce775-7f76-49b0-a6e8-5b3d983674a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f4d69945-pklc4\" (UID: \"765ce775-7f76-49b0-a6e8-5b3d983674a8\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.536378 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.536373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/765ce775-7f76-49b0-a6e8-5b3d983674a8-tmp\") pod \"opendatahub-operator-controller-manager-5f4d69945-pklc4\" (UID: \"765ce775-7f76-49b0-a6e8-5b3d983674a8\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.637609 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.637580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/765ce775-7f76-49b0-a6e8-5b3d983674a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f4d69945-pklc4\" (UID: \"765ce775-7f76-49b0-a6e8-5b3d983674a8\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.637609 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.637613    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/765ce775-7f76-49b0-a6e8-5b3d983674a8-tmp\") pod \"opendatahub-operator-controller-manager-5f4d69945-pklc4\" (UID: \"765ce775-7f76-49b0-a6e8-5b3d983674a8\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.637817 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.637631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/765ce775-7f76-49b0-a6e8-5b3d983674a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f4d69945-pklc4\" (UID: \"765ce775-7f76-49b0-a6e8-5b3d983674a8\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.637817 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.637659    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/765ce775-7f76-49b0-a6e8-5b3d983674a8-manifests\") pod \"opendatahub-operator-controller-manager-5f4d69945-pklc4\" (UID: \"765ce775-7f76-49b0-a6e8-5b3d983674a8\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.637817 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.637678    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfq2b\" (UniqueName: \"kubernetes.io/projected/765ce775-7f76-49b0-a6e8-5b3d983674a8-kube-api-access-sfq2b\") pod \"opendatahub-operator-controller-manager-5f4d69945-pklc4\" (UID: \"765ce775-7f76-49b0-a6e8-5b3d983674a8\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.638085 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.638064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/765ce775-7f76-49b0-a6e8-5b3d983674a8-manifests\") pod \"opendatahub-operator-controller-manager-5f4d69945-pklc4\" (UID: \"765ce775-7f76-49b0-a6e8-5b3d983674a8\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.639933 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.639914    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/765ce775-7f76-49b0-a6e8-5b3d983674a8-tmp\") pod \"opendatahub-operator-controller-manager-5f4d69945-pklc4\" (UID: \"765ce775-7f76-49b0-a6e8-5b3d983674a8\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.640024 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.640000    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/765ce775-7f76-49b0-a6e8-5b3d983674a8-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f4d69945-pklc4\" (UID: \"765ce775-7f76-49b0-a6e8-5b3d983674a8\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.640106 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.640089    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/765ce775-7f76-49b0-a6e8-5b3d983674a8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f4d69945-pklc4\" (UID: \"765ce775-7f76-49b0-a6e8-5b3d983674a8\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.645491 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.645468    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfq2b\" (UniqueName: \"kubernetes.io/projected/765ce775-7f76-49b0-a6e8-5b3d983674a8-kube-api-access-sfq2b\") pod \"opendatahub-operator-controller-manager-5f4d69945-pklc4\" (UID: \"765ce775-7f76-49b0-a6e8-5b3d983674a8\") " pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.734607 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.734520    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:23.871245 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.871219    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"]
Jul 28 19:40:23.873465 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:40:23.873444    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod765ce775_7f76_49b0_a6e8_5b3d983674a8.slice/crio-66184e5df8434a17e7b5ff8d8f39c4240e3b80d012d6683a1dd14fb7f03b886f WatchSource:0}: Error finding container 66184e5df8434a17e7b5ff8d8f39c4240e3b80d012d6683a1dd14fb7f03b886f: Status 404 returned error can't find the container with id 66184e5df8434a17e7b5ff8d8f39c4240e3b80d012d6683a1dd14fb7f03b886f
Jul 28 19:40:23.875866 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.875848    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 19:40:23.962628 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:23.962589    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4" event={"ID":"765ce775-7f76-49b0-a6e8-5b3d983674a8","Type":"ContainerStarted","Data":"66184e5df8434a17e7b5ff8d8f39c4240e3b80d012d6683a1dd14fb7f03b886f"}
Jul 28 19:40:26.978872 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:26.978789    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4" event={"ID":"765ce775-7f76-49b0-a6e8-5b3d983674a8","Type":"ContainerStarted","Data":"4534e27bd6e79a45e0c2ff875396311e3d070be3218707fcd4684bdd45b01eeb"}
Jul 28 19:40:27.984996 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:27.984963    2563 generic.go:356] "Generic (PLEG): container finished" podID="765ce775-7f76-49b0-a6e8-5b3d983674a8" containerID="4534e27bd6e79a45e0c2ff875396311e3d070be3218707fcd4684bdd45b01eeb" exitCode=0
Jul 28 19:40:27.985365 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:27.985002    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4" event={"ID":"765ce775-7f76-49b0-a6e8-5b3d983674a8","Type":"ContainerDied","Data":"4534e27bd6e79a45e0c2ff875396311e3d070be3218707fcd4684bdd45b01eeb"}
Jul 28 19:40:28.990908 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:28.990826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4" event={"ID":"765ce775-7f76-49b0-a6e8-5b3d983674a8","Type":"ContainerStarted","Data":"0c7f9cc9b51b830953eb1144ef61d45f104d6e2f6ce3b677a87530ed2c01a1ef"}
Jul 28 19:40:28.991251 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:28.990918    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:29.016667 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:29.016612    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4" podStartSLOduration=1.5581850259999999 podStartE2EDuration="6.016595994s" totalImagesPullingTime="3.3631661s" totalInitContainerRuntime="1.095244868s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:40:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:40:29.0135813 +0000 UTC m=+314.035876887" watchObservedRunningTime="2026-07-28 19:40:29.016595994 +0000 UTC m=+314.038891581"
Jul 28 19:40:39.998407 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:39.998371    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f4d69945-pklc4"
Jul 28 19:40:42.753572 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:42.753525    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f9868ff69-ql269"]
Jul 28 19:40:42.756491 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:42.756472    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f9868ff69-ql269"
Jul 28 19:40:42.760933 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:42.760909    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 28 19:40:42.761124 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:42.761110    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 28 19:40:42.761211 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:42.761153    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 19:40:42.762127 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:42.762110    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zr7lh\""
Jul 28 19:40:42.762223 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:42.762157    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 19:40:42.777312 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:42.777286    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f9868ff69-ql269"]
Jul 28 19:40:42.909255 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:42.909226    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b715383-6b15-41a2-bf7e-279e1a94ccf1-tmp\") pod \"kube-auth-proxy-5f9868ff69-ql269\" (UID: \"3b715383-6b15-41a2-bf7e-279e1a94ccf1\") " pod="openshift-ingress/kube-auth-proxy-5f9868ff69-ql269"
Jul 28 19:40:42.909447 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:42.909268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b715383-6b15-41a2-bf7e-279e1a94ccf1-tls-certs\") pod \"kube-auth-proxy-5f9868ff69-ql269\" (UID: \"3b715383-6b15-41a2-bf7e-279e1a94ccf1\") " pod="openshift-ingress/kube-auth-proxy-5f9868ff69-ql269"
Jul 28 19:40:42.909447 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:42.909298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khq9q\" (UniqueName: \"kubernetes.io/projected/3b715383-6b15-41a2-bf7e-279e1a94ccf1-kube-api-access-khq9q\") pod \"kube-auth-proxy-5f9868ff69-ql269\" (UID: \"3b715383-6b15-41a2-bf7e-279e1a94ccf1\") " pod="openshift-ingress/kube-auth-proxy-5f9868ff69-ql269"
Jul 28 19:40:43.010583 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:43.010482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b715383-6b15-41a2-bf7e-279e1a94ccf1-tmp\") pod \"kube-auth-proxy-5f9868ff69-ql269\" (UID: \"3b715383-6b15-41a2-bf7e-279e1a94ccf1\") " pod="openshift-ingress/kube-auth-proxy-5f9868ff69-ql269"
Jul 28 19:40:43.010583 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:43.010519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b715383-6b15-41a2-bf7e-279e1a94ccf1-tls-certs\") pod \"kube-auth-proxy-5f9868ff69-ql269\" (UID: \"3b715383-6b15-41a2-bf7e-279e1a94ccf1\") " pod="openshift-ingress/kube-auth-proxy-5f9868ff69-ql269"
Jul 28 19:40:43.010583 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:43.010556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khq9q\" (UniqueName: \"kubernetes.io/projected/3b715383-6b15-41a2-bf7e-279e1a94ccf1-kube-api-access-khq9q\") pod \"kube-auth-proxy-5f9868ff69-ql269\" (UID: \"3b715383-6b15-41a2-bf7e-279e1a94ccf1\") " pod="openshift-ingress/kube-auth-proxy-5f9868ff69-ql269"
Jul 28 19:40:43.012717 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:43.012699    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b715383-6b15-41a2-bf7e-279e1a94ccf1-tmp\") pod \"kube-auth-proxy-5f9868ff69-ql269\" (UID: \"3b715383-6b15-41a2-bf7e-279e1a94ccf1\") " pod="openshift-ingress/kube-auth-proxy-5f9868ff69-ql269"
Jul 28 19:40:43.012856 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:43.012835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b715383-6b15-41a2-bf7e-279e1a94ccf1-tls-certs\") pod \"kube-auth-proxy-5f9868ff69-ql269\" (UID: \"3b715383-6b15-41a2-bf7e-279e1a94ccf1\") " pod="openshift-ingress/kube-auth-proxy-5f9868ff69-ql269"
Jul 28 19:40:43.025486 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:43.025462    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khq9q\" (UniqueName: \"kubernetes.io/projected/3b715383-6b15-41a2-bf7e-279e1a94ccf1-kube-api-access-khq9q\") pod \"kube-auth-proxy-5f9868ff69-ql269\" (UID: \"3b715383-6b15-41a2-bf7e-279e1a94ccf1\") " pod="openshift-ingress/kube-auth-proxy-5f9868ff69-ql269"
Jul 28 19:40:43.066140 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:43.066103    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f9868ff69-ql269"
Jul 28 19:40:43.203139 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:43.203115    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f9868ff69-ql269"]
Jul 28 19:40:43.205466 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:40:43.205433    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b715383_6b15_41a2_bf7e_279e1a94ccf1.slice/crio-339bd7b6b4bae9ed8226e0872dcd61e2b48ca221cb00522e935778bc73014681 WatchSource:0}: Error finding container 339bd7b6b4bae9ed8226e0872dcd61e2b48ca221cb00522e935778bc73014681: Status 404 returned error can't find the container with id 339bd7b6b4bae9ed8226e0872dcd61e2b48ca221cb00522e935778bc73014681
Jul 28 19:40:44.010993 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:44.010959    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jj74k"]
Jul 28 19:40:44.013725 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:44.013702    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jj74k"
Jul 28 19:40:44.016134 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:44.016109    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 28 19:40:44.016261 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:44.016216    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hbggp\""
Jul 28 19:40:44.020839 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:44.020731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9sqt\" (UniqueName: \"kubernetes.io/projected/24f6d720-7c14-4328-8f02-1f44696aab58-kube-api-access-g9sqt\") pod \"model-serving-api-54d89bd5fc-jj74k\" (UID: \"24f6d720-7c14-4328-8f02-1f44696aab58\") " pod="opendatahub/model-serving-api-54d89bd5fc-jj74k"
Jul 28 19:40:44.020839 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:44.020772    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24f6d720-7c14-4328-8f02-1f44696aab58-tls-certs\") pod \"model-serving-api-54d89bd5fc-jj74k\" (UID: \"24f6d720-7c14-4328-8f02-1f44696aab58\") " pod="opendatahub/model-serving-api-54d89bd5fc-jj74k"
Jul 28 19:40:44.024529 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:44.024498    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jj74k"]
Jul 28 19:40:44.058506 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:44.058467    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f9868ff69-ql269" event={"ID":"3b715383-6b15-41a2-bf7e-279e1a94ccf1","Type":"ContainerStarted","Data":"339bd7b6b4bae9ed8226e0872dcd61e2b48ca221cb00522e935778bc73014681"}
Jul 28 19:40:44.121892 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:44.121853    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9sqt\" (UniqueName: \"kubernetes.io/projected/24f6d720-7c14-4328-8f02-1f44696aab58-kube-api-access-g9sqt\") pod \"model-serving-api-54d89bd5fc-jj74k\" (UID: \"24f6d720-7c14-4328-8f02-1f44696aab58\") " pod="opendatahub/model-serving-api-54d89bd5fc-jj74k"
Jul 28 19:40:44.121892 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:44.121889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24f6d720-7c14-4328-8f02-1f44696aab58-tls-certs\") pod \"model-serving-api-54d89bd5fc-jj74k\" (UID: \"24f6d720-7c14-4328-8f02-1f44696aab58\") " pod="opendatahub/model-serving-api-54d89bd5fc-jj74k"
Jul 28 19:40:44.122108 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:40:44.122015    2563 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 28 19:40:44.122108 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:40:44.122067    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24f6d720-7c14-4328-8f02-1f44696aab58-tls-certs podName:24f6d720-7c14-4328-8f02-1f44696aab58 nodeName:}" failed. No retries permitted until 2026-07-28 19:40:44.622050994 +0000 UTC m=+329.644346560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/24f6d720-7c14-4328-8f02-1f44696aab58-tls-certs") pod "model-serving-api-54d89bd5fc-jj74k" (UID: "24f6d720-7c14-4328-8f02-1f44696aab58") : secret "model-serving-api-tls" not found
Jul 28 19:40:44.130343 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:44.130307    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9sqt\" (UniqueName: \"kubernetes.io/projected/24f6d720-7c14-4328-8f02-1f44696aab58-kube-api-access-g9sqt\") pod \"model-serving-api-54d89bd5fc-jj74k\" (UID: \"24f6d720-7c14-4328-8f02-1f44696aab58\") " pod="opendatahub/model-serving-api-54d89bd5fc-jj74k"
Jul 28 19:40:44.626162 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:44.626123    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24f6d720-7c14-4328-8f02-1f44696aab58-tls-certs\") pod \"model-serving-api-54d89bd5fc-jj74k\" (UID: \"24f6d720-7c14-4328-8f02-1f44696aab58\") " pod="opendatahub/model-serving-api-54d89bd5fc-jj74k"
Jul 28 19:40:44.626345 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:40:44.626225    2563 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 28 19:40:44.626345 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:40:44.626294    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24f6d720-7c14-4328-8f02-1f44696aab58-tls-certs podName:24f6d720-7c14-4328-8f02-1f44696aab58 nodeName:}" failed. No retries permitted until 2026-07-28 19:40:45.626276787 +0000 UTC m=+330.648572353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/24f6d720-7c14-4328-8f02-1f44696aab58-tls-certs") pod "model-serving-api-54d89bd5fc-jj74k" (UID: "24f6d720-7c14-4328-8f02-1f44696aab58") : secret "model-serving-api-tls" not found
Jul 28 19:40:45.633342 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:45.633305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24f6d720-7c14-4328-8f02-1f44696aab58-tls-certs\") pod \"model-serving-api-54d89bd5fc-jj74k\" (UID: \"24f6d720-7c14-4328-8f02-1f44696aab58\") " pod="opendatahub/model-serving-api-54d89bd5fc-jj74k"
Jul 28 19:40:45.636026 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:45.636002    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24f6d720-7c14-4328-8f02-1f44696aab58-tls-certs\") pod \"model-serving-api-54d89bd5fc-jj74k\" (UID: \"24f6d720-7c14-4328-8f02-1f44696aab58\") " pod="opendatahub/model-serving-api-54d89bd5fc-jj74k"
Jul 28 19:40:45.833759 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:45.833728    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jj74k"
Jul 28 19:40:46.124577 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:46.124526    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jj74k"]
Jul 28 19:40:46.125467 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:40:46.125444    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f6d720_7c14_4328_8f02_1f44696aab58.slice/crio-119302a53365cd466f2a9ed1144119b2c5c668ca66ae5b085f3585111fd90c53 WatchSource:0}: Error finding container 119302a53365cd466f2a9ed1144119b2c5c668ca66ae5b085f3585111fd90c53: Status 404 returned error can't find the container with id 119302a53365cd466f2a9ed1144119b2c5c668ca66ae5b085f3585111fd90c53
Jul 28 19:40:47.077384 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:47.077343    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jj74k" event={"ID":"24f6d720-7c14-4328-8f02-1f44696aab58","Type":"ContainerStarted","Data":"119302a53365cd466f2a9ed1144119b2c5c668ca66ae5b085f3585111fd90c53"}
Jul 28 19:40:47.079017 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:47.078988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f9868ff69-ql269" event={"ID":"3b715383-6b15-41a2-bf7e-279e1a94ccf1","Type":"ContainerStarted","Data":"13a7b7a7298c0b653cb63c57344f9ec2d6807748a770c70ed7c7843b3c655a2d"}
Jul 28 19:40:47.098371 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:47.098318    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f9868ff69-ql269" podStartSLOduration=2.270042319 podStartE2EDuration="5.098298342s" totalImagesPullingTime="2.828256023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:40:47.09732956 +0000 UTC m=+332.119625155" watchObservedRunningTime="2026-07-28 19:40:47.098298342 +0000 UTC m=+332.120593931"
Jul 28 19:40:49.089739 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:49.089707    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jj74k" event={"ID":"24f6d720-7c14-4328-8f02-1f44696aab58","Type":"ContainerStarted","Data":"37522d6dbb8f94f0368a00c196991d0523d5f2272bcff7e799c3e0301c50c1db"}
Jul 28 19:40:49.090182 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:49.089838    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-jj74k"
Jul 28 19:40:49.111161 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:49.111112    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-jj74k" podStartSLOduration=4.191052916 podStartE2EDuration="6.111096507s" totalImagesPullingTime="1.920043591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:40:49.109202443 +0000 UTC m=+334.131498030" watchObservedRunningTime="2026-07-28 19:40:49.111096507 +0000 UTC m=+334.133392152"
Jul 28 19:40:50.531839 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.531809    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"]
Jul 28 19:40:50.534516 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.534495    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.539091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.539073    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-chbbw\""
Jul 28 19:40:50.539677 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.539659    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 19:40:50.570178 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.570150    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"]
Jul 28 19:40:50.574940 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.574916    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22e38ea6-bc5b-4365-8ab6-6a2a36532114-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.575051 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.574957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e38ea6-bc5b-4365-8ab6-6a2a36532114-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.575051 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.574984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e38ea6-bc5b-4365-8ab6-6a2a36532114-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.575126 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.575058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22e38ea6-bc5b-4365-8ab6-6a2a36532114-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.575126 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.575091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhm64\" (UniqueName: \"kubernetes.io/projected/22e38ea6-bc5b-4365-8ab6-6a2a36532114-kube-api-access-zhm64\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.575126 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.575112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22e38ea6-bc5b-4365-8ab6-6a2a36532114-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.575233 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.575129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22e38ea6-bc5b-4365-8ab6-6a2a36532114-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.575233 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.575195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22e38ea6-bc5b-4365-8ab6-6a2a36532114-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.575299 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.575266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22e38ea6-bc5b-4365-8ab6-6a2a36532114-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.676076 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.676032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22e38ea6-bc5b-4365-8ab6-6a2a36532114-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.676076 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.676077    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhm64\" (UniqueName: \"kubernetes.io/projected/22e38ea6-bc5b-4365-8ab6-6a2a36532114-kube-api-access-zhm64\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.676335 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.676105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22e38ea6-bc5b-4365-8ab6-6a2a36532114-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.676335 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.676135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22e38ea6-bc5b-4365-8ab6-6a2a36532114-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.676335 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.676173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22e38ea6-bc5b-4365-8ab6-6a2a36532114-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.676335 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.676230    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22e38ea6-bc5b-4365-8ab6-6a2a36532114-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.676335 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.676258    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22e38ea6-bc5b-4365-8ab6-6a2a36532114-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.676335 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.676292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e38ea6-bc5b-4365-8ab6-6a2a36532114-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.676335 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.676315    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e38ea6-bc5b-4365-8ab6-6a2a36532114-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.676726 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.676701    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22e38ea6-bc5b-4365-8ab6-6a2a36532114-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.676780 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.676726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22e38ea6-bc5b-4365-8ab6-6a2a36532114-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.676838 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.676820    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e38ea6-bc5b-4365-8ab6-6a2a36532114-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.676898 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.676882    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22e38ea6-bc5b-4365-8ab6-6a2a36532114-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.677136 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.677119    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22e38ea6-bc5b-4365-8ab6-6a2a36532114-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.678475 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.678453    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22e38ea6-bc5b-4365-8ab6-6a2a36532114-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.678711 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.678692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22e38ea6-bc5b-4365-8ab6-6a2a36532114-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.691473 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.691451    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhm64\" (UniqueName: \"kubernetes.io/projected/22e38ea6-bc5b-4365-8ab6-6a2a36532114-kube-api-access-zhm64\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.691621 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.691475    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22e38ea6-bc5b-4365-8ab6-6a2a36532114-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c9j62r\" (UID: \"22e38ea6-bc5b-4365-8ab6-6a2a36532114\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.844080 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.843992    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:50.976768 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:50.976737    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"]
Jul 28 19:40:50.980242 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:40:50.980218    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e38ea6_bc5b_4365_8ab6_6a2a36532114.slice/crio-94f99a95332511d78f305c76e9dc2a7a151ca05729362dd045dd19da203d7355 WatchSource:0}: Error finding container 94f99a95332511d78f305c76e9dc2a7a151ca05729362dd045dd19da203d7355: Status 404 returned error can't find the container with id 94f99a95332511d78f305c76e9dc2a7a151ca05729362dd045dd19da203d7355
Jul 28 19:40:51.100130 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:51.100048    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r" event={"ID":"22e38ea6-bc5b-4365-8ab6-6a2a36532114","Type":"ContainerStarted","Data":"94f99a95332511d78f305c76e9dc2a7a151ca05729362dd045dd19da203d7355"}
Jul 28 19:40:52.392038 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.392000    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"]
Jul 28 19:40:52.394494 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.394476    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:40:52.402181 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.402150    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cljhz\""
Jul 28 19:40:52.402448 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.402154    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 28 19:40:52.402564 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.402225    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 28 19:40:52.402634 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.402273    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 28 19:40:52.404855 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.404832    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"]
Jul 28 19:40:52.492511 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.492448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0131ae4d-357a-46ed-b45c-5b4043385965-cert\") pod \"lws-controller-manager-69b7dc5fd4-2wkzb\" (UID: \"0131ae4d-357a-46ed-b45c-5b4043385965\") " pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:40:52.492701 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.492526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8msxq\" (UniqueName: \"kubernetes.io/projected/0131ae4d-357a-46ed-b45c-5b4043385965-kube-api-access-8msxq\") pod \"lws-controller-manager-69b7dc5fd4-2wkzb\" (UID: \"0131ae4d-357a-46ed-b45c-5b4043385965\") " pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:40:52.492701 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.492576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0131ae4d-357a-46ed-b45c-5b4043385965-metrics-cert\") pod \"lws-controller-manager-69b7dc5fd4-2wkzb\" (UID: \"0131ae4d-357a-46ed-b45c-5b4043385965\") " pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:40:52.492701 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.492595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0131ae4d-357a-46ed-b45c-5b4043385965-manager-config\") pod \"lws-controller-manager-69b7dc5fd4-2wkzb\" (UID: \"0131ae4d-357a-46ed-b45c-5b4043385965\") " pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:40:52.593820 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.593782    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0131ae4d-357a-46ed-b45c-5b4043385965-cert\") pod \"lws-controller-manager-69b7dc5fd4-2wkzb\" (UID: \"0131ae4d-357a-46ed-b45c-5b4043385965\") " pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:40:52.594003 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.593833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8msxq\" (UniqueName: \"kubernetes.io/projected/0131ae4d-357a-46ed-b45c-5b4043385965-kube-api-access-8msxq\") pod \"lws-controller-manager-69b7dc5fd4-2wkzb\" (UID: \"0131ae4d-357a-46ed-b45c-5b4043385965\") " pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:40:52.594003 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.593853    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0131ae4d-357a-46ed-b45c-5b4043385965-metrics-cert\") pod \"lws-controller-manager-69b7dc5fd4-2wkzb\" (UID: \"0131ae4d-357a-46ed-b45c-5b4043385965\") " pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:40:52.594114 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.594024    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0131ae4d-357a-46ed-b45c-5b4043385965-manager-config\") pod \"lws-controller-manager-69b7dc5fd4-2wkzb\" (UID: \"0131ae4d-357a-46ed-b45c-5b4043385965\") " pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:40:52.594812 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.594764    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0131ae4d-357a-46ed-b45c-5b4043385965-manager-config\") pod \"lws-controller-manager-69b7dc5fd4-2wkzb\" (UID: \"0131ae4d-357a-46ed-b45c-5b4043385965\") " pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:40:52.597071 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.597049    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0131ae4d-357a-46ed-b45c-5b4043385965-cert\") pod \"lws-controller-manager-69b7dc5fd4-2wkzb\" (UID: \"0131ae4d-357a-46ed-b45c-5b4043385965\") " pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:40:52.597457 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.597430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0131ae4d-357a-46ed-b45c-5b4043385965-metrics-cert\") pod \"lws-controller-manager-69b7dc5fd4-2wkzb\" (UID: \"0131ae4d-357a-46ed-b45c-5b4043385965\") " pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:40:52.602849 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.602799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8msxq\" (UniqueName: \"kubernetes.io/projected/0131ae4d-357a-46ed-b45c-5b4043385965-kube-api-access-8msxq\") pod \"lws-controller-manager-69b7dc5fd4-2wkzb\" (UID: \"0131ae4d-357a-46ed-b45c-5b4043385965\") " pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:40:52.712091 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:52.711999    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:40:53.064564 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:53.062757    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"]
Jul 28 19:40:53.112489 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:53.112453    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb" event={"ID":"0131ae4d-357a-46ed-b45c-5b4043385965","Type":"ContainerStarted","Data":"99d521c55650be41f60c12edbfd103d9e337f151eb6d42a1e7dd3ba09e56ff7f"}
Jul 28 19:40:54.097250 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:54.097209    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 19:40:54.097530 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:54.097286    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 19:40:54.097530 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:54.097316    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 19:40:55.124089 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:55.124044    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r" event={"ID":"22e38ea6-bc5b-4365-8ab6-6a2a36532114","Type":"ContainerStarted","Data":"512729a9e1629b9586e6c4a181174e2ed6cd4aeef421761cee77c8fb7384f4c2"}
Jul 28 19:40:55.125710 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:55.125684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb" event={"ID":"0131ae4d-357a-46ed-b45c-5b4043385965","Type":"ContainerStarted","Data":"c373a49b0be79d65374e07c33e1314ddef3bba126234c431b12267c17740f4ec"}
Jul 28 19:40:55.125829 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:55.125755    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:40:55.145908 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:55.145856    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r" podStartSLOduration=2.031060251 podStartE2EDuration="5.145838663s" totalImagesPullingTime="3.114778412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:40:55.144253853 +0000 UTC m=+340.166549475" watchObservedRunningTime="2026-07-28 19:40:55.145838663 +0000 UTC m=+340.168134251"
Jul 28 19:40:55.170347 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:55.170292    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb" podStartSLOduration=1.279114448 podStartE2EDuration="3.17027578s" totalImagesPullingTime="1.891161332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:40:55.16861658 +0000 UTC m=+340.190912172" watchObservedRunningTime="2026-07-28 19:40:55.17027578 +0000 UTC m=+340.192571369"
Jul 28 19:40:55.844987 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:55.844952    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:55.849441 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:55.849415    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:56.133979 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:56.133893    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:40:56.134849 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:40:56.134823    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c9j62r"
Jul 28 19:41:00.098260 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:00.098230    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-jj74k"
Jul 28 19:41:06.136316 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:06.136286    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-69b7dc5fd4-2wkzb"
Jul 28 19:41:59.009052 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.009015    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"]
Jul 28 19:41:59.011765 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.011749    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"
Jul 28 19:41:59.014172 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.014144    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 19:41:59.014172 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.014147    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 19:41:59.015121 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.015103    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6gsrx\""
Jul 28 19:41:59.020886 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.020862    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"]
Jul 28 19:41:59.057290 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.057250    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9txbg\" (UniqueName: \"kubernetes.io/projected/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-kube-api-access-9txbg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp\" (UID: \"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"
Jul 28 19:41:59.057493 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.057301    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp\" (UID: \"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"
Jul 28 19:41:59.057493 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.057444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp\" (UID: \"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"
Jul 28 19:41:59.158707 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.158671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp\" (UID: \"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"
Jul 28 19:41:59.158879 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.158718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9txbg\" (UniqueName: \"kubernetes.io/projected/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-kube-api-access-9txbg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp\" (UID: \"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"
Jul 28 19:41:59.158930 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.158895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp\" (UID: \"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"
Jul 28 19:41:59.159069 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.159039    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp\" (UID: \"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"
Jul 28 19:41:59.159190 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.159174    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp\" (UID: \"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"
Jul 28 19:41:59.168878 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.168852    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9txbg\" (UniqueName: \"kubernetes.io/projected/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-kube-api-access-9txbg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp\" (UID: \"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"
Jul 28 19:41:59.321773 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.321683    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"
Jul 28 19:41:59.453477 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.453454    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"]
Jul 28 19:41:59.455811 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:41:59.455786    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f82d7c_c1eb_4de0_8c61_c95471ac75f8.slice/crio-42bf2b36b92756e7bc712a1817a7cd66673a9b07207d17a28111f917af33d194 WatchSource:0}: Error finding container 42bf2b36b92756e7bc712a1817a7cd66673a9b07207d17a28111f917af33d194: Status 404 returned error can't find the container with id 42bf2b36b92756e7bc712a1817a7cd66673a9b07207d17a28111f917af33d194
Jul 28 19:41:59.836321 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.835958    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"]
Jul 28 19:41:59.838921 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.838905    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"
Jul 28 19:41:59.849121 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.849098    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"]
Jul 28 19:41:59.965944 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.965908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8be42563-d715-459a-812e-91f094ad118c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf\" (UID: \"8be42563-d715-459a-812e-91f094ad118c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"
Jul 28 19:41:59.965944 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.965947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwh5x\" (UniqueName: \"kubernetes.io/projected/8be42563-d715-459a-812e-91f094ad118c-kube-api-access-xwh5x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf\" (UID: \"8be42563-d715-459a-812e-91f094ad118c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"
Jul 28 19:41:59.966147 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:41:59.966070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8be42563-d715-459a-812e-91f094ad118c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf\" (UID: \"8be42563-d715-459a-812e-91f094ad118c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"
Jul 28 19:42:00.067063 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.067025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8be42563-d715-459a-812e-91f094ad118c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf\" (UID: \"8be42563-d715-459a-812e-91f094ad118c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"
Jul 28 19:42:00.067063 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.067069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwh5x\" (UniqueName: \"kubernetes.io/projected/8be42563-d715-459a-812e-91f094ad118c-kube-api-access-xwh5x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf\" (UID: \"8be42563-d715-459a-812e-91f094ad118c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"
Jul 28 19:42:00.067627 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.067143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8be42563-d715-459a-812e-91f094ad118c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf\" (UID: \"8be42563-d715-459a-812e-91f094ad118c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"
Jul 28 19:42:00.067627 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.067506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8be42563-d715-459a-812e-91f094ad118c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf\" (UID: \"8be42563-d715-459a-812e-91f094ad118c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"
Jul 28 19:42:00.067627 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.067589    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8be42563-d715-459a-812e-91f094ad118c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf\" (UID: \"8be42563-d715-459a-812e-91f094ad118c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"
Jul 28 19:42:00.075954 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.075934    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwh5x\" (UniqueName: \"kubernetes.io/projected/8be42563-d715-459a-812e-91f094ad118c-kube-api-access-xwh5x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf\" (UID: \"8be42563-d715-459a-812e-91f094ad118c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"
Jul 28 19:42:00.147742 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.147664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"
Jul 28 19:42:00.206843 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.206817    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"]
Jul 28 19:42:00.209428 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.209412    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"
Jul 28 19:42:00.220919 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.220896    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"]
Jul 28 19:42:00.268866 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.268830    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgmpf\" (UniqueName: \"kubernetes.io/projected/e074634e-0b9b-4211-9d3a-ac49689ad9bd-kube-api-access-zgmpf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5\" (UID: \"e074634e-0b9b-4211-9d3a-ac49689ad9bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"
Jul 28 19:42:00.269014 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.268946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e074634e-0b9b-4211-9d3a-ac49689ad9bd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5\" (UID: \"e074634e-0b9b-4211-9d3a-ac49689ad9bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"
Jul 28 19:42:00.269056 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.269013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e074634e-0b9b-4211-9d3a-ac49689ad9bd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5\" (UID: \"e074634e-0b9b-4211-9d3a-ac49689ad9bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"
Jul 28 19:42:00.280679 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.280654    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"]
Jul 28 19:42:00.282266 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:42:00.282239    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be42563_d715_459a_812e_91f094ad118c.slice/crio-3b5096171155c702881e198d2fd8af6d828ca980b1a2c6e72fded42fe5171c0e WatchSource:0}: Error finding container 3b5096171155c702881e198d2fd8af6d828ca980b1a2c6e72fded42fe5171c0e: Status 404 returned error can't find the container with id 3b5096171155c702881e198d2fd8af6d828ca980b1a2c6e72fded42fe5171c0e
Jul 28 19:42:00.369593 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.369536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e074634e-0b9b-4211-9d3a-ac49689ad9bd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5\" (UID: \"e074634e-0b9b-4211-9d3a-ac49689ad9bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"
Jul 28 19:42:00.369785 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.369613    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgmpf\" (UniqueName: \"kubernetes.io/projected/e074634e-0b9b-4211-9d3a-ac49689ad9bd-kube-api-access-zgmpf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5\" (UID: \"e074634e-0b9b-4211-9d3a-ac49689ad9bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"
Jul 28 19:42:00.369785 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.369688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e074634e-0b9b-4211-9d3a-ac49689ad9bd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5\" (UID: \"e074634e-0b9b-4211-9d3a-ac49689ad9bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"
Jul 28 19:42:00.369920 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.369859    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e074634e-0b9b-4211-9d3a-ac49689ad9bd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5\" (UID: \"e074634e-0b9b-4211-9d3a-ac49689ad9bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"
Jul 28 19:42:00.370012 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.369993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e074634e-0b9b-4211-9d3a-ac49689ad9bd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5\" (UID: \"e074634e-0b9b-4211-9d3a-ac49689ad9bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"
Jul 28 19:42:00.378985 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.378958    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgmpf\" (UniqueName: \"kubernetes.io/projected/e074634e-0b9b-4211-9d3a-ac49689ad9bd-kube-api-access-zgmpf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5\" (UID: \"e074634e-0b9b-4211-9d3a-ac49689ad9bd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"
Jul 28 19:42:00.420131 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.420055    2563 generic.go:356] "Generic (PLEG): container finished" podID="a4f82d7c-c1eb-4de0-8c61-c95471ac75f8" containerID="6347b49980abc2de3d4a78739d40767b63b1e8e832412926cb2f8bb0812cb7cb" exitCode=0
Jul 28 19:42:00.420272 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.420145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp" event={"ID":"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8","Type":"ContainerDied","Data":"6347b49980abc2de3d4a78739d40767b63b1e8e832412926cb2f8bb0812cb7cb"}
Jul 28 19:42:00.420272 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.420193    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp" event={"ID":"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8","Type":"ContainerStarted","Data":"42bf2b36b92756e7bc712a1817a7cd66673a9b07207d17a28111f917af33d194"}
Jul 28 19:42:00.421758 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.421737    2563 generic.go:356] "Generic (PLEG): container finished" podID="8be42563-d715-459a-812e-91f094ad118c" containerID="727722e73981933c5f37f8eaa80d3d5eeb3bfd907df24bf0d523784eac9aff16" exitCode=0
Jul 28 19:42:00.421845 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.421775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf" event={"ID":"8be42563-d715-459a-812e-91f094ad118c","Type":"ContainerDied","Data":"727722e73981933c5f37f8eaa80d3d5eeb3bfd907df24bf0d523784eac9aff16"}
Jul 28 19:42:00.421845 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.421816    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf" event={"ID":"8be42563-d715-459a-812e-91f094ad118c","Type":"ContainerStarted","Data":"3b5096171155c702881e198d2fd8af6d828ca980b1a2c6e72fded42fe5171c0e"}
Jul 28 19:42:00.518534 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.518494    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"
Jul 28 19:42:00.608601 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.608571    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"]
Jul 28 19:42:00.611187 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.611166    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"
Jul 28 19:42:00.624192 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.624163    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"]
Jul 28 19:42:00.652113 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.651941    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"]
Jul 28 19:42:00.654145 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:42:00.654115    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode074634e_0b9b_4211_9d3a_ac49689ad9bd.slice/crio-9ce47952a1baf24f1803d9e0ad096e374cddf1d377f279067d567f1898aa9501 WatchSource:0}: Error finding container 9ce47952a1baf24f1803d9e0ad096e374cddf1d377f279067d567f1898aa9501: Status 404 returned error can't find the container with id 9ce47952a1baf24f1803d9e0ad096e374cddf1d377f279067d567f1898aa9501
Jul 28 19:42:00.672718 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.672669    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e64078b8-7322-4064-bc3d-775078f29364-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4\" (UID: \"e64078b8-7322-4064-bc3d-775078f29364\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"
Jul 28 19:42:00.672802 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.672719    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls4f6\" (UniqueName: \"kubernetes.io/projected/e64078b8-7322-4064-bc3d-775078f29364-kube-api-access-ls4f6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4\" (UID: \"e64078b8-7322-4064-bc3d-775078f29364\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"
Jul 28 19:42:00.672802 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.672786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e64078b8-7322-4064-bc3d-775078f29364-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4\" (UID: \"e64078b8-7322-4064-bc3d-775078f29364\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"
Jul 28 19:42:00.773368 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.773333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e64078b8-7322-4064-bc3d-775078f29364-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4\" (UID: \"e64078b8-7322-4064-bc3d-775078f29364\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"
Jul 28 19:42:00.773528 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.773391    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls4f6\" (UniqueName: \"kubernetes.io/projected/e64078b8-7322-4064-bc3d-775078f29364-kube-api-access-ls4f6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4\" (UID: \"e64078b8-7322-4064-bc3d-775078f29364\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"
Jul 28 19:42:00.773635 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.773564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e64078b8-7322-4064-bc3d-775078f29364-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4\" (UID: \"e64078b8-7322-4064-bc3d-775078f29364\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"
Jul 28 19:42:00.773774 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.773751    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e64078b8-7322-4064-bc3d-775078f29364-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4\" (UID: \"e64078b8-7322-4064-bc3d-775078f29364\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"
Jul 28 19:42:00.773831 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.773799    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e64078b8-7322-4064-bc3d-775078f29364-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4\" (UID: \"e64078b8-7322-4064-bc3d-775078f29364\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"
Jul 28 19:42:00.782036 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.782016    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls4f6\" (UniqueName: \"kubernetes.io/projected/e64078b8-7322-4064-bc3d-775078f29364-kube-api-access-ls4f6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4\" (UID: \"e64078b8-7322-4064-bc3d-775078f29364\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"
Jul 28 19:42:00.921554 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:00.921509    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"
Jul 28 19:42:01.055778 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:01.055749    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"]
Jul 28 19:42:01.057634 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:42:01.057608    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode64078b8_7322_4064_bc3d_775078f29364.slice/crio-7f68bf7abc5593047c004c39113dfe5da445d5c930598347858eae5692987eac WatchSource:0}: Error finding container 7f68bf7abc5593047c004c39113dfe5da445d5c930598347858eae5692987eac: Status 404 returned error can't find the container with id 7f68bf7abc5593047c004c39113dfe5da445d5c930598347858eae5692987eac
Jul 28 19:42:01.429265 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:01.429234    2563 generic.go:356] "Generic (PLEG): container finished" podID="e074634e-0b9b-4211-9d3a-ac49689ad9bd" containerID="73c5a7eaf18c4fb14b469629b985e7a190294e9dbbd8af2ff516a9453a5e7d41" exitCode=0
Jul 28 19:42:01.429647 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:01.429311    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5" event={"ID":"e074634e-0b9b-4211-9d3a-ac49689ad9bd","Type":"ContainerDied","Data":"73c5a7eaf18c4fb14b469629b985e7a190294e9dbbd8af2ff516a9453a5e7d41"}
Jul 28 19:42:01.429647 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:01.429358    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5" event={"ID":"e074634e-0b9b-4211-9d3a-ac49689ad9bd","Type":"ContainerStarted","Data":"9ce47952a1baf24f1803d9e0ad096e374cddf1d377f279067d567f1898aa9501"}
Jul 28 19:42:01.431353 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:01.431331    2563 generic.go:356] "Generic (PLEG): container finished" podID="a4f82d7c-c1eb-4de0-8c61-c95471ac75f8" containerID="bb808514eefd43a88ba1b77444c78b429dfb214272a22470f58319ffb3667795" exitCode=0
Jul 28 19:42:01.431436 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:01.431410    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp" event={"ID":"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8","Type":"ContainerDied","Data":"bb808514eefd43a88ba1b77444c78b429dfb214272a22470f58319ffb3667795"}
Jul 28 19:42:01.433264 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:01.433191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf" event={"ID":"8be42563-d715-459a-812e-91f094ad118c","Type":"ContainerStarted","Data":"b0552b81f40ec7b34d8b4c8d6327a71375ab1574f0cb425ee38b4e98d156f02e"}
Jul 28 19:42:01.434802 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:01.434780    2563 generic.go:356] "Generic (PLEG): container finished" podID="e64078b8-7322-4064-bc3d-775078f29364" containerID="718f1ab1516780ee1d0cdb1a2fd4f4c844085358e9add9a03719e4ecc0cb100e" exitCode=0
Jul 28 19:42:01.434888 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:01.434810    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4" event={"ID":"e64078b8-7322-4064-bc3d-775078f29364","Type":"ContainerDied","Data":"718f1ab1516780ee1d0cdb1a2fd4f4c844085358e9add9a03719e4ecc0cb100e"}
Jul 28 19:42:01.434888 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:01.434863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4" event={"ID":"e64078b8-7322-4064-bc3d-775078f29364","Type":"ContainerStarted","Data":"7f68bf7abc5593047c004c39113dfe5da445d5c930598347858eae5692987eac"}
Jul 28 19:42:02.444747 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:02.444717    2563 generic.go:356] "Generic (PLEG): container finished" podID="a4f82d7c-c1eb-4de0-8c61-c95471ac75f8" containerID="8f83a57fb899952f77b539d68b85605a133622873606624ca550e9dc75238703" exitCode=0
Jul 28 19:42:02.445172 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:02.444817    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp" event={"ID":"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8","Type":"ContainerDied","Data":"8f83a57fb899952f77b539d68b85605a133622873606624ca550e9dc75238703"}
Jul 28 19:42:02.446980 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:02.446915    2563 generic.go:356] "Generic (PLEG): container finished" podID="8be42563-d715-459a-812e-91f094ad118c" containerID="b0552b81f40ec7b34d8b4c8d6327a71375ab1574f0cb425ee38b4e98d156f02e" exitCode=0
Jul 28 19:42:02.446980 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:02.446943    2563 generic.go:356] "Generic (PLEG): container finished" podID="8be42563-d715-459a-812e-91f094ad118c" containerID="7180d37e4ddbeb1fbb47878e6118b533893b63f7d98e1e6f8c6a3706c4a2e52e" exitCode=0
Jul 28 19:42:02.446980 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:02.446951    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf" event={"ID":"8be42563-d715-459a-812e-91f094ad118c","Type":"ContainerDied","Data":"b0552b81f40ec7b34d8b4c8d6327a71375ab1574f0cb425ee38b4e98d156f02e"}
Jul 28 19:42:02.447173 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:02.446991    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf" event={"ID":"8be42563-d715-459a-812e-91f094ad118c","Type":"ContainerDied","Data":"7180d37e4ddbeb1fbb47878e6118b533893b63f7d98e1e6f8c6a3706c4a2e52e"}
Jul 28 19:42:02.448723 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:02.448701    2563 generic.go:356] "Generic (PLEG): container finished" podID="e64078b8-7322-4064-bc3d-775078f29364" containerID="9d733e7da529ecfeef41f911239a533d8f5f2362e648e4fe1e2dedc83f5fd94a" exitCode=0
Jul 28 19:42:02.448826 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:02.448747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4" event={"ID":"e64078b8-7322-4064-bc3d-775078f29364","Type":"ContainerDied","Data":"9d733e7da529ecfeef41f911239a533d8f5f2362e648e4fe1e2dedc83f5fd94a"}
Jul 28 19:42:03.455874 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.455788    2563 generic.go:356] "Generic (PLEG): container finished" podID="e64078b8-7322-4064-bc3d-775078f29364" containerID="76df29728c2cbb8d3ef3ac0ebc8be40e19ecba8021dc2d56271913c57e81c071" exitCode=0
Jul 28 19:42:03.456265 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.455868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4" event={"ID":"e64078b8-7322-4064-bc3d-775078f29364","Type":"ContainerDied","Data":"76df29728c2cbb8d3ef3ac0ebc8be40e19ecba8021dc2d56271913c57e81c071"}
Jul 28 19:42:03.457476 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.457455    2563 generic.go:356] "Generic (PLEG): container finished" podID="e074634e-0b9b-4211-9d3a-ac49689ad9bd" containerID="cc0ccad16ad56b54ad6e0be30ddb4395aa61253baa994ea64a3cd1a679a72c57" exitCode=0
Jul 28 19:42:03.457557 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.457504    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5" event={"ID":"e074634e-0b9b-4211-9d3a-ac49689ad9bd","Type":"ContainerDied","Data":"cc0ccad16ad56b54ad6e0be30ddb4395aa61253baa994ea64a3cd1a679a72c57"}
Jul 28 19:42:03.660017 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.659987    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"
Jul 28 19:42:03.662719 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.662702    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"
Jul 28 19:42:03.803376 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.803338    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8be42563-d715-459a-812e-91f094ad118c-bundle\") pod \"8be42563-d715-459a-812e-91f094ad118c\" (UID: \"8be42563-d715-459a-812e-91f094ad118c\") "
Jul 28 19:42:03.803596 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.803402    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9txbg\" (UniqueName: \"kubernetes.io/projected/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-kube-api-access-9txbg\") pod \"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8\" (UID: \"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8\") "
Jul 28 19:42:03.803596 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.803440    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwh5x\" (UniqueName: \"kubernetes.io/projected/8be42563-d715-459a-812e-91f094ad118c-kube-api-access-xwh5x\") pod \"8be42563-d715-459a-812e-91f094ad118c\" (UID: \"8be42563-d715-459a-812e-91f094ad118c\") "
Jul 28 19:42:03.803596 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.803562    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8be42563-d715-459a-812e-91f094ad118c-util\") pod \"8be42563-d715-459a-812e-91f094ad118c\" (UID: \"8be42563-d715-459a-812e-91f094ad118c\") "
Jul 28 19:42:03.803756 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.803628    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-bundle\") pod \"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8\" (UID: \"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8\") "
Jul 28 19:42:03.803756 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.803676    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-util\") pod \"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8\" (UID: \"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8\") "
Jul 28 19:42:03.804256 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.804228    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-bundle" (OuterVolumeSpecName: "bundle") pod "a4f82d7c-c1eb-4de0-8c61-c95471ac75f8" (UID: "a4f82d7c-c1eb-4de0-8c61-c95471ac75f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:42:03.805706 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.805682    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-kube-api-access-9txbg" (OuterVolumeSpecName: "kube-api-access-9txbg") pod "a4f82d7c-c1eb-4de0-8c61-c95471ac75f8" (UID: "a4f82d7c-c1eb-4de0-8c61-c95471ac75f8"). InnerVolumeSpecName "kube-api-access-9txbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:42:03.805844 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.805823    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8be42563-d715-459a-812e-91f094ad118c-bundle" (OuterVolumeSpecName: "bundle") pod "8be42563-d715-459a-812e-91f094ad118c" (UID: "8be42563-d715-459a-812e-91f094ad118c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:42:03.805937 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.805919    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8be42563-d715-459a-812e-91f094ad118c-kube-api-access-xwh5x" (OuterVolumeSpecName: "kube-api-access-xwh5x") pod "8be42563-d715-459a-812e-91f094ad118c" (UID: "8be42563-d715-459a-812e-91f094ad118c"). InnerVolumeSpecName "kube-api-access-xwh5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:42:03.811859 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.811808    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-util" (OuterVolumeSpecName: "util") pod "a4f82d7c-c1eb-4de0-8c61-c95471ac75f8" (UID: "a4f82d7c-c1eb-4de0-8c61-c95471ac75f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:42:03.812256 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.812238    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8be42563-d715-459a-812e-91f094ad118c-util" (OuterVolumeSpecName: "util") pod "8be42563-d715-459a-812e-91f094ad118c" (UID: "8be42563-d715-459a-812e-91f094ad118c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:42:03.904906 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.904878    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8be42563-d715-459a-812e-91f094ad118c-bundle\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:03.904906 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.904902    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9txbg\" (UniqueName: \"kubernetes.io/projected/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-kube-api-access-9txbg\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:03.904906 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.904913    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwh5x\" (UniqueName: \"kubernetes.io/projected/8be42563-d715-459a-812e-91f094ad118c-kube-api-access-xwh5x\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:03.905118 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.904921    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8be42563-d715-459a-812e-91f094ad118c-util\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:03.905118 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.904929    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-bundle\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:03.905118 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:03.904938    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4f82d7c-c1eb-4de0-8c61-c95471ac75f8-util\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:04.463923 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.463851    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp"
Jul 28 19:42:04.463923 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.463867    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp" event={"ID":"a4f82d7c-c1eb-4de0-8c61-c95471ac75f8","Type":"ContainerDied","Data":"42bf2b36b92756e7bc712a1817a7cd66673a9b07207d17a28111f917af33d194"}
Jul 28 19:42:04.463923 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.463918    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42bf2b36b92756e7bc712a1817a7cd66673a9b07207d17a28111f917af33d194"
Jul 28 19:42:04.465719 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.465702    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf"
Jul 28 19:42:04.465835 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.465734    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf" event={"ID":"8be42563-d715-459a-812e-91f094ad118c","Type":"ContainerDied","Data":"3b5096171155c702881e198d2fd8af6d828ca980b1a2c6e72fded42fe5171c0e"}
Jul 28 19:42:04.465835 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.465770    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b5096171155c702881e198d2fd8af6d828ca980b1a2c6e72fded42fe5171c0e"
Jul 28 19:42:04.467995 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.467972    2563 generic.go:356] "Generic (PLEG): container finished" podID="e074634e-0b9b-4211-9d3a-ac49689ad9bd" containerID="ba9cf099518c52bce93473dca6539a3d244f5856ba607c8d02fca6c216c55494" exitCode=0
Jul 28 19:42:04.468068 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.467994    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5" event={"ID":"e074634e-0b9b-4211-9d3a-ac49689ad9bd","Type":"ContainerDied","Data":"ba9cf099518c52bce93473dca6539a3d244f5856ba607c8d02fca6c216c55494"}
Jul 28 19:42:04.592827 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.592804    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"
Jul 28 19:42:04.711047 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.711006    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e64078b8-7322-4064-bc3d-775078f29364-util\") pod \"e64078b8-7322-4064-bc3d-775078f29364\" (UID: \"e64078b8-7322-4064-bc3d-775078f29364\") "
Jul 28 19:42:04.711214 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.711122    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e64078b8-7322-4064-bc3d-775078f29364-bundle\") pod \"e64078b8-7322-4064-bc3d-775078f29364\" (UID: \"e64078b8-7322-4064-bc3d-775078f29364\") "
Jul 28 19:42:04.711214 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.711148    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls4f6\" (UniqueName: \"kubernetes.io/projected/e64078b8-7322-4064-bc3d-775078f29364-kube-api-access-ls4f6\") pod \"e64078b8-7322-4064-bc3d-775078f29364\" (UID: \"e64078b8-7322-4064-bc3d-775078f29364\") "
Jul 28 19:42:04.711642 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.711609    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e64078b8-7322-4064-bc3d-775078f29364-bundle" (OuterVolumeSpecName: "bundle") pod "e64078b8-7322-4064-bc3d-775078f29364" (UID: "e64078b8-7322-4064-bc3d-775078f29364"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:42:04.713229 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.713206    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e64078b8-7322-4064-bc3d-775078f29364-kube-api-access-ls4f6" (OuterVolumeSpecName: "kube-api-access-ls4f6") pod "e64078b8-7322-4064-bc3d-775078f29364" (UID: "e64078b8-7322-4064-bc3d-775078f29364"). InnerVolumeSpecName "kube-api-access-ls4f6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:42:04.716698 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.716638    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e64078b8-7322-4064-bc3d-775078f29364-util" (OuterVolumeSpecName: "util") pod "e64078b8-7322-4064-bc3d-775078f29364" (UID: "e64078b8-7322-4064-bc3d-775078f29364"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:42:04.812009 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.811959    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e64078b8-7322-4064-bc3d-775078f29364-bundle\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:04.812009 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.812003    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls4f6\" (UniqueName: \"kubernetes.io/projected/e64078b8-7322-4064-bc3d-775078f29364-kube-api-access-ls4f6\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:04.812009 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:04.812014    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e64078b8-7322-4064-bc3d-775078f29364-util\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:05.475980 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:05.475954    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4"
Jul 28 19:42:05.476445 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:05.475988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4" event={"ID":"e64078b8-7322-4064-bc3d-775078f29364","Type":"ContainerDied","Data":"7f68bf7abc5593047c004c39113dfe5da445d5c930598347858eae5692987eac"}
Jul 28 19:42:05.476445 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:05.476037    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f68bf7abc5593047c004c39113dfe5da445d5c930598347858eae5692987eac"
Jul 28 19:42:05.607892 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:05.607864    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"
Jul 28 19:42:05.719680 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:05.719650    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e074634e-0b9b-4211-9d3a-ac49689ad9bd-util\") pod \"e074634e-0b9b-4211-9d3a-ac49689ad9bd\" (UID: \"e074634e-0b9b-4211-9d3a-ac49689ad9bd\") "
Jul 28 19:42:05.719848 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:05.719774    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgmpf\" (UniqueName: \"kubernetes.io/projected/e074634e-0b9b-4211-9d3a-ac49689ad9bd-kube-api-access-zgmpf\") pod \"e074634e-0b9b-4211-9d3a-ac49689ad9bd\" (UID: \"e074634e-0b9b-4211-9d3a-ac49689ad9bd\") "
Jul 28 19:42:05.719848 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:05.719803    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e074634e-0b9b-4211-9d3a-ac49689ad9bd-bundle\") pod \"e074634e-0b9b-4211-9d3a-ac49689ad9bd\" (UID: \"e074634e-0b9b-4211-9d3a-ac49689ad9bd\") "
Jul 28 19:42:05.720323 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:05.720295    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e074634e-0b9b-4211-9d3a-ac49689ad9bd-bundle" (OuterVolumeSpecName: "bundle") pod "e074634e-0b9b-4211-9d3a-ac49689ad9bd" (UID: "e074634e-0b9b-4211-9d3a-ac49689ad9bd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:42:05.721906 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:05.721878    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e074634e-0b9b-4211-9d3a-ac49689ad9bd-kube-api-access-zgmpf" (OuterVolumeSpecName: "kube-api-access-zgmpf") pod "e074634e-0b9b-4211-9d3a-ac49689ad9bd" (UID: "e074634e-0b9b-4211-9d3a-ac49689ad9bd"). InnerVolumeSpecName "kube-api-access-zgmpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:42:05.725224 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:05.725197    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e074634e-0b9b-4211-9d3a-ac49689ad9bd-util" (OuterVolumeSpecName: "util") pod "e074634e-0b9b-4211-9d3a-ac49689ad9bd" (UID: "e074634e-0b9b-4211-9d3a-ac49689ad9bd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:42:05.821153 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:05.821125    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgmpf\" (UniqueName: \"kubernetes.io/projected/e074634e-0b9b-4211-9d3a-ac49689ad9bd-kube-api-access-zgmpf\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:05.821153 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:05.821149    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e074634e-0b9b-4211-9d3a-ac49689ad9bd-bundle\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:05.821153 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:05.821158    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e074634e-0b9b-4211-9d3a-ac49689ad9bd-util\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:05.898094 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:05.898051    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f576bd69-fxttf"]
Jul 28 19:42:06.482701 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:06.482671    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5"
Jul 28 19:42:06.483052 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:06.482669    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5" event={"ID":"e074634e-0b9b-4211-9d3a-ac49689ad9bd","Type":"ContainerDied","Data":"9ce47952a1baf24f1803d9e0ad096e374cddf1d377f279067d567f1898aa9501"}
Jul 28 19:42:06.483052 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:06.482786    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ce47952a1baf24f1803d9e0ad096e374cddf1d377f279067d567f1898aa9501"
Jul 28 19:42:30.916708 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:30.916648    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65f576bd69-fxttf" podUID="292a37d0-f519-4fc0-bc6a-03b84bfcd2e3" containerName="console" containerID="cri-o://3e989b718b449dfe5b2175efbce9c3792ad5fde75c2252da61b5078276a22c0f" gracePeriod=15
Jul 28 19:42:31.171181 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.171127    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:42:31.235956 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.235918    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-serving-cert\") pod \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") "
Jul 28 19:42:31.235956 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.235958    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-service-ca\") pod \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") "
Jul 28 19:42:31.236189 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.235988    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jltqp\" (UniqueName: \"kubernetes.io/projected/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-kube-api-access-jltqp\") pod \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") "
Jul 28 19:42:31.236189 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.236035    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-oauth-config\") pod \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") "
Jul 28 19:42:31.236189 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.236079    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-config\") pod \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") "
Jul 28 19:42:31.236189 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.236123    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-trusted-ca-bundle\") pod \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") "
Jul 28 19:42:31.236189 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.236161    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-oauth-serving-cert\") pod \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\" (UID: \"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3\") "
Jul 28 19:42:31.236453 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.236424    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-service-ca" (OuterVolumeSpecName: "service-ca") pod "292a37d0-f519-4fc0-bc6a-03b84bfcd2e3" (UID: "292a37d0-f519-4fc0-bc6a-03b84bfcd2e3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:42:31.236528 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.236494    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "292a37d0-f519-4fc0-bc6a-03b84bfcd2e3" (UID: "292a37d0-f519-4fc0-bc6a-03b84bfcd2e3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:42:31.236692 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.236660    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-config" (OuterVolumeSpecName: "console-config") pod "292a37d0-f519-4fc0-bc6a-03b84bfcd2e3" (UID: "292a37d0-f519-4fc0-bc6a-03b84bfcd2e3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:42:31.236782 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.236761    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "292a37d0-f519-4fc0-bc6a-03b84bfcd2e3" (UID: "292a37d0-f519-4fc0-bc6a-03b84bfcd2e3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 19:42:31.238230 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.238204    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-kube-api-access-jltqp" (OuterVolumeSpecName: "kube-api-access-jltqp") pod "292a37d0-f519-4fc0-bc6a-03b84bfcd2e3" (UID: "292a37d0-f519-4fc0-bc6a-03b84bfcd2e3"). InnerVolumeSpecName "kube-api-access-jltqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:42:31.238336 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.238225    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "292a37d0-f519-4fc0-bc6a-03b84bfcd2e3" (UID: "292a37d0-f519-4fc0-bc6a-03b84bfcd2e3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:42:31.238336 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.238275    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "292a37d0-f519-4fc0-bc6a-03b84bfcd2e3" (UID: "292a37d0-f519-4fc0-bc6a-03b84bfcd2e3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:42:31.337194 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.337139    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-oauth-config\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:31.337194 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.337188    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-config\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:31.337194 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.337200    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-trusted-ca-bundle\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:31.337194 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.337211    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-oauth-serving-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:31.337464 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.337223    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-console-serving-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:31.337464 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.337234    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-service-ca\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:31.337464 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.337246    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jltqp\" (UniqueName: \"kubernetes.io/projected/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3-kube-api-access-jltqp\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:42:31.604934 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.604895    2563 generic.go:356] "Generic (PLEG): container finished" podID="292a37d0-f519-4fc0-bc6a-03b84bfcd2e3" containerID="3e989b718b449dfe5b2175efbce9c3792ad5fde75c2252da61b5078276a22c0f" exitCode=0
Jul 28 19:42:31.604934 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.604938    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f576bd69-fxttf"
Jul 28 19:42:31.605126 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.604977    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f576bd69-fxttf" event={"ID":"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3","Type":"ContainerDied","Data":"3e989b718b449dfe5b2175efbce9c3792ad5fde75c2252da61b5078276a22c0f"}
Jul 28 19:42:31.605126 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.605023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f576bd69-fxttf" event={"ID":"292a37d0-f519-4fc0-bc6a-03b84bfcd2e3","Type":"ContainerDied","Data":"c8578dd2b507259ed4850a50e031ec3bba5e955e06b67e5b7b6058a5d032d1f6"}
Jul 28 19:42:31.605126 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.605043    2563 scope.go:117] "RemoveContainer" containerID="3e989b718b449dfe5b2175efbce9c3792ad5fde75c2252da61b5078276a22c0f"
Jul 28 19:42:31.619964 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.619939    2563 scope.go:117] "RemoveContainer" containerID="3e989b718b449dfe5b2175efbce9c3792ad5fde75c2252da61b5078276a22c0f"
Jul 28 19:42:31.620262 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:42:31.620242    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e989b718b449dfe5b2175efbce9c3792ad5fde75c2252da61b5078276a22c0f\": container with ID starting with 3e989b718b449dfe5b2175efbce9c3792ad5fde75c2252da61b5078276a22c0f not found: ID does not exist" containerID="3e989b718b449dfe5b2175efbce9c3792ad5fde75c2252da61b5078276a22c0f"
Jul 28 19:42:31.620310 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.620269    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e989b718b449dfe5b2175efbce9c3792ad5fde75c2252da61b5078276a22c0f"} err="failed to get container status \"3e989b718b449dfe5b2175efbce9c3792ad5fde75c2252da61b5078276a22c0f\": rpc error: code = NotFound desc = could not find container \"3e989b718b449dfe5b2175efbce9c3792ad5fde75c2252da61b5078276a22c0f\": container with ID starting with 3e989b718b449dfe5b2175efbce9c3792ad5fde75c2252da61b5078276a22c0f not found: ID does not exist"
Jul 28 19:42:31.634815 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.634783    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f576bd69-fxttf"]
Jul 28 19:42:31.638758 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:31.638725    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65f576bd69-fxttf"]
Jul 28 19:42:33.603410 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:42:33.603379    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="292a37d0-f519-4fc0-bc6a-03b84bfcd2e3" path="/var/lib/kubelet/pods/292a37d0-f519-4fc0-bc6a-03b84bfcd2e3/volumes"
Jul 28 19:43:32.311230 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311197    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311520    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f82d7c-c1eb-4de0-8c61-c95471ac75f8" containerName="pull"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311531    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f82d7c-c1eb-4de0-8c61-c95471ac75f8" containerName="pull"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311554    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f82d7c-c1eb-4de0-8c61-c95471ac75f8" containerName="util"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311560    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f82d7c-c1eb-4de0-8c61-c95471ac75f8" containerName="util"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311568    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be42563-d715-459a-812e-91f094ad118c" containerName="pull"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311573    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be42563-d715-459a-812e-91f094ad118c" containerName="pull"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311579    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e074634e-0b9b-4211-9d3a-ac49689ad9bd" containerName="extract"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311584    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e074634e-0b9b-4211-9d3a-ac49689ad9bd" containerName="extract"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311595    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e64078b8-7322-4064-bc3d-775078f29364" containerName="util"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311600    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e64078b8-7322-4064-bc3d-775078f29364" containerName="util"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311608    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f82d7c-c1eb-4de0-8c61-c95471ac75f8" containerName="extract"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311613    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f82d7c-c1eb-4de0-8c61-c95471ac75f8" containerName="extract"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311624    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="292a37d0-f519-4fc0-bc6a-03b84bfcd2e3" containerName="console"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311628    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="292a37d0-f519-4fc0-bc6a-03b84bfcd2e3" containerName="console"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311634    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be42563-d715-459a-812e-91f094ad118c" containerName="util"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311640    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be42563-d715-459a-812e-91f094ad118c" containerName="util"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311647    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e64078b8-7322-4064-bc3d-775078f29364" containerName="pull"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311652    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e64078b8-7322-4064-bc3d-775078f29364" containerName="pull"
Jul 28 19:43:32.311650 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311658    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e074634e-0b9b-4211-9d3a-ac49689ad9bd" containerName="util"
Jul 28 19:43:32.312184 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311664    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e074634e-0b9b-4211-9d3a-ac49689ad9bd" containerName="util"
Jul 28 19:43:32.312184 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311674    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be42563-d715-459a-812e-91f094ad118c" containerName="extract"
Jul 28 19:43:32.312184 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311680    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be42563-d715-459a-812e-91f094ad118c" containerName="extract"
Jul 28 19:43:32.312184 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311686    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e64078b8-7322-4064-bc3d-775078f29364" containerName="extract"
Jul 28 19:43:32.312184 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311690    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e64078b8-7322-4064-bc3d-775078f29364" containerName="extract"
Jul 28 19:43:32.312184 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311696    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e074634e-0b9b-4211-9d3a-ac49689ad9bd" containerName="pull"
Jul 28 19:43:32.312184 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311701    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e074634e-0b9b-4211-9d3a-ac49689ad9bd" containerName="pull"
Jul 28 19:43:32.312184 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311745    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4f82d7c-c1eb-4de0-8c61-c95471ac75f8" containerName="extract"
Jul 28 19:43:32.312184 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311751    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8be42563-d715-459a-812e-91f094ad118c" containerName="extract"
Jul 28 19:43:32.312184 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311760    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e074634e-0b9b-4211-9d3a-ac49689ad9bd" containerName="extract"
Jul 28 19:43:32.312184 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311766    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e64078b8-7322-4064-bc3d-775078f29364" containerName="extract"
Jul 28 19:43:32.312184 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.311772    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="292a37d0-f519-4fc0-bc6a-03b84bfcd2e3" containerName="console"
Jul 28 19:43:32.314603 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.314586    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"
Jul 28 19:43:32.317100 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.317072    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 19:43:32.317214 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.317165    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 28 19:43:32.318066 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.318045    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6gsrx\""
Jul 28 19:43:32.318158 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.318070    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 19:43:32.323031 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.323007    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:43:32.350470 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.350442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4b9c4817-5e7c-471a-b168-705fcc074712-config-file\") pod \"limitador-limitador-54d6d988d5-gkzgr\" (UID: \"4b9c4817-5e7c-471a-b168-705fcc074712\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"
Jul 28 19:43:32.350615 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.350474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhscr\" (UniqueName: \"kubernetes.io/projected/4b9c4817-5e7c-471a-b168-705fcc074712-kube-api-access-jhscr\") pod \"limitador-limitador-54d6d988d5-gkzgr\" (UID: \"4b9c4817-5e7c-471a-b168-705fcc074712\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"
Jul 28 19:43:32.353838 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.353816    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:43:32.451611 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.451571    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4b9c4817-5e7c-471a-b168-705fcc074712-config-file\") pod \"limitador-limitador-54d6d988d5-gkzgr\" (UID: \"4b9c4817-5e7c-471a-b168-705fcc074712\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"
Jul 28 19:43:32.451611 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.451612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhscr\" (UniqueName: \"kubernetes.io/projected/4b9c4817-5e7c-471a-b168-705fcc074712-kube-api-access-jhscr\") pod \"limitador-limitador-54d6d988d5-gkzgr\" (UID: \"4b9c4817-5e7c-471a-b168-705fcc074712\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"
Jul 28 19:43:32.452170 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.452150    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4b9c4817-5e7c-471a-b168-705fcc074712-config-file\") pod \"limitador-limitador-54d6d988d5-gkzgr\" (UID: \"4b9c4817-5e7c-471a-b168-705fcc074712\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"
Jul 28 19:43:32.460183 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.460148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhscr\" (UniqueName: \"kubernetes.io/projected/4b9c4817-5e7c-471a-b168-705fcc074712-kube-api-access-jhscr\") pod \"limitador-limitador-54d6d988d5-gkzgr\" (UID: \"4b9c4817-5e7c-471a-b168-705fcc074712\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"
Jul 28 19:43:32.625469 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.625377    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"
Jul 28 19:43:32.758447 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.758425    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:43:32.759976 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:43:32.759943    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9c4817_5e7c_471a_b168_705fcc074712.slice/crio-8469a3bfd44f27267fe9cd8126758d38d9c0a58d24701a6f6a35323f15fa4478 WatchSource:0}: Error finding container 8469a3bfd44f27267fe9cd8126758d38d9c0a58d24701a6f6a35323f15fa4478: Status 404 returned error can't find the container with id 8469a3bfd44f27267fe9cd8126758d38d9c0a58d24701a6f6a35323f15fa4478
Jul 28 19:43:32.900204 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.900116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gkzgr" event={"ID":"4b9c4817-5e7c-471a-b168-705fcc074712","Type":"ContainerStarted","Data":"8469a3bfd44f27267fe9cd8126758d38d9c0a58d24701a6f6a35323f15fa4478"}
Jul 28 19:43:32.919487 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.919456    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-bxkrm"]
Jul 28 19:43:32.923164 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.923148    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bxkrm"
Jul 28 19:43:32.925534 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.925517    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-s7jjx\""
Jul 28 19:43:32.930079 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.930059    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bxkrm"]
Jul 28 19:43:32.956829 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:32.956804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsv6l\" (UniqueName: \"kubernetes.io/projected/14a4b38c-ac23-427d-8397-d488ce6ca792-kube-api-access-vsv6l\") pod \"authorino-75d556bd77-bxkrm\" (UID: \"14a4b38c-ac23-427d-8397-d488ce6ca792\") " pod="kuadrant-system/authorino-75d556bd77-bxkrm"
Jul 28 19:43:33.057622 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:33.057582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsv6l\" (UniqueName: \"kubernetes.io/projected/14a4b38c-ac23-427d-8397-d488ce6ca792-kube-api-access-vsv6l\") pod \"authorino-75d556bd77-bxkrm\" (UID: \"14a4b38c-ac23-427d-8397-d488ce6ca792\") " pod="kuadrant-system/authorino-75d556bd77-bxkrm"
Jul 28 19:43:33.068812 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:33.068779    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsv6l\" (UniqueName: \"kubernetes.io/projected/14a4b38c-ac23-427d-8397-d488ce6ca792-kube-api-access-vsv6l\") pod \"authorino-75d556bd77-bxkrm\" (UID: \"14a4b38c-ac23-427d-8397-d488ce6ca792\") " pod="kuadrant-system/authorino-75d556bd77-bxkrm"
Jul 28 19:43:33.232908 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:33.232824    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bxkrm"
Jul 28 19:43:33.398611 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:33.397716    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bxkrm"]
Jul 28 19:43:33.405707 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:43:33.405676    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14a4b38c_ac23_427d_8397_d488ce6ca792.slice/crio-0826f75271f547970abe3a604f7a60ed75c8856d017567e1bd2a57dfaccfa440 WatchSource:0}: Error finding container 0826f75271f547970abe3a604f7a60ed75c8856d017567e1bd2a57dfaccfa440: Status 404 returned error can't find the container with id 0826f75271f547970abe3a604f7a60ed75c8856d017567e1bd2a57dfaccfa440
Jul 28 19:43:33.908898 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:33.908859    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bxkrm" event={"ID":"14a4b38c-ac23-427d-8397-d488ce6ca792","Type":"ContainerStarted","Data":"0826f75271f547970abe3a604f7a60ed75c8856d017567e1bd2a57dfaccfa440"}
Jul 28 19:43:37.930687 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:37.930647    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bxkrm" event={"ID":"14a4b38c-ac23-427d-8397-d488ce6ca792","Type":"ContainerStarted","Data":"85f275845a17aeaf356983c2e8e59c96ecb30921a6c1fc0043cb97af4bf45fd7"}
Jul 28 19:43:37.932156 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:37.932129    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gkzgr" event={"ID":"4b9c4817-5e7c-471a-b168-705fcc074712","Type":"ContainerStarted","Data":"0d487eb18c6e2d178792f34b1f499c60831854efa29fd8b8ad54d7505163727a"}
Jul 28 19:43:37.932270 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:37.932218    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"
Jul 28 19:43:37.945589 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:37.945524    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-bxkrm" podStartSLOduration=2.243432854 podStartE2EDuration="5.94551022s" totalImagesPullingTime="3.702077366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:43:37.944536136 +0000 UTC m=+502.966831725" watchObservedRunningTime="2026-07-28 19:43:37.94551022 +0000 UTC m=+502.967805829"
Jul 28 19:43:37.962002 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:37.961948    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-gkzgr" podStartSLOduration=1.618438121 podStartE2EDuration="5.961927842s" totalImagesPullingTime="4.343489721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:43:37.96013151 +0000 UTC m=+502.982427099" watchObservedRunningTime="2026-07-28 19:43:37.961927842 +0000 UTC m=+502.984223431"
Jul 28 19:43:48.938687 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:43:48.938656    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"
Jul 28 19:44:06.587316 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:06.587282    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kwz5z"]
Jul 28 19:44:06.590789 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:06.590772    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kwz5z"
Jul 28 19:44:06.597785 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:06.597321    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kwz5z"]
Jul 28 19:44:06.750710 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:06.750631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwmhg\" (UniqueName: \"kubernetes.io/projected/73576ec2-1035-4e61-877c-fd25ffa3848b-kube-api-access-wwmhg\") pod \"authorino-5d4b67c446-kwz5z\" (UID: \"73576ec2-1035-4e61-877c-fd25ffa3848b\") " pod="kuadrant-system/authorino-5d4b67c446-kwz5z"
Jul 28 19:44:06.850130 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:06.850054    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kwz5z"]
Jul 28 19:44:06.850319 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:44:06.850300    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wwmhg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-kwz5z" podUID="73576ec2-1035-4e61-877c-fd25ffa3848b"
Jul 28 19:44:06.851205 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:06.851182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwmhg\" (UniqueName: \"kubernetes.io/projected/73576ec2-1035-4e61-877c-fd25ffa3848b-kube-api-access-wwmhg\") pod \"authorino-5d4b67c446-kwz5z\" (UID: \"73576ec2-1035-4e61-877c-fd25ffa3848b\") " pod="kuadrant-system/authorino-5d4b67c446-kwz5z"
Jul 28 19:44:06.865079 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:06.865056    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwmhg\" (UniqueName: \"kubernetes.io/projected/73576ec2-1035-4e61-877c-fd25ffa3848b-kube-api-access-wwmhg\") pod \"authorino-5d4b67c446-kwz5z\" (UID: \"73576ec2-1035-4e61-877c-fd25ffa3848b\") " pod="kuadrant-system/authorino-5d4b67c446-kwz5z"
Jul 28 19:44:07.072776 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:07.072748    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kwz5z"
Jul 28 19:44:07.097688 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:07.097662    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kwz5z"
Jul 28 19:44:07.256043 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:07.256011    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwmhg\" (UniqueName: \"kubernetes.io/projected/73576ec2-1035-4e61-877c-fd25ffa3848b-kube-api-access-wwmhg\") pod \"73576ec2-1035-4e61-877c-fd25ffa3848b\" (UID: \"73576ec2-1035-4e61-877c-fd25ffa3848b\") "
Jul 28 19:44:07.258136 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:07.258110    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73576ec2-1035-4e61-877c-fd25ffa3848b-kube-api-access-wwmhg" (OuterVolumeSpecName: "kube-api-access-wwmhg") pod "73576ec2-1035-4e61-877c-fd25ffa3848b" (UID: "73576ec2-1035-4e61-877c-fd25ffa3848b"). InnerVolumeSpecName "kube-api-access-wwmhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:44:07.357260 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:07.357224    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwmhg\" (UniqueName: \"kubernetes.io/projected/73576ec2-1035-4e61-877c-fd25ffa3848b-kube-api-access-wwmhg\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:44:08.077818 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:08.077789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kwz5z"
Jul 28 19:44:08.110417 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:08.110389    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kwz5z"]
Jul 28 19:44:08.113437 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:08.113413    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kwz5z"]
Jul 28 19:44:09.063722 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:09.063691    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bxkrm"]
Jul 28 19:44:09.063888 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:09.063854    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-bxkrm" podUID="14a4b38c-ac23-427d-8397-d488ce6ca792" containerName="authorino" containerID="cri-o://85f275845a17aeaf356983c2e8e59c96ecb30921a6c1fc0043cb97af4bf45fd7" gracePeriod=30
Jul 28 19:44:09.332728 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:09.332659    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bxkrm"
Jul 28 19:44:09.475220 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:09.475188    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsv6l\" (UniqueName: \"kubernetes.io/projected/14a4b38c-ac23-427d-8397-d488ce6ca792-kube-api-access-vsv6l\") pod \"14a4b38c-ac23-427d-8397-d488ce6ca792\" (UID: \"14a4b38c-ac23-427d-8397-d488ce6ca792\") "
Jul 28 19:44:09.477204 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:09.477166    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14a4b38c-ac23-427d-8397-d488ce6ca792-kube-api-access-vsv6l" (OuterVolumeSpecName: "kube-api-access-vsv6l") pod "14a4b38c-ac23-427d-8397-d488ce6ca792" (UID: "14a4b38c-ac23-427d-8397-d488ce6ca792"). InnerVolumeSpecName "kube-api-access-vsv6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:44:09.575810 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:09.575777    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsv6l\" (UniqueName: \"kubernetes.io/projected/14a4b38c-ac23-427d-8397-d488ce6ca792-kube-api-access-vsv6l\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:44:09.603858 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:09.603794    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73576ec2-1035-4e61-877c-fd25ffa3848b" path="/var/lib/kubelet/pods/73576ec2-1035-4e61-877c-fd25ffa3848b/volumes"
Jul 28 19:44:10.089452 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:10.089421    2563 generic.go:356] "Generic (PLEG): container finished" podID="14a4b38c-ac23-427d-8397-d488ce6ca792" containerID="85f275845a17aeaf356983c2e8e59c96ecb30921a6c1fc0043cb97af4bf45fd7" exitCode=0
Jul 28 19:44:10.089644 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:10.089464    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bxkrm"
Jul 28 19:44:10.089644 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:10.089487    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bxkrm" event={"ID":"14a4b38c-ac23-427d-8397-d488ce6ca792","Type":"ContainerDied","Data":"85f275845a17aeaf356983c2e8e59c96ecb30921a6c1fc0043cb97af4bf45fd7"}
Jul 28 19:44:10.089644 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:10.089530    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bxkrm" event={"ID":"14a4b38c-ac23-427d-8397-d488ce6ca792","Type":"ContainerDied","Data":"0826f75271f547970abe3a604f7a60ed75c8856d017567e1bd2a57dfaccfa440"}
Jul 28 19:44:10.089644 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:10.089567    2563 scope.go:117] "RemoveContainer" containerID="85f275845a17aeaf356983c2e8e59c96ecb30921a6c1fc0043cb97af4bf45fd7"
Jul 28 19:44:10.102445 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:10.102328    2563 scope.go:117] "RemoveContainer" containerID="85f275845a17aeaf356983c2e8e59c96ecb30921a6c1fc0043cb97af4bf45fd7"
Jul 28 19:44:10.102976 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:44:10.102945    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85f275845a17aeaf356983c2e8e59c96ecb30921a6c1fc0043cb97af4bf45fd7\": container with ID starting with 85f275845a17aeaf356983c2e8e59c96ecb30921a6c1fc0043cb97af4bf45fd7 not found: ID does not exist" containerID="85f275845a17aeaf356983c2e8e59c96ecb30921a6c1fc0043cb97af4bf45fd7"
Jul 28 19:44:10.103078 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:10.102982    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85f275845a17aeaf356983c2e8e59c96ecb30921a6c1fc0043cb97af4bf45fd7"} err="failed to get container status \"85f275845a17aeaf356983c2e8e59c96ecb30921a6c1fc0043cb97af4bf45fd7\": rpc error: code = NotFound desc = could not find container \"85f275845a17aeaf356983c2e8e59c96ecb30921a6c1fc0043cb97af4bf45fd7\": container with ID starting with 85f275845a17aeaf356983c2e8e59c96ecb30921a6c1fc0043cb97af4bf45fd7 not found: ID does not exist"
Jul 28 19:44:10.108927 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:10.108908    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bxkrm"]
Jul 28 19:44:10.110706 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:10.110687    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bxkrm"]
Jul 28 19:44:11.604268 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:11.604224    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14a4b38c-ac23-427d-8397-d488ce6ca792" path="/var/lib/kubelet/pods/14a4b38c-ac23-427d-8397-d488ce6ca792/volumes"
Jul 28 19:44:52.381568 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:44:52.380893    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:45:12.648136 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:45:12.648099    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:45:18.049623 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:45:18.049585    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:45:43.943067 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:45:43.942986    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:45:51.148658 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:45:51.148621    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:46:13.443789 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:46:13.443755    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:46:28.851467 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:46:28.851432    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:47:02.678665 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:02.678631    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cb69565bc-9j98r"]
Jul 28 19:47:02.679115 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:02.678983    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14a4b38c-ac23-427d-8397-d488ce6ca792" containerName="authorino"
Jul 28 19:47:02.679115 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:02.678997    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="14a4b38c-ac23-427d-8397-d488ce6ca792" containerName="authorino"
Jul 28 19:47:02.679115 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:02.679050    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="14a4b38c-ac23-427d-8397-d488ce6ca792" containerName="authorino"
Jul 28 19:47:02.680995 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:02.680980    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cb69565bc-9j98r"
Jul 28 19:47:02.684346 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:02.684326    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-s7jjx\""
Jul 28 19:47:02.684463 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:02.684347    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 28 19:47:02.690703 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:02.690683    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cb69565bc-9j98r"]
Jul 28 19:47:02.717591 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:02.717562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/770e2f94-66a5-4b95-82bb-86a289a90d57-tls-cert\") pod \"authorino-cb69565bc-9j98r\" (UID: \"770e2f94-66a5-4b95-82bb-86a289a90d57\") " pod="kuadrant-system/authorino-cb69565bc-9j98r"
Jul 28 19:47:02.717731 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:02.717604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ztpr\" (UniqueName: \"kubernetes.io/projected/770e2f94-66a5-4b95-82bb-86a289a90d57-kube-api-access-2ztpr\") pod \"authorino-cb69565bc-9j98r\" (UID: \"770e2f94-66a5-4b95-82bb-86a289a90d57\") " pod="kuadrant-system/authorino-cb69565bc-9j98r"
Jul 28 19:47:02.818475 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:02.818426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ztpr\" (UniqueName: \"kubernetes.io/projected/770e2f94-66a5-4b95-82bb-86a289a90d57-kube-api-access-2ztpr\") pod \"authorino-cb69565bc-9j98r\" (UID: \"770e2f94-66a5-4b95-82bb-86a289a90d57\") " pod="kuadrant-system/authorino-cb69565bc-9j98r"
Jul 28 19:47:02.818672 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:02.818570    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/770e2f94-66a5-4b95-82bb-86a289a90d57-tls-cert\") pod \"authorino-cb69565bc-9j98r\" (UID: \"770e2f94-66a5-4b95-82bb-86a289a90d57\") " pod="kuadrant-system/authorino-cb69565bc-9j98r"
Jul 28 19:47:02.820839 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:02.820816    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/770e2f94-66a5-4b95-82bb-86a289a90d57-tls-cert\") pod \"authorino-cb69565bc-9j98r\" (UID: \"770e2f94-66a5-4b95-82bb-86a289a90d57\") " pod="kuadrant-system/authorino-cb69565bc-9j98r"
Jul 28 19:47:02.826531 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:02.826509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ztpr\" (UniqueName: \"kubernetes.io/projected/770e2f94-66a5-4b95-82bb-86a289a90d57-kube-api-access-2ztpr\") pod \"authorino-cb69565bc-9j98r\" (UID: \"770e2f94-66a5-4b95-82bb-86a289a90d57\") " pod="kuadrant-system/authorino-cb69565bc-9j98r"
Jul 28 19:47:02.990111 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:02.990035    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cb69565bc-9j98r"
Jul 28 19:47:03.122813 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:03.122789    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cb69565bc-9j98r"]
Jul 28 19:47:03.124659 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:47:03.124635    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod770e2f94_66a5_4b95_82bb_86a289a90d57.slice/crio-7602e36a3d948ca9eb7eaac28981709b301f09335a66e3c51991eb3ac06a5af5 WatchSource:0}: Error finding container 7602e36a3d948ca9eb7eaac28981709b301f09335a66e3c51991eb3ac06a5af5: Status 404 returned error can't find the container with id 7602e36a3d948ca9eb7eaac28981709b301f09335a66e3c51991eb3ac06a5af5
Jul 28 19:47:03.125961 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:03.125942    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 19:47:03.923841 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:03.923812    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cb69565bc-9j98r" event={"ID":"770e2f94-66a5-4b95-82bb-86a289a90d57","Type":"ContainerStarted","Data":"7602e36a3d948ca9eb7eaac28981709b301f09335a66e3c51991eb3ac06a5af5"}
Jul 28 19:47:04.931529 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:04.931490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cb69565bc-9j98r" event={"ID":"770e2f94-66a5-4b95-82bb-86a289a90d57","Type":"ContainerStarted","Data":"d7a3cedc11beedbef5bc93bb68083a056afe79dce84a2504b6110140d46731ba"}
Jul 28 19:47:04.948700 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:04.948650    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-cb69565bc-9j98r" podStartSLOduration=2.192434895 podStartE2EDuration="2.948633301s" totalImagesPullingTime="756.198406ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:47:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:47:04.947477115 +0000 UTC m=+709.969772704" watchObservedRunningTime="2026-07-28 19:47:04.948633301 +0000 UTC m=+709.970928913"
Jul 28 19:47:33.756328 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:33.756284    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:47:43.645643 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:43.645609    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:47:54.150175 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:47:54.150137    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:49:36.845799 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:49:36.845762    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:50:22.547156 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:50:22.547121    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:50:32.050912 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:50:32.050879    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:50:40.752075 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:50:40.752039    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:50:49.659385 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:50:49.659352    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:51:00.456780 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:51:00.456742    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:51:10.062407 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:51:10.062371    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:51:21.660756 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:51:21.660725    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:51:32.153605 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:51:32.151517    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:51:53.748039 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:51:53.748000    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:52:06.848733 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:52:06.848696    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:52:30.347158 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:52:30.347124    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:52:40.657727 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:52:40.657689    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:52:50.996277 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:52:50.996244    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:53:08.854881 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:53:08.854786    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:53:18.254460 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:53:18.254427    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:53:29.245154 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:53:29.245113    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:53:38.646772 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:53:38.646739    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:53:48.045511 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:53:48.045475    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:55:36.780785 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:55:36.780748    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:55:48.518341 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:55:48.518307    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:56:01.724842 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:56:01.724806    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:56:17.930872 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:56:17.930796    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:56:29.830090 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:56:29.830057    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:56:38.836392 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:56:38.836358    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:56:50.226383 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:56:50.226350    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:56:59.719361 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:56:59.719326    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:57:10.435030 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:57:10.434983    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:57:20.221438 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:57:20.221402    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:57:31.632713 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:57:31.632681    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:57:39.429729 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:57:39.429638    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:57:57.827710 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:57:57.827678    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:58:07.727101 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:07.727067    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:58:21.627476 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:21.627446    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:58:27.753409 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.753376    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"]
Jul 28 19:58:27.756643 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.756623    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.759125 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.759104    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 19:58:27.760047 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.760035    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 19:58:27.760112 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.760077    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-5d56be1d-kserve-self-signed-certs\""
Jul 28 19:58:27.760112 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.760086    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jpg4f\""
Jul 28 19:58:27.767205 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.767180    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"]
Jul 28 19:58:27.863333 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.863306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f490735-8e1a-472d-84a7-0740bc46cc9e-tls-certs\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.863501 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.863360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-home\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.863501 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.863391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-model-cache\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.863501 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.863413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-tmp-dir\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.863501 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.863434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2csd6\" (UniqueName: \"kubernetes.io/projected/0f490735-8e1a-472d-84a7-0740bc46cc9e-kube-api-access-2csd6\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.863657 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.863530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-dshm\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.964295 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.964261    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-tmp-dir\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.964458 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.964301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2csd6\" (UniqueName: \"kubernetes.io/projected/0f490735-8e1a-472d-84a7-0740bc46cc9e-kube-api-access-2csd6\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.964458 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.964346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-dshm\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.964458 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.964371    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f490735-8e1a-472d-84a7-0740bc46cc9e-tls-certs\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.964458 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.964448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-home\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.964648 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.964479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-model-cache\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.964717 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.964696    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-tmp-dir\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.964842 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.964823    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-home\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.964902 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.964851    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-model-cache\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.966730 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.966701    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-dshm\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.966977 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.966960    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f490735-8e1a-472d-84a7-0740bc46cc9e-tls-certs\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:27.971915 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:27.971893    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2csd6\" (UniqueName: \"kubernetes.io/projected/0f490735-8e1a-472d-84a7-0740bc46cc9e-kube-api-access-2csd6\") pod \"e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") " pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:28.065673 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:28.065602    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:28.197413 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:28.197392    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"]
Jul 28 19:58:28.199183 ip-10-0-128-52 kubenswrapper[2563]: W0728 19:58:28.199158    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f490735_8e1a_472d_84a7_0740bc46cc9e.slice/crio-edf14539bdd5c8d65f3642d4772bd7b8de699267d0a7eb2a0adbd9c5db36b06e WatchSource:0}: Error finding container edf14539bdd5c8d65f3642d4772bd7b8de699267d0a7eb2a0adbd9c5db36b06e: Status 404 returned error can't find the container with id edf14539bdd5c8d65f3642d4772bd7b8de699267d0a7eb2a0adbd9c5db36b06e
Jul 28 19:58:28.201098 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:28.201079    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 19:58:28.298243 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:28.298213    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b" event={"ID":"0f490735-8e1a-472d-84a7-0740bc46cc9e","Type":"ContainerStarted","Data":"edf14539bdd5c8d65f3642d4772bd7b8de699267d0a7eb2a0adbd9c5db36b06e"}
Jul 28 19:58:29.305272 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:29.305241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b" event={"ID":"0f490735-8e1a-472d-84a7-0740bc46cc9e","Type":"ContainerStarted","Data":"eb16bbb4458321e7ada91c582788c0f83804d0530d03526c72acfeb433442ec2"}
Jul 28 19:58:29.322534 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:29.322486    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b" podStartSLOduration=1.336119482 podStartE2EDuration="2.322472135s" totalImagesPullingTime="986.352653ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 19:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 19:58:29.321252266 +0000 UTC m=+1394.343547854" watchObservedRunningTime="2026-07-28 19:58:29.322472135 +0000 UTC m=+1394.344767701"
Jul 28 19:58:33.024954 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:33.024915    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:58:38.066457 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:38.066424    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:38.066883 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:38.066472    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:38.079121 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:38.079101    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:38.361061 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:38.360995    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:58:52.071606 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:52.071574    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"]
Jul 28 19:58:54.929903 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:58:54.929872    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:59:07.090775 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.090660    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b" podUID="0f490735-8e1a-472d-84a7-0740bc46cc9e" containerName="main" containerID="cri-o://eb16bbb4458321e7ada91c582788c0f83804d0530d03526c72acfeb433442ec2" gracePeriod=45
Jul 28 19:59:07.327211 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.327188    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:59:07.495189 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.495103    2563 generic.go:356] "Generic (PLEG): container finished" podID="0f490735-8e1a-472d-84a7-0740bc46cc9e" containerID="eb16bbb4458321e7ada91c582788c0f83804d0530d03526c72acfeb433442ec2" exitCode=0
Jul 28 19:59:07.495189 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.495142    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"
Jul 28 19:59:07.495385 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.495188    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b" event={"ID":"0f490735-8e1a-472d-84a7-0740bc46cc9e","Type":"ContainerDied","Data":"eb16bbb4458321e7ada91c582788c0f83804d0530d03526c72acfeb433442ec2"}
Jul 28 19:59:07.495385 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.495227    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b" event={"ID":"0f490735-8e1a-472d-84a7-0740bc46cc9e","Type":"ContainerDied","Data":"edf14539bdd5c8d65f3642d4772bd7b8de699267d0a7eb2a0adbd9c5db36b06e"}
Jul 28 19:59:07.495385 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.495245    2563 scope.go:117] "RemoveContainer" containerID="eb16bbb4458321e7ada91c582788c0f83804d0530d03526c72acfeb433442ec2"
Jul 28 19:59:07.503502 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.503491    2563 scope.go:117] "RemoveContainer" containerID="eb16bbb4458321e7ada91c582788c0f83804d0530d03526c72acfeb433442ec2"
Jul 28 19:59:07.503776 ip-10-0-128-52 kubenswrapper[2563]: E0728 19:59:07.503758    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb16bbb4458321e7ada91c582788c0f83804d0530d03526c72acfeb433442ec2\": container with ID starting with eb16bbb4458321e7ada91c582788c0f83804d0530d03526c72acfeb433442ec2 not found: ID does not exist" containerID="eb16bbb4458321e7ada91c582788c0f83804d0530d03526c72acfeb433442ec2"
Jul 28 19:59:07.503832 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.503784    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb16bbb4458321e7ada91c582788c0f83804d0530d03526c72acfeb433442ec2"} err="failed to get container status \"eb16bbb4458321e7ada91c582788c0f83804d0530d03526c72acfeb433442ec2\": rpc error: code = NotFound desc = could not find container \"eb16bbb4458321e7ada91c582788c0f83804d0530d03526c72acfeb433442ec2\": container with ID starting with eb16bbb4458321e7ada91c582788c0f83804d0530d03526c72acfeb433442ec2 not found: ID does not exist"
Jul 28 19:59:07.510042 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.510026    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2csd6\" (UniqueName: \"kubernetes.io/projected/0f490735-8e1a-472d-84a7-0740bc46cc9e-kube-api-access-2csd6\") pod \"0f490735-8e1a-472d-84a7-0740bc46cc9e\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") "
Jul 28 19:59:07.510102 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.510078    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-tmp-dir\") pod \"0f490735-8e1a-472d-84a7-0740bc46cc9e\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") "
Jul 28 19:59:07.510151 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.510109    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f490735-8e1a-472d-84a7-0740bc46cc9e-tls-certs\") pod \"0f490735-8e1a-472d-84a7-0740bc46cc9e\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") "
Jul 28 19:59:07.510151 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.510131    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-home\") pod \"0f490735-8e1a-472d-84a7-0740bc46cc9e\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") "
Jul 28 19:59:07.510151 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.510147    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-dshm\") pod \"0f490735-8e1a-472d-84a7-0740bc46cc9e\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") "
Jul 28 19:59:07.510306 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.510179    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-model-cache\") pod \"0f490735-8e1a-472d-84a7-0740bc46cc9e\" (UID: \"0f490735-8e1a-472d-84a7-0740bc46cc9e\") "
Jul 28 19:59:07.510415 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.510393    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0f490735-8e1a-472d-84a7-0740bc46cc9e" (UID: "0f490735-8e1a-472d-84a7-0740bc46cc9e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:59:07.510505 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.510441    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-home" (OuterVolumeSpecName: "home") pod "0f490735-8e1a-472d-84a7-0740bc46cc9e" (UID: "0f490735-8e1a-472d-84a7-0740bc46cc9e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:59:07.510579 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.510524    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-model-cache" (OuterVolumeSpecName: "model-cache") pod "0f490735-8e1a-472d-84a7-0740bc46cc9e" (UID: "0f490735-8e1a-472d-84a7-0740bc46cc9e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:59:07.512120 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.512099    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-dshm" (OuterVolumeSpecName: "dshm") pod "0f490735-8e1a-472d-84a7-0740bc46cc9e" (UID: "0f490735-8e1a-472d-84a7-0740bc46cc9e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 19:59:07.512195 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.512114    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f490735-8e1a-472d-84a7-0740bc46cc9e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0f490735-8e1a-472d-84a7-0740bc46cc9e" (UID: "0f490735-8e1a-472d-84a7-0740bc46cc9e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 19:59:07.512195 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.512103    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f490735-8e1a-472d-84a7-0740bc46cc9e-kube-api-access-2csd6" (OuterVolumeSpecName: "kube-api-access-2csd6") pod "0f490735-8e1a-472d-84a7-0740bc46cc9e" (UID: "0f490735-8e1a-472d-84a7-0740bc46cc9e"). InnerVolumeSpecName "kube-api-access-2csd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 19:59:07.610768 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.610741    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-tmp-dir\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:59:07.610768 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.610762    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f490735-8e1a-472d-84a7-0740bc46cc9e-tls-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:59:07.610768 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.610771    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-home\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:59:07.610960 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.610780    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-dshm\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:59:07.610960 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.610792    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f490735-8e1a-472d-84a7-0740bc46cc9e-model-cache\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:59:07.610960 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.610805    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2csd6\" (UniqueName: \"kubernetes.io/projected/0f490735-8e1a-472d-84a7-0740bc46cc9e-kube-api-access-2csd6\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 19:59:07.810618 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.810592    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"]
Jul 28 19:59:07.814592 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:07.814570    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-5d56be1d-kserve-5b54fd5f55-d7j9b"]
Jul 28 19:59:08.526718 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:08.526686    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:59:09.602990 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:09.602960    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f490735-8e1a-472d-84a7-0740bc46cc9e" path="/var/lib/kubelet/pods/0f490735-8e1a-472d-84a7-0740bc46cc9e/volumes"
Jul 28 19:59:15.325378 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:15.325339    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:59:30.463856 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:30.463822    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:59:44.626435 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:44.626389    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:59:53.133281 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:53.133245    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 19:59:59.223491 ip-10-0-128-52 kubenswrapper[2563]: I0728 19:59:59.223448    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:00:08.930492 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:00:08.930459    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:00:19.019708 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:00:19.019669    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:00:32.329326 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:00:32.329289    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:00:41.720575 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:00:41.720477    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:00:51.290420 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:00:51.290386    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:01:03.823212 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:01:03.823165    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:01:13.320871 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:01:13.320834    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:01:19.924875 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:01:19.924833    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:01:37.318440 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:01:37.318407    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:01:49.432127 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:01:49.432089    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:01:58.328506 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:01:58.328472    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:02:09.122804 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:02:09.122723    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:02:17.418443 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:02:17.418406    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:02:27.925412 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:02:27.925378    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:02:40.332260 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:02:40.332225    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:02:56.427587 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:02:56.427553    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:03:21.127524 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.127494    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"]
Jul 28 20:03:21.127978 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.127831    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f490735-8e1a-472d-84a7-0740bc46cc9e" containerName="main"
Jul 28 20:03:21.127978 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.127844    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f490735-8e1a-472d-84a7-0740bc46cc9e" containerName="main"
Jul 28 20:03:21.127978 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.127910    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f490735-8e1a-472d-84a7-0740bc46cc9e" containerName="main"
Jul 28 20:03:21.130680 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.130664    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.133260 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.133241    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e98c78a1-gw-openshift-default-dockercfg-mwpqh\""
Jul 28 20:03:21.143145 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.143122    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"]
Jul 28 20:03:21.226210 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.226180    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istiod-ca-cert\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.226387 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.226218    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-data\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.226387 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.226238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-token\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.226387 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.226341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-workload-socket\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.226503 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.226385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-credential-socket\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.226503 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.226483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-workload-certs\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.226596 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.226509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-envoy\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.226596 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.226536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-podinfo\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.226660 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.226625    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9mp7\" (UniqueName: \"kubernetes.io/projected/c131514d-0f02-4ae1-8a8b-974ac3c4266e-kube-api-access-h9mp7\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.327841 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.327809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-workload-certs\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.327841 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.327842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-envoy\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.328093 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.327869    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-podinfo\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.328093 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.327893    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9mp7\" (UniqueName: \"kubernetes.io/projected/c131514d-0f02-4ae1-8a8b-974ac3c4266e-kube-api-access-h9mp7\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.328093 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.327934    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istiod-ca-cert\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.328093 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.327975    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-data\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.328093 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.328002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-token\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.328093 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.328039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-workload-socket\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.328093 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.328066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-credential-socket\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.328432 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.328340    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-workload-certs\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.328432 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.328402    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-data\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.328551 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.328471    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-credential-socket\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.328607 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.328572    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-workload-socket\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.328707 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.328680    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istiod-ca-cert\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.330218 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.330195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-envoy\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.330432 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.330416    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-podinfo\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.335892 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.335867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9mp7\" (UniqueName: \"kubernetes.io/projected/c131514d-0f02-4ae1-8a8b-974ac3c4266e-kube-api-access-h9mp7\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.335971 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.335869    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-token\") pod \"e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") " pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.440955 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.440879    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:21.577980 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:03:21.577950    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc131514d_0f02_4ae1_8a8b_974ac3c4266e.slice/crio-99c7d0dda78bdb8aecec927bdbdd1c7969417abf51faeb73876a558e308f2bf4 WatchSource:0}: Error finding container 99c7d0dda78bdb8aecec927bdbdd1c7969417abf51faeb73876a558e308f2bf4: Status 404 returned error can't find the container with id 99c7d0dda78bdb8aecec927bdbdd1c7969417abf51faeb73876a558e308f2bf4
Jul 28 20:03:21.578101 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.577979    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"]
Jul 28 20:03:21.580086 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.580047    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:03:21.580177 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.580158    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:03:21.580224 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.580206    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:03:21.743964 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.743881    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv" event={"ID":"c131514d-0f02-4ae1-8a8b-974ac3c4266e","Type":"ContainerStarted","Data":"d7110cb1c76e1ca31e6610266d09b0d7ef95dbb28a27d1a91bb9b2ddef279e63"}
Jul 28 20:03:21.743964 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.743938    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv" event={"ID":"c131514d-0f02-4ae1-8a8b-974ac3c4266e","Type":"ContainerStarted","Data":"99c7d0dda78bdb8aecec927bdbdd1c7969417abf51faeb73876a558e308f2bf4"}
Jul 28 20:03:21.764912 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:21.764853    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv" podStartSLOduration=0.764838293 podStartE2EDuration="764.838293ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:03:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:03:21.762185463 +0000 UTC m=+1686.784481054" watchObservedRunningTime="2026-07-28 20:03:21.764838293 +0000 UTC m=+1686.787133881"
Jul 28 20:03:22.441990 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:22.441960    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:22.447247 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:22.447224    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:22.748762 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:22.748740    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:22.749578 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:22.749560    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:23.630461 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:23.630429    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:03:33.320552 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:33.320505    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:03:37.750333 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:37.750296    2563 patch_prober.go:28] interesting pod/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 28 20:03:37.750807 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:37.750362    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv" podUID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 28 20:03:37.825177 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:37.825146    2563 generic.go:356] "Generic (PLEG): container finished" podID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerID="d7110cb1c76e1ca31e6610266d09b0d7ef95dbb28a27d1a91bb9b2ddef279e63" exitCode=0
Jul 28 20:03:37.825337 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:37.825213    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv" event={"ID":"c131514d-0f02-4ae1-8a8b-974ac3c4266e","Type":"ContainerDied","Data":"d7110cb1c76e1ca31e6610266d09b0d7ef95dbb28a27d1a91bb9b2ddef279e63"}
Jul 28 20:03:37.825715 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:37.825697    2563 scope.go:117] "RemoveContainer" containerID="d7110cb1c76e1ca31e6610266d09b0d7ef95dbb28a27d1a91bb9b2ddef279e63"
Jul 28 20:03:37.826683 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:37.826652    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:03:37.826786 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:37.826718    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:03:37.826786 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:37.826751    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:03:38.832884 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:38.832854    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv" event={"ID":"c131514d-0f02-4ae1-8a8b-974ac3c4266e","Type":"ContainerStarted","Data":"32c05cdbfb4870cadf71a93474118f8f277b5208caa2f9ad07454473269c42bb"}
Jul 28 20:03:39.441167 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:39.441124    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:39.441468 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:39.441443    2563 patch_prober.go:28] interesting pod/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 28 20:03:39.441524 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:39.441496    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv" podUID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 28 20:03:40.441986 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:40.441952    2563 patch_prober.go:28] interesting pod/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 28 20:03:40.442459 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:40.442015    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv" podUID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 28 20:03:41.441746 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:41.441709    2563 patch_prober.go:28] interesting pod/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 28 20:03:41.441926 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:41.441776    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv" podUID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 28 20:03:42.441715 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:42.441674    2563 patch_prober.go:28] interesting pod/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 28 20:03:42.442172 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:42.441735    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv" podUID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 28 20:03:43.442099 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:43.442065    2563 patch_prober.go:28] interesting pod/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 28 20:03:43.442469 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:43.442121    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv" podUID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 28 20:03:44.445193 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:44.445158    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:44.445579 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:44.445409    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:44.445978 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:44.445964    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:03:55.127341 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:55.127309    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"]
Jul 28 20:03:55.127854 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:55.127524    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv" podUID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerName="istio-proxy" containerID="cri-o://32c05cdbfb4870cadf71a93474118f8f277b5208caa2f9ad07454473269c42bb" gracePeriod=30
Jul 28 20:03:58.732015 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:58.731975    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:03:59.448182 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:59.448142    2563 patch_prober.go:28] interesting pod/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 28 20:03:59.448363 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:03:59.448201    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv" podUID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:04:00.370267 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.370239    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:04:00.460937 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.460841    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-workload-certs\") pod \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") "
Jul 28 20:04:00.460937 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.460893    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-podinfo\") pod \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") "
Jul 28 20:04:00.460937 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.460921    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-token\") pod \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") "
Jul 28 20:04:00.460937 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.460936    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-envoy\") pod \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") "
Jul 28 20:04:00.461261 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.460957    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-credential-socket\") pod \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") "
Jul 28 20:04:00.461261 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.460998    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9mp7\" (UniqueName: \"kubernetes.io/projected/c131514d-0f02-4ae1-8a8b-974ac3c4266e-kube-api-access-h9mp7\") pod \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") "
Jul 28 20:04:00.461261 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.461017    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-data\") pod \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") "
Jul 28 20:04:00.461261 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.461052    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istiod-ca-cert\") pod \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") "
Jul 28 20:04:00.461261 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.461083    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-workload-socket\") pod \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\" (UID: \"c131514d-0f02-4ae1-8a8b-974ac3c4266e\") "
Jul 28 20:04:00.461261 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.461213    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c131514d-0f02-4ae1-8a8b-974ac3c4266e" (UID: "c131514d-0f02-4ae1-8a8b-974ac3c4266e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:04:00.461571 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.461394    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-workload-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:04:00.461571 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.461441    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c131514d-0f02-4ae1-8a8b-974ac3c4266e" (UID: "c131514d-0f02-4ae1-8a8b-974ac3c4266e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:04:00.461690 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.461617    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c131514d-0f02-4ae1-8a8b-974ac3c4266e" (UID: "c131514d-0f02-4ae1-8a8b-974ac3c4266e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:04:00.461742 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.461699    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c131514d-0f02-4ae1-8a8b-974ac3c4266e" (UID: "c131514d-0f02-4ae1-8a8b-974ac3c4266e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:04:00.462089 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.462061    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-data" (OuterVolumeSpecName: "istio-data") pod "c131514d-0f02-4ae1-8a8b-974ac3c4266e" (UID: "c131514d-0f02-4ae1-8a8b-974ac3c4266e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:04:00.463290 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.463264    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c131514d-0f02-4ae1-8a8b-974ac3c4266e" (UID: "c131514d-0f02-4ae1-8a8b-974ac3c4266e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:04:00.463290 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.463270    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c131514d-0f02-4ae1-8a8b-974ac3c4266e" (UID: "c131514d-0f02-4ae1-8a8b-974ac3c4266e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:04:00.463421 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.463407    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-token" (OuterVolumeSpecName: "istio-token") pod "c131514d-0f02-4ae1-8a8b-974ac3c4266e" (UID: "c131514d-0f02-4ae1-8a8b-974ac3c4266e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:04:00.463462 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.463431    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c131514d-0f02-4ae1-8a8b-974ac3c4266e-kube-api-access-h9mp7" (OuterVolumeSpecName: "kube-api-access-h9mp7") pod "c131514d-0f02-4ae1-8a8b-974ac3c4266e" (UID: "c131514d-0f02-4ae1-8a8b-974ac3c4266e"). InnerVolumeSpecName "kube-api-access-h9mp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:04:00.561812 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.561778    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-data\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:04:00.561812 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.561804    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istiod-ca-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:04:00.561812 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.561814    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-workload-socket\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:04:00.561812 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.561822    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-podinfo\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:04:00.562054 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.561830    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-token\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:04:00.562054 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.561838    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-istio-envoy\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:04:00.562054 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.561845    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c131514d-0f02-4ae1-8a8b-974ac3c4266e-credential-socket\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:04:00.562054 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.561861    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9mp7\" (UniqueName: \"kubernetes.io/projected/c131514d-0f02-4ae1-8a8b-974ac3c4266e-kube-api-access-h9mp7\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:04:00.944226 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.944181    2563 generic.go:356] "Generic (PLEG): container finished" podID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerID="32c05cdbfb4870cadf71a93474118f8f277b5208caa2f9ad07454473269c42bb" exitCode=0
Jul 28 20:04:00.944226 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.944217    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv" event={"ID":"c131514d-0f02-4ae1-8a8b-974ac3c4266e","Type":"ContainerDied","Data":"32c05cdbfb4870cadf71a93474118f8f277b5208caa2f9ad07454473269c42bb"}
Jul 28 20:04:00.944471 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.944255    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"
Jul 28 20:04:00.944471 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.944277    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv" event={"ID":"c131514d-0f02-4ae1-8a8b-974ac3c4266e","Type":"ContainerDied","Data":"99c7d0dda78bdb8aecec927bdbdd1c7969417abf51faeb73876a558e308f2bf4"}
Jul 28 20:04:00.944471 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.944300    2563 scope.go:117] "RemoveContainer" containerID="32c05cdbfb4870cadf71a93474118f8f277b5208caa2f9ad07454473269c42bb"
Jul 28 20:04:00.953781 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.953763    2563 scope.go:117] "RemoveContainer" containerID="d7110cb1c76e1ca31e6610266d09b0d7ef95dbb28a27d1a91bb9b2ddef279e63"
Jul 28 20:04:00.961825 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.961805    2563 scope.go:117] "RemoveContainer" containerID="32c05cdbfb4870cadf71a93474118f8f277b5208caa2f9ad07454473269c42bb"
Jul 28 20:04:00.962055 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:04:00.962036    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32c05cdbfb4870cadf71a93474118f8f277b5208caa2f9ad07454473269c42bb\": container with ID starting with 32c05cdbfb4870cadf71a93474118f8f277b5208caa2f9ad07454473269c42bb not found: ID does not exist" containerID="32c05cdbfb4870cadf71a93474118f8f277b5208caa2f9ad07454473269c42bb"
Jul 28 20:04:00.962110 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.962063    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32c05cdbfb4870cadf71a93474118f8f277b5208caa2f9ad07454473269c42bb"} err="failed to get container status \"32c05cdbfb4870cadf71a93474118f8f277b5208caa2f9ad07454473269c42bb\": rpc error: code = NotFound desc = could not find container \"32c05cdbfb4870cadf71a93474118f8f277b5208caa2f9ad07454473269c42bb\": container with ID starting with 32c05cdbfb4870cadf71a93474118f8f277b5208caa2f9ad07454473269c42bb not found: ID does not exist"
Jul 28 20:04:00.962110 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.962080    2563 scope.go:117] "RemoveContainer" containerID="d7110cb1c76e1ca31e6610266d09b0d7ef95dbb28a27d1a91bb9b2ddef279e63"
Jul 28 20:04:00.962301 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:04:00.962281    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7110cb1c76e1ca31e6610266d09b0d7ef95dbb28a27d1a91bb9b2ddef279e63\": container with ID starting with d7110cb1c76e1ca31e6610266d09b0d7ef95dbb28a27d1a91bb9b2ddef279e63 not found: ID does not exist" containerID="d7110cb1c76e1ca31e6610266d09b0d7ef95dbb28a27d1a91bb9b2ddef279e63"
Jul 28 20:04:00.962340 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.962307    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7110cb1c76e1ca31e6610266d09b0d7ef95dbb28a27d1a91bb9b2ddef279e63"} err="failed to get container status \"d7110cb1c76e1ca31e6610266d09b0d7ef95dbb28a27d1a91bb9b2ddef279e63\": rpc error: code = NotFound desc = could not find container \"d7110cb1c76e1ca31e6610266d09b0d7ef95dbb28a27d1a91bb9b2ddef279e63\": container with ID starting with d7110cb1c76e1ca31e6610266d09b0d7ef95dbb28a27d1a91bb9b2ddef279e63 not found: ID does not exist"
Jul 28 20:04:00.967869 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.967850    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"]
Jul 28 20:04:00.973814 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:00.973794    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-e98c78a1-gw-openshift-default-5b4657bb8d-vh7sv"]
Jul 28 20:04:01.604040 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:01.604009    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" path="/var/lib/kubelet/pods/c131514d-0f02-4ae1-8a8b-974ac3c4266e/volumes"
Jul 28 20:04:10.122873 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:10.122836    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:04:31.347863 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.347834    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"]
Jul 28 20:04:31.348229 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.348204    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerName="istio-proxy"
Jul 28 20:04:31.348229 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.348215    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerName="istio-proxy"
Jul 28 20:04:31.348229 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.348228    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerName="istio-proxy"
Jul 28 20:04:31.348328 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.348234    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerName="istio-proxy"
Jul 28 20:04:31.348328 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.348313    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerName="istio-proxy"
Jul 28 20:04:31.348328 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.348324    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c131514d-0f02-4ae1-8a8b-974ac3c4266e" containerName="istio-proxy"
Jul 28 20:04:31.350467 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.350452    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.353381 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.353362    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2a481de7-openshift-default-dockercfg-f85xj\""
Jul 28 20:04:31.365336 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.365313    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"]
Jul 28 20:04:31.397518 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.397482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-data\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.397693 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.397526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5f4a365-52f9-4c98-9438-85d7736638bc-istiod-ca-cert\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.397693 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.397574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-credential-socket\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.397693 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.397605    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-envoy\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.397693 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.397641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-workload-certs\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.397693 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.397662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-podinfo\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.397693 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.397681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-token\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.397935 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.397710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-workload-socket\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.397935 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.397816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btldx\" (UniqueName: \"kubernetes.io/projected/a5f4a365-52f9-4c98-9438-85d7736638bc-kube-api-access-btldx\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.498404 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.498365    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-data\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.498404 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.498408    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5f4a365-52f9-4c98-9438-85d7736638bc-istiod-ca-cert\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.498677 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.498434    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-credential-socket\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.498677 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.498462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-envoy\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.498677 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.498493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-workload-certs\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.498677 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.498609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-podinfo\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.498677 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.498649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-token\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.498924 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.498685    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-workload-socket\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.498924 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.498764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btldx\" (UniqueName: \"kubernetes.io/projected/a5f4a365-52f9-4c98-9438-85d7736638bc-kube-api-access-btldx\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.498924 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.498798    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-data\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.498924 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.498900    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-workload-certs\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.499091 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.498958    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-credential-socket\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.499177 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.499160    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-workload-socket\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.499300 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.499282    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5f4a365-52f9-4c98-9438-85d7736638bc-istiod-ca-cert\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.500694 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.500672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-envoy\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.501009 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.500992    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-podinfo\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.507091 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.507058    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btldx\" (UniqueName: \"kubernetes.io/projected/a5f4a365-52f9-4c98-9438-85d7736638bc-kube-api-access-btldx\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.507091 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.507071    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-token\") pod \"e2e-derive-2a481de7-openshift-default-f684bc776-2btlh\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") " pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.660135 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.660043    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:31.790511 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.790481    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"]
Jul 28 20:04:31.791659 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:04:31.791634    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f4a365_52f9_4c98_9438_85d7736638bc.slice/crio-80e9260a92e0510c00ae0598e2b871c852b33058a618510e896cfd406a963804 WatchSource:0}: Error finding container 80e9260a92e0510c00ae0598e2b871c852b33058a618510e896cfd406a963804: Status 404 returned error can't find the container with id 80e9260a92e0510c00ae0598e2b871c852b33058a618510e896cfd406a963804
Jul 28 20:04:31.793882 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.793847    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:04:31.793972 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.793917    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:04:31.793972 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:31.793946    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:04:32.102444 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:32.102406    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh" event={"ID":"a5f4a365-52f9-4c98-9438-85d7736638bc","Type":"ContainerStarted","Data":"8ff9a449efd04ab62254cc2df5be847f827a7a30416f5775c92977f2a6503db8"}
Jul 28 20:04:32.102635 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:32.102470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh" event={"ID":"a5f4a365-52f9-4c98-9438-85d7736638bc","Type":"ContainerStarted","Data":"80e9260a92e0510c00ae0598e2b871c852b33058a618510e896cfd406a963804"}
Jul 28 20:04:32.124095 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:32.124033    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh" podStartSLOduration=1.124013008 podStartE2EDuration="1.124013008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:04:32.122199681 +0000 UTC m=+1757.144495276" watchObservedRunningTime="2026-07-28 20:04:32.124013008 +0000 UTC m=+1757.146308597"
Jul 28 20:04:32.660558 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:32.660506    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:32.665312 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:32.665289    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:33.022510 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:33.022475    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:04:33.106944 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:33.106910    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:33.107775 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:33.107759    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:45.231071 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:45.231031    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:04:47.175778 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:47.175750    2563 generic.go:356] "Generic (PLEG): container finished" podID="a5f4a365-52f9-4c98-9438-85d7736638bc" containerID="8ff9a449efd04ab62254cc2df5be847f827a7a30416f5775c92977f2a6503db8" exitCode=0
Jul 28 20:04:47.176178 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:47.175828    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh" event={"ID":"a5f4a365-52f9-4c98-9438-85d7736638bc","Type":"ContainerDied","Data":"8ff9a449efd04ab62254cc2df5be847f827a7a30416f5775c92977f2a6503db8"}
Jul 28 20:04:47.176224 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:47.176207    2563 scope.go:117] "RemoveContainer" containerID="8ff9a449efd04ab62254cc2df5be847f827a7a30416f5775c92977f2a6503db8"
Jul 28 20:04:47.177203 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:47.177176    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:04:47.177295 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:47.177240    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:04:47.177295 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:47.177270    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:04:48.107619 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:48.107580    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:48.188324 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:48.187423    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh" event={"ID":"a5f4a365-52f9-4c98-9438-85d7736638bc","Type":"ContainerStarted","Data":"6b4d56be0557d1e858bffe4dc7158fc86fce025171d6ced113f45b31a8c3457b"}
Jul 28 20:04:48.662248 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:48.662202    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:48.662459 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:48.662322    2563 patch_prober.go:28] interesting pod/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 20:04:48.662459 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:48.662369    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh" podUID="a5f4a365-52f9-4c98-9438-85d7736638bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 20:04:49.661426 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:49.661385    2563 patch_prober.go:28] interesting pod/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 20:04:49.661958 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:49.661461    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh" podUID="a5f4a365-52f9-4c98-9438-85d7736638bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 20:04:50.661564 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:50.661499    2563 patch_prober.go:28] interesting pod/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 20:04:50.662144 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:50.662108    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh" podUID="a5f4a365-52f9-4c98-9438-85d7736638bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 20:04:51.660962 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:51.660921    2563 patch_prober.go:28] interesting pod/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 20:04:51.661169 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:51.660992    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh" podUID="a5f4a365-52f9-4c98-9438-85d7736638bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 20:04:52.664504 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:52.664470    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:52.665016 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:52.664747    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:52.665629 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:52.665611    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:04:54.640195 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:54.640160    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"]
Jul 28 20:04:55.224831 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:55.224774    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh" podUID="a5f4a365-52f9-4c98-9438-85d7736638bc" containerName="istio-proxy" containerID="cri-o://6b4d56be0557d1e858bffe4dc7158fc86fce025171d6ced113f45b31a8c3457b" gracePeriod=30
Jul 28 20:04:57.827032 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:04:57.826994    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:05:00.477339 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.477320    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:05:00.555141 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.555110    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-envoy\") pod \"a5f4a365-52f9-4c98-9438-85d7736638bc\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") "
Jul 28 20:05:00.555331 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.555166    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-podinfo\") pod \"a5f4a365-52f9-4c98-9438-85d7736638bc\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") "
Jul 28 20:05:00.555331 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.555196    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5f4a365-52f9-4c98-9438-85d7736638bc-istiod-ca-cert\") pod \"a5f4a365-52f9-4c98-9438-85d7736638bc\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") "
Jul 28 20:05:00.555331 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.555237    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-workload-certs\") pod \"a5f4a365-52f9-4c98-9438-85d7736638bc\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") "
Jul 28 20:05:00.555331 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.555256    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-workload-socket\") pod \"a5f4a365-52f9-4c98-9438-85d7736638bc\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") "
Jul 28 20:05:00.555331 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.555280    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-token\") pod \"a5f4a365-52f9-4c98-9438-85d7736638bc\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") "
Jul 28 20:05:00.555331 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.555312    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-data\") pod \"a5f4a365-52f9-4c98-9438-85d7736638bc\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") "
Jul 28 20:05:00.555670 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.555346    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btldx\" (UniqueName: \"kubernetes.io/projected/a5f4a365-52f9-4c98-9438-85d7736638bc-kube-api-access-btldx\") pod \"a5f4a365-52f9-4c98-9438-85d7736638bc\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") "
Jul 28 20:05:00.555670 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.555378    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-credential-socket\") pod \"a5f4a365-52f9-4c98-9438-85d7736638bc\" (UID: \"a5f4a365-52f9-4c98-9438-85d7736638bc\") "
Jul 28 20:05:00.555670 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.555526    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5f4a365-52f9-4c98-9438-85d7736638bc" (UID: "a5f4a365-52f9-4c98-9438-85d7736638bc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:05:00.555822 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.555705    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-workload-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:05:00.555822 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.555662    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5f4a365-52f9-4c98-9438-85d7736638bc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5f4a365-52f9-4c98-9438-85d7736638bc" (UID: "a5f4a365-52f9-4c98-9438-85d7736638bc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:05:00.555822 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.555741    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5f4a365-52f9-4c98-9438-85d7736638bc" (UID: "a5f4a365-52f9-4c98-9438-85d7736638bc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:05:00.555822 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.555753    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5f4a365-52f9-4c98-9438-85d7736638bc" (UID: "a5f4a365-52f9-4c98-9438-85d7736638bc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:05:00.556663 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.556632    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5f4a365-52f9-4c98-9438-85d7736638bc" (UID: "a5f4a365-52f9-4c98-9438-85d7736638bc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:05:00.557532 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.557511    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5f4a365-52f9-4c98-9438-85d7736638bc" (UID: "a5f4a365-52f9-4c98-9438-85d7736638bc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:05:00.557650 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.557630    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5f4a365-52f9-4c98-9438-85d7736638bc-kube-api-access-btldx" (OuterVolumeSpecName: "kube-api-access-btldx") pod "a5f4a365-52f9-4c98-9438-85d7736638bc" (UID: "a5f4a365-52f9-4c98-9438-85d7736638bc"). InnerVolumeSpecName "kube-api-access-btldx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:05:00.557817 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.557797    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5f4a365-52f9-4c98-9438-85d7736638bc" (UID: "a5f4a365-52f9-4c98-9438-85d7736638bc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:05:00.558066 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.558041    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5f4a365-52f9-4c98-9438-85d7736638bc" (UID: "a5f4a365-52f9-4c98-9438-85d7736638bc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:05:00.656091 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.656060    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5f4a365-52f9-4c98-9438-85d7736638bc-istiod-ca-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:05:00.656091 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.656086    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-workload-socket\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:05:00.656091 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.656096    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-token\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:05:00.656307 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.656104    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-data\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:05:00.656307 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.656112    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btldx\" (UniqueName: \"kubernetes.io/projected/a5f4a365-52f9-4c98-9438-85d7736638bc-kube-api-access-btldx\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:05:00.656307 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.656120    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-credential-socket\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:05:00.656307 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.656128    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-envoy\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:05:00.656307 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:00.656136    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5f4a365-52f9-4c98-9438-85d7736638bc-istio-podinfo\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:05:01.255053 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:01.255013    2563 generic.go:356] "Generic (PLEG): container finished" podID="a5f4a365-52f9-4c98-9438-85d7736638bc" containerID="6b4d56be0557d1e858bffe4dc7158fc86fce025171d6ced113f45b31a8c3457b" exitCode=0
Jul 28 20:05:01.255223 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:01.255061    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"
Jul 28 20:05:01.255223 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:01.255099    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh" event={"ID":"a5f4a365-52f9-4c98-9438-85d7736638bc","Type":"ContainerDied","Data":"6b4d56be0557d1e858bffe4dc7158fc86fce025171d6ced113f45b31a8c3457b"}
Jul 28 20:05:01.255223 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:01.255154    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh" event={"ID":"a5f4a365-52f9-4c98-9438-85d7736638bc","Type":"ContainerDied","Data":"80e9260a92e0510c00ae0598e2b871c852b33058a618510e896cfd406a963804"}
Jul 28 20:05:01.255223 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:01.255182    2563 scope.go:117] "RemoveContainer" containerID="6b4d56be0557d1e858bffe4dc7158fc86fce025171d6ced113f45b31a8c3457b"
Jul 28 20:05:01.264592 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:01.264573    2563 scope.go:117] "RemoveContainer" containerID="8ff9a449efd04ab62254cc2df5be847f827a7a30416f5775c92977f2a6503db8"
Jul 28 20:05:01.271902 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:01.271886    2563 scope.go:117] "RemoveContainer" containerID="6b4d56be0557d1e858bffe4dc7158fc86fce025171d6ced113f45b31a8c3457b"
Jul 28 20:05:01.272134 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:05:01.272112    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b4d56be0557d1e858bffe4dc7158fc86fce025171d6ced113f45b31a8c3457b\": container with ID starting with 6b4d56be0557d1e858bffe4dc7158fc86fce025171d6ced113f45b31a8c3457b not found: ID does not exist" containerID="6b4d56be0557d1e858bffe4dc7158fc86fce025171d6ced113f45b31a8c3457b"
Jul 28 20:05:01.272194 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:01.272141    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b4d56be0557d1e858bffe4dc7158fc86fce025171d6ced113f45b31a8c3457b"} err="failed to get container status \"6b4d56be0557d1e858bffe4dc7158fc86fce025171d6ced113f45b31a8c3457b\": rpc error: code = NotFound desc = could not find container \"6b4d56be0557d1e858bffe4dc7158fc86fce025171d6ced113f45b31a8c3457b\": container with ID starting with 6b4d56be0557d1e858bffe4dc7158fc86fce025171d6ced113f45b31a8c3457b not found: ID does not exist"
Jul 28 20:05:01.272194 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:01.272156    2563 scope.go:117] "RemoveContainer" containerID="8ff9a449efd04ab62254cc2df5be847f827a7a30416f5775c92977f2a6503db8"
Jul 28 20:05:01.272394 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:05:01.272378    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ff9a449efd04ab62254cc2df5be847f827a7a30416f5775c92977f2a6503db8\": container with ID starting with 8ff9a449efd04ab62254cc2df5be847f827a7a30416f5775c92977f2a6503db8 not found: ID does not exist" containerID="8ff9a449efd04ab62254cc2df5be847f827a7a30416f5775c92977f2a6503db8"
Jul 28 20:05:01.272431 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:01.272399    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff9a449efd04ab62254cc2df5be847f827a7a30416f5775c92977f2a6503db8"} err="failed to get container status \"8ff9a449efd04ab62254cc2df5be847f827a7a30416f5775c92977f2a6503db8\": rpc error: code = NotFound desc = could not find container \"8ff9a449efd04ab62254cc2df5be847f827a7a30416f5775c92977f2a6503db8\": container with ID starting with 8ff9a449efd04ab62254cc2df5be847f827a7a30416f5775c92977f2a6503db8 not found: ID does not exist"
Jul 28 20:05:01.276836 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:01.276816    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"]
Jul 28 20:05:01.281204 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:01.281183    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2a481de7-openshift-default-f684bc776-2btlh"]
Jul 28 20:05:01.609405 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:05:01.609319    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5f4a365-52f9-4c98-9438-85d7736638bc" path="/var/lib/kubelet/pods/a5f4a365-52f9-4c98-9438-85d7736638bc/volumes"
Jul 28 20:06:19.834238 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:06:19.834207    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:06:31.832329 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:06:31.832290    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:06:41.634835 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:06:41.634746    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:06:52.322339 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:06:52.322302    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:07:32.725118 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:07:32.725080    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:08:05.629274 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:05.629232    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:08:35.645474 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.645394    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"]
Jul 28 20:08:35.645893 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.645787    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5f4a365-52f9-4c98-9438-85d7736638bc" containerName="istio-proxy"
Jul 28 20:08:35.645893 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.645801    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5f4a365-52f9-4c98-9438-85d7736638bc" containerName="istio-proxy"
Jul 28 20:08:35.645893 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.645818    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5f4a365-52f9-4c98-9438-85d7736638bc" containerName="istio-proxy"
Jul 28 20:08:35.645893 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.645826    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5f4a365-52f9-4c98-9438-85d7736638bc" containerName="istio-proxy"
Jul 28 20:08:35.645893 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.645883    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5f4a365-52f9-4c98-9438-85d7736638bc" containerName="istio-proxy"
Jul 28 20:08:35.648284 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.648267    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.650772 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.650752    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-27915281\"/\"kube-root-ca.crt\""
Jul 28 20:08:35.651834 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.651810    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-27915281\"/\"default-dockercfg-mwb5j\""
Jul 28 20:08:35.651955 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.651850    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-27915281\"/\"e2e-lifecycle-model-27915281-kserve-self-signed-certs\""
Jul 28 20:08:35.651955 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.651902    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-27915281\"/\"openshift-service-ca.crt\""
Jul 28 20:08:35.659039 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.659016    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"]
Jul 28 20:08:35.752657 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.752626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-home\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.752873 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.752695    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-model-cache\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.752873 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.752714    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/161eb5d9-213f-4053-a406-31ca886ca84c-tls-certs\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.753022 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.752873    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzt9w\" (UniqueName: \"kubernetes.io/projected/161eb5d9-213f-4053-a406-31ca886ca84c-kube-api-access-kzt9w\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.753022 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.752932    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-tmp-dir\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.753138 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.753053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-dshm\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.853519 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.853489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-dshm\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.853712 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.853554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-home\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.853712 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.853591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-model-cache\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.853712 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.853609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/161eb5d9-213f-4053-a406-31ca886ca84c-tls-certs\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.853889 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.853730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzt9w\" (UniqueName: \"kubernetes.io/projected/161eb5d9-213f-4053-a406-31ca886ca84c-kube-api-access-kzt9w\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.853889 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.853776    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-tmp-dir\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.854008 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.853984    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-model-cache\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.854078 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.854055    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-home\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.854133 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.854065    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-tmp-dir\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.856102 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.856075    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-dshm\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.856235 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.856219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/161eb5d9-213f-4053-a406-31ca886ca84c-tls-certs\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.861884 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.861866    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzt9w\" (UniqueName: \"kubernetes.io/projected/161eb5d9-213f-4053-a406-31ca886ca84c-kube-api-access-kzt9w\") pod \"e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") " pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:35.957351 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:35.957273    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:36.085884 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:36.085858    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"]
Jul 28 20:08:36.087661 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:08:36.087635    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod161eb5d9_213f_4053_a406_31ca886ca84c.slice/crio-4d156af081de5b3bd2f3a9da9777e8ec8185de8198ef6f12ad9b1818df1ab393 WatchSource:0}: Error finding container 4d156af081de5b3bd2f3a9da9777e8ec8185de8198ef6f12ad9b1818df1ab393: Status 404 returned error can't find the container with id 4d156af081de5b3bd2f3a9da9777e8ec8185de8198ef6f12ad9b1818df1ab393
Jul 28 20:08:36.327407 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:36.327369    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd" event={"ID":"161eb5d9-213f-4053-a406-31ca886ca84c","Type":"ContainerStarted","Data":"66b7987bd4ec80b113a7c8bc7b406169f5065ad446763bf4ddfc279eaf04e2d3"}
Jul 28 20:08:36.327677 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:36.327416    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd" event={"ID":"161eb5d9-213f-4053-a406-31ca886ca84c","Type":"ContainerStarted","Data":"4d156af081de5b3bd2f3a9da9777e8ec8185de8198ef6f12ad9b1818df1ab393"}
Jul 28 20:08:36.343768 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:36.343724    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd" podStartSLOduration=1.34370829 podStartE2EDuration="1.34370829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:08:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:08:36.342160466 +0000 UTC m=+2001.364456066" watchObservedRunningTime="2026-07-28 20:08:36.34370829 +0000 UTC m=+2001.366003879"
Jul 28 20:08:39.019103 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:39.019068    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:08:45.958370 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:45.958334    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:45.958370 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:45.958376    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:45.971109 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:45.971085    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:08:46.388914 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:08:46.388887    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:09:04.226722 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:04.226683    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:09:24.130614 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:24.130575    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:09:32.126861 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:32.126822    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:09:33.455321 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:33.455285    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"]
Jul 28 20:09:48.474186 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.474127    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd" podUID="161eb5d9-213f-4053-a406-31ca886ca84c" containerName="main" containerID="cri-o://66b7987bd4ec80b113a7c8bc7b406169f5065ad446763bf4ddfc279eaf04e2d3" gracePeriod=45
Jul 28 20:09:48.675194 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.675165    2563 generic.go:356] "Generic (PLEG): container finished" podID="161eb5d9-213f-4053-a406-31ca886ca84c" containerID="66b7987bd4ec80b113a7c8bc7b406169f5065ad446763bf4ddfc279eaf04e2d3" exitCode=0
Jul 28 20:09:48.675341 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.675247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd" event={"ID":"161eb5d9-213f-4053-a406-31ca886ca84c","Type":"ContainerDied","Data":"66b7987bd4ec80b113a7c8bc7b406169f5065ad446763bf4ddfc279eaf04e2d3"}
Jul 28 20:09:48.721403 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.721379    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:09:48.787772 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.787742    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-dshm\") pod \"161eb5d9-213f-4053-a406-31ca886ca84c\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") "
Jul 28 20:09:48.787944 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.787784    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzt9w\" (UniqueName: \"kubernetes.io/projected/161eb5d9-213f-4053-a406-31ca886ca84c-kube-api-access-kzt9w\") pod \"161eb5d9-213f-4053-a406-31ca886ca84c\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") "
Jul 28 20:09:48.787944 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.787821    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/161eb5d9-213f-4053-a406-31ca886ca84c-tls-certs\") pod \"161eb5d9-213f-4053-a406-31ca886ca84c\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") "
Jul 28 20:09:48.787944 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.787910    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-model-cache\") pod \"161eb5d9-213f-4053-a406-31ca886ca84c\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") "
Jul 28 20:09:48.788127 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.787963    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-home\") pod \"161eb5d9-213f-4053-a406-31ca886ca84c\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") "
Jul 28 20:09:48.788127 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.787985    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-tmp-dir\") pod \"161eb5d9-213f-4053-a406-31ca886ca84c\" (UID: \"161eb5d9-213f-4053-a406-31ca886ca84c\") "
Jul 28 20:09:48.788261 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.788218    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-home" (OuterVolumeSpecName: "home") pod "161eb5d9-213f-4053-a406-31ca886ca84c" (UID: "161eb5d9-213f-4053-a406-31ca886ca84c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:09:48.788317 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.788224    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-model-cache" (OuterVolumeSpecName: "model-cache") pod "161eb5d9-213f-4053-a406-31ca886ca84c" (UID: "161eb5d9-213f-4053-a406-31ca886ca84c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:09:48.788317 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.788294    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "161eb5d9-213f-4053-a406-31ca886ca84c" (UID: "161eb5d9-213f-4053-a406-31ca886ca84c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:09:48.789960 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.789931    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-dshm" (OuterVolumeSpecName: "dshm") pod "161eb5d9-213f-4053-a406-31ca886ca84c" (UID: "161eb5d9-213f-4053-a406-31ca886ca84c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:09:48.790057 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.789978    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/161eb5d9-213f-4053-a406-31ca886ca84c-kube-api-access-kzt9w" (OuterVolumeSpecName: "kube-api-access-kzt9w") pod "161eb5d9-213f-4053-a406-31ca886ca84c" (UID: "161eb5d9-213f-4053-a406-31ca886ca84c"). InnerVolumeSpecName "kube-api-access-kzt9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:09:48.790057 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.789991    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/161eb5d9-213f-4053-a406-31ca886ca84c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "161eb5d9-213f-4053-a406-31ca886ca84c" (UID: "161eb5d9-213f-4053-a406-31ca886ca84c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:09:48.888723 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.888690    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-dshm\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:09:48.888723 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.888716    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzt9w\" (UniqueName: \"kubernetes.io/projected/161eb5d9-213f-4053-a406-31ca886ca84c-kube-api-access-kzt9w\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:09:48.888723 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.888728    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/161eb5d9-213f-4053-a406-31ca886ca84c-tls-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:09:48.888963 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.888737    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-model-cache\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:09:48.888963 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.888745    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-home\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:09:48.888963 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:48.888752    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/161eb5d9-213f-4053-a406-31ca886ca84c-tmp-dir\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:09:49.681034 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:49.681008    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"
Jul 28 20:09:49.681034 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:49.681029    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd" event={"ID":"161eb5d9-213f-4053-a406-31ca886ca84c","Type":"ContainerDied","Data":"4d156af081de5b3bd2f3a9da9777e8ec8185de8198ef6f12ad9b1818df1ab393"}
Jul 28 20:09:49.681509 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:49.681075    2563 scope.go:117] "RemoveContainer" containerID="66b7987bd4ec80b113a7c8bc7b406169f5065ad446763bf4ddfc279eaf04e2d3"
Jul 28 20:09:49.697372 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:49.697350    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"]
Jul 28 20:09:49.703493 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:49.703465    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-27915281/e2e-lifecycle-model-27915281-kserve-786c7788dc-ddpsd"]
Jul 28 20:09:51.603917 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:09:51.603882    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="161eb5d9-213f-4053-a406-31ca886ca84c" path="/var/lib/kubelet/pods/161eb5d9-213f-4053-a406-31ca886ca84c/volumes"
Jul 28 20:10:34.624986 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:10:34.624944    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:10:46.079717 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:10:46.079680    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:11:26.606676 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.606596    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"]
Jul 28 20:11:26.607137 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.607083    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="161eb5d9-213f-4053-a406-31ca886ca84c" containerName="main"
Jul 28 20:11:26.607137 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.607101    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="161eb5d9-213f-4053-a406-31ca886ca84c" containerName="main"
Jul 28 20:11:26.607215 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.607202    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5f4a365-52f9-4c98-9438-85d7736638bc" containerName="istio-proxy"
Jul 28 20:11:26.607255 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.607218    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="161eb5d9-213f-4053-a406-31ca886ca84c" containerName="main"
Jul 28 20:11:26.610998 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.610982    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.613462 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.613447    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-188d8c-openshift-default-dockercfg-9lm5c\""
Jul 28 20:11:26.621024 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.621004    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"]
Jul 28 20:11:26.707223 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.707181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-data\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.707411 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.707248    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd8j6\" (UniqueName: \"kubernetes.io/projected/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-kube-api-access-dd8j6\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.707411 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.707289    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-credential-socket\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.707411 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.707337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-token\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.707411 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.707383    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-envoy\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.707627 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.707458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-workload-certs\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.707627 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.707479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-workload-socket\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.707627 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.707514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istiod-ca-cert\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.707627 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.707599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-podinfo\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.808145 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.808114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-workload-certs\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.808145 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.808147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-workload-socket\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.808394 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.808173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istiod-ca-cert\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.808394 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.808288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-podinfo\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.808394 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.808334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-data\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.808394 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.808379    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd8j6\" (UniqueName: \"kubernetes.io/projected/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-kube-api-access-dd8j6\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.808644 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.808420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-credential-socket\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.808644 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.808443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-token\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.808644 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.808473    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-envoy\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.808644 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.808518    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-workload-socket\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.808644 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.808600    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-workload-certs\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.808896 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.808801    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-credential-socket\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.808896 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.808842    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-data\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.809120 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.809101    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istiod-ca-cert\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.810725 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.810704    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-envoy\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.810819 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.810796    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-podinfo\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.815765 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.815745    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-token\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.815865 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.815808    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd8j6\" (UniqueName: \"kubernetes.io/projected/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-kube-api-access-dd8j6\") pod \"e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") " pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:26.921614 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:26.921511    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:27.052246 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:27.052215    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"]
Jul 28 20:11:27.053290 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:11:27.053261    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod470fb9a9_c3e3_4737_abd2_5fdd7f31fb3a.slice/crio-57e91aaf533841bc42b2303f5ebc93c17f7bd4c68e714c84bc8f3864f625e953 WatchSource:0}: Error finding container 57e91aaf533841bc42b2303f5ebc93c17f7bd4c68e714c84bc8f3864f625e953: Status 404 returned error can't find the container with id 57e91aaf533841bc42b2303f5ebc93c17f7bd4c68e714c84bc8f3864f625e953
Jul 28 20:11:27.055265 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:27.055233    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:11:27.055332 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:27.055297    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:11:27.055368 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:27.055328    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:11:27.170119 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:27.170081    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x" event={"ID":"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a","Type":"ContainerStarted","Data":"59cae490dc60fd3c2f4a88c37b515865fbd70550cf7d30b8bf687d271ce6c79b"}
Jul 28 20:11:27.170290 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:27.170138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x" event={"ID":"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a","Type":"ContainerStarted","Data":"57e91aaf533841bc42b2303f5ebc93c17f7bd4c68e714c84bc8f3864f625e953"}
Jul 28 20:11:27.190862 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:27.190769    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x" podStartSLOduration=1.190753139 podStartE2EDuration="1.190753139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:11:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:11:27.188251147 +0000 UTC m=+2172.210546735" watchObservedRunningTime="2026-07-28 20:11:27.190753139 +0000 UTC m=+2172.213048726"
Jul 28 20:11:27.922361 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:27.922323    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:28.926685 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:28.926656    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:29.179432 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:29.179356    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:29.180412 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:29.180393    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:35.226639 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:35.226603    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:11:44.180899 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:44.180856    2563 patch_prober.go:28] interesting pod/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 28 20:11:44.181317 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:44.180936    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x" podUID="470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 28 20:11:44.253988 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:44.253957    2563 generic.go:356] "Generic (PLEG): container finished" podID="470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" containerID="59cae490dc60fd3c2f4a88c37b515865fbd70550cf7d30b8bf687d271ce6c79b" exitCode=0
Jul 28 20:11:44.254177 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:44.254015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x" event={"ID":"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a","Type":"ContainerDied","Data":"59cae490dc60fd3c2f4a88c37b515865fbd70550cf7d30b8bf687d271ce6c79b"}
Jul 28 20:11:44.254428 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:44.254414    2563 scope.go:117] "RemoveContainer" containerID="59cae490dc60fd3c2f4a88c37b515865fbd70550cf7d30b8bf687d271ce6c79b"
Jul 28 20:11:44.255453 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:44.255422    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:11:44.255510 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:44.255491    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:11:44.255565 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:44.255526    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:11:45.261566 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:45.261492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x" event={"ID":"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a","Type":"ContainerStarted","Data":"888e5c2e887ac10111b665cb787ba694d3a9577f02da41e73ccab3f50e4c9b37"}
Jul 28 20:11:45.921747 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:45.921714    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:45.921967 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:45.921944    2563 patch_prober.go:28] interesting pod/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 28 20:11:45.922015 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:45.921996    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x" podUID="470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 28 20:11:46.921890 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:46.921855    2563 patch_prober.go:28] interesting pod/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 28 20:11:46.922295 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:46.921909    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x" podUID="470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 28 20:11:47.922174 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:47.922139    2563 patch_prober.go:28] interesting pod/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 28 20:11:47.922579 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:47.922201    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x" podUID="470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 28 20:11:48.922931 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:48.922892    2563 patch_prober.go:28] interesting pod/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 28 20:11:48.923370 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:48.922962    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x" podUID="470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 28 20:11:49.926515 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:49.926483    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:49.927005 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:49.926988    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:11:49.927634 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:11:49.927618    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:12:05.630078 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:05.630041    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:12:54.548951 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.548915    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"]
Jul 28 20:12:54.551823 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.551807    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.554678 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.554653    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-188d8c\"/\"openshift-service-ca.crt\""
Jul 28 20:12:54.554798 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.554679    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-188d8c\"/\"kube-root-ca.crt\""
Jul 28 20:12:54.554798 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.554751    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-188d8c\"/\"default-dockercfg-bssm5\""
Jul 28 20:12:54.555051 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.555030    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-188d8c\"/\"test-model-188d8c-kserve-self-signed-certs\""
Jul 28 20:12:54.562266 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.562244    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"]
Jul 28 20:12:54.640805 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.640773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-tmp-dir\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.640965 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.640824    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwxwx\" (UniqueName: \"kubernetes.io/projected/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-kube-api-access-dwxwx\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.640965 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.640878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-tls-certs\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.640965 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.640905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-dshm\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.640965 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.640953    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-home\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.641129 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.640996    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-model-cache\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.744040 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.743997    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-model-cache\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.744280 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.744257    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-tmp-dir\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.744356 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.744324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwxwx\" (UniqueName: \"kubernetes.io/projected/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-kube-api-access-dwxwx\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.744356 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.744353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-tls-certs\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.744458 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.744369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-dshm\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.744458 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.744411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-home\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.744583 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.744493    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-model-cache\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.744677 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.744655    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-tmp-dir\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.744789 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.744770    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-home\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.746617 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.746593    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-dshm\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.746908 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.746886    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-tls-certs\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.754944 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.754920    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwxwx\" (UniqueName: \"kubernetes.io/projected/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-kube-api-access-dwxwx\") pod \"test-model-188d8c-kserve-6fcfdd5b7c-2gd49\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") " pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.862606 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.862497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:12:54.994828 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:54.994802    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"]
Jul 28 20:12:54.996602 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:12:54.996576    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cf34ad4_fa5a_4dd6_bdad_b4e2410258fc.slice/crio-c64b06fd7a457b6b660993b19b4525c395cf0da3beda11dec2beff28f002ea6b WatchSource:0}: Error finding container c64b06fd7a457b6b660993b19b4525c395cf0da3beda11dec2beff28f002ea6b: Status 404 returned error can't find the container with id c64b06fd7a457b6b660993b19b4525c395cf0da3beda11dec2beff28f002ea6b
Jul 28 20:12:55.619384 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:55.619349    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49" event={"ID":"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc","Type":"ContainerStarted","Data":"eabfc29959ffb26c03b765a0f73cd24d58a3da19b2b9a34e122afdb058ba5af2"}
Jul 28 20:12:55.619384 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:55.619388    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49" event={"ID":"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc","Type":"ContainerStarted","Data":"c64b06fd7a457b6b660993b19b4525c395cf0da3beda11dec2beff28f002ea6b"}
Jul 28 20:12:55.653306 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:55.653250    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49" podStartSLOduration=1.653233092 podStartE2EDuration="1.653233092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:12:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:12:55.653092913 +0000 UTC m=+2260.675388501" watchObservedRunningTime="2026-07-28 20:12:55.653233092 +0000 UTC m=+2260.675528681"
Jul 28 20:12:58.935620 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:12:58.935588    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:13:04.863280 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:04.863250    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:13:04.863703 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:04.863310    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:13:04.876091 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:04.876067    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:13:05.678391 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:05.678364    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:13:23.744048 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.744008    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"]
Jul 28 20:13:23.747278 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.747260    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.750133 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.750110    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ba3d8d\"/\"openshift-service-ca.crt\""
Jul 28 20:13:23.751127 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.751105    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ba3d8d\"/\"kube-root-ca.crt\""
Jul 28 20:13:23.751265 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.751129    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ba3d8d\"/\"test-model-ba3d8d-kserve-self-signed-certs\""
Jul 28 20:13:23.751265 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.751183    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ba3d8d\"/\"default-dockercfg-qx8ns\""
Jul 28 20:13:23.758597 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.758575    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"]
Jul 28 20:13:23.794913 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.794877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjxb9\" (UniqueName: \"kubernetes.io/projected/48141f58-f112-4612-a2ad-b4a706b2d4de-kube-api-access-zjxb9\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.795062 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.794919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-model-cache\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.795062 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.794980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-tmp-dir\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.795062 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.795013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-dshm\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.795202 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.795079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48141f58-f112-4612-a2ad-b4a706b2d4de-tls-certs\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.795202 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.795122    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-home\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.895568 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.895500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48141f58-f112-4612-a2ad-b4a706b2d4de-tls-certs\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.895568 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.895573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-home\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.895812 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.895611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjxb9\" (UniqueName: \"kubernetes.io/projected/48141f58-f112-4612-a2ad-b4a706b2d4de-kube-api-access-zjxb9\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.895812 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.895629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-model-cache\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.895812 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.895653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-tmp-dir\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.895812 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.895771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-dshm\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.896041 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.896022    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-home\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.896102 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.896065    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-tmp-dir\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.896158 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.896121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-model-cache\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.897888 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.897870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-dshm\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.898166 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.898148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48141f58-f112-4612-a2ad-b4a706b2d4de-tls-certs\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:23.904272 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:23.904249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjxb9\" (UniqueName: \"kubernetes.io/projected/48141f58-f112-4612-a2ad-b4a706b2d4de-kube-api-access-zjxb9\") pod \"test-model-ba3d8d-kserve-84b5768db9-5znwg\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") " pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:24.057346 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:24.057304    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:24.192626 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:24.192603    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"]
Jul 28 20:13:24.194620 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:13:24.194586    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48141f58_f112_4612_a2ad_b4a706b2d4de.slice/crio-83a01e4aec5f4a5668149c4e1b2a2a6e703d263b5beb56a97434af8f29c74e74 WatchSource:0}: Error finding container 83a01e4aec5f4a5668149c4e1b2a2a6e703d263b5beb56a97434af8f29c74e74: Status 404 returned error can't find the container with id 83a01e4aec5f4a5668149c4e1b2a2a6e703d263b5beb56a97434af8f29c74e74
Jul 28 20:13:24.767665 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:24.767625    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg" event={"ID":"48141f58-f112-4612-a2ad-b4a706b2d4de","Type":"ContainerStarted","Data":"692ff19b29cbb30c7c1565cae98767fbdd99f71b1f976cb842d48f40d5d07999"}
Jul 28 20:13:24.768064 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:24.767674    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg" event={"ID":"48141f58-f112-4612-a2ad-b4a706b2d4de","Type":"ContainerStarted","Data":"83a01e4aec5f4a5668149c4e1b2a2a6e703d263b5beb56a97434af8f29c74e74"}
Jul 28 20:13:24.786687 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:24.786635    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg" podStartSLOduration=1.786619329 podStartE2EDuration="1.786619329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:13:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:13:24.784673056 +0000 UTC m=+2289.806968665" watchObservedRunningTime="2026-07-28 20:13:24.786619329 +0000 UTC m=+2289.808914917"
Jul 28 20:13:27.939953 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:27.939922    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:13:34.058366 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:34.058327    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:34.058821 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:34.058396    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:34.071058 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:34.071033    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:34.834498 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:34.834469    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:13:41.634069 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:13:41.634029    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:14:04.054972 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:04.054938    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"]
Jul 28 20:14:04.980028 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:04.979998    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"]
Jul 28 20:14:08.839384 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:08.839305    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:14:19.073527 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.073488    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49" podUID="1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc" containerName="main" containerID="cri-o://eabfc29959ffb26c03b765a0f73cd24d58a3da19b2b9a34e122afdb058ba5af2" gracePeriod=45
Jul 28 20:14:19.316499 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.316477    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:14:19.376166 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.376091    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-dshm\") pod \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") "
Jul 28 20:14:19.376166 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.376127    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-model-cache\") pod \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") "
Jul 28 20:14:19.376166 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.376151    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-home\") pod \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") "
Jul 28 20:14:19.376425 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.376174    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwxwx\" (UniqueName: \"kubernetes.io/projected/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-kube-api-access-dwxwx\") pod \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") "
Jul 28 20:14:19.376425 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.376206    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-tmp-dir\") pod \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") "
Jul 28 20:14:19.376425 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.376261    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-tls-certs\") pod \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\" (UID: \"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc\") "
Jul 28 20:14:19.376425 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.376399    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-model-cache" (OuterVolumeSpecName: "model-cache") pod "1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc" (UID: "1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:19.376615 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.376420    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-home" (OuterVolumeSpecName: "home") pod "1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc" (UID: "1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:19.376615 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.376480    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc" (UID: "1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:19.378325 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.378303    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-dshm" (OuterVolumeSpecName: "dshm") pod "1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc" (UID: "1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:19.378446 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.378371    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc" (UID: "1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:14:19.378446 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.378379    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-kube-api-access-dwxwx" (OuterVolumeSpecName: "kube-api-access-dwxwx") pod "1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc" (UID: "1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc"). InnerVolumeSpecName "kube-api-access-dwxwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:14:19.477714 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.477681    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-tls-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:19.477714 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.477710    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-dshm\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:19.477714 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.477720    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-model-cache\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:19.477931 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.477727    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-home\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:19.477931 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.477736    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwxwx\" (UniqueName: \"kubernetes.io/projected/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-kube-api-access-dwxwx\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:19.477931 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.477749    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc-tmp-dir\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:19.998759 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:19.998702    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg" podUID="48141f58-f112-4612-a2ad-b4a706b2d4de" containerName="main" containerID="cri-o://692ff19b29cbb30c7c1565cae98767fbdd99f71b1f976cb842d48f40d5d07999" gracePeriod=45
Jul 28 20:14:20.057366 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.057326    2563 generic.go:356] "Generic (PLEG): container finished" podID="1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc" containerID="eabfc29959ffb26c03b765a0f73cd24d58a3da19b2b9a34e122afdb058ba5af2" exitCode=0
Jul 28 20:14:20.057522 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.057370    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"
Jul 28 20:14:20.057522 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.057409    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49" event={"ID":"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc","Type":"ContainerDied","Data":"eabfc29959ffb26c03b765a0f73cd24d58a3da19b2b9a34e122afdb058ba5af2"}
Jul 28 20:14:20.057522 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.057455    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49" event={"ID":"1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc","Type":"ContainerDied","Data":"c64b06fd7a457b6b660993b19b4525c395cf0da3beda11dec2beff28f002ea6b"}
Jul 28 20:14:20.057522 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.057473    2563 scope.go:117] "RemoveContainer" containerID="eabfc29959ffb26c03b765a0f73cd24d58a3da19b2b9a34e122afdb058ba5af2"
Jul 28 20:14:20.081484 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.081457    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"]
Jul 28 20:14:20.084917 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.084894    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-188d8c/test-model-188d8c-kserve-6fcfdd5b7c-2gd49"]
Jul 28 20:14:20.109191 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.109037    2563 scope.go:117] "RemoveContainer" containerID="eabfc29959ffb26c03b765a0f73cd24d58a3da19b2b9a34e122afdb058ba5af2"
Jul 28 20:14:20.109405 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:14:20.109384    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eabfc29959ffb26c03b765a0f73cd24d58a3da19b2b9a34e122afdb058ba5af2\": container with ID starting with eabfc29959ffb26c03b765a0f73cd24d58a3da19b2b9a34e122afdb058ba5af2 not found: ID does not exist" containerID="eabfc29959ffb26c03b765a0f73cd24d58a3da19b2b9a34e122afdb058ba5af2"
Jul 28 20:14:20.109459 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.109413    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eabfc29959ffb26c03b765a0f73cd24d58a3da19b2b9a34e122afdb058ba5af2"} err="failed to get container status \"eabfc29959ffb26c03b765a0f73cd24d58a3da19b2b9a34e122afdb058ba5af2\": rpc error: code = NotFound desc = could not find container \"eabfc29959ffb26c03b765a0f73cd24d58a3da19b2b9a34e122afdb058ba5af2\": container with ID starting with eabfc29959ffb26c03b765a0f73cd24d58a3da19b2b9a34e122afdb058ba5af2 not found: ID does not exist"
Jul 28 20:14:20.241010 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.240986    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:14:20.284609 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.284520    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-dshm\") pod \"48141f58-f112-4612-a2ad-b4a706b2d4de\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") "
Jul 28 20:14:20.284609 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.284573    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48141f58-f112-4612-a2ad-b4a706b2d4de-tls-certs\") pod \"48141f58-f112-4612-a2ad-b4a706b2d4de\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") "
Jul 28 20:14:20.284841 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.284625    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-model-cache\") pod \"48141f58-f112-4612-a2ad-b4a706b2d4de\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") "
Jul 28 20:14:20.284841 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.284649    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-tmp-dir\") pod \"48141f58-f112-4612-a2ad-b4a706b2d4de\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") "
Jul 28 20:14:20.284841 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.284687    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjxb9\" (UniqueName: \"kubernetes.io/projected/48141f58-f112-4612-a2ad-b4a706b2d4de-kube-api-access-zjxb9\") pod \"48141f58-f112-4612-a2ad-b4a706b2d4de\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") "
Jul 28 20:14:20.284841 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.284739    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-home\") pod \"48141f58-f112-4612-a2ad-b4a706b2d4de\" (UID: \"48141f58-f112-4612-a2ad-b4a706b2d4de\") "
Jul 28 20:14:20.285041 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.284863    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "48141f58-f112-4612-a2ad-b4a706b2d4de" (UID: "48141f58-f112-4612-a2ad-b4a706b2d4de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:20.285041 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.284880    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-model-cache" (OuterVolumeSpecName: "model-cache") pod "48141f58-f112-4612-a2ad-b4a706b2d4de" (UID: "48141f58-f112-4612-a2ad-b4a706b2d4de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:20.285041 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.285031    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-model-cache\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:20.285170 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.285052    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-tmp-dir\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:20.285170 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.285069    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-home" (OuterVolumeSpecName: "home") pod "48141f58-f112-4612-a2ad-b4a706b2d4de" (UID: "48141f58-f112-4612-a2ad-b4a706b2d4de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:20.286747 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.286725    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-dshm" (OuterVolumeSpecName: "dshm") pod "48141f58-f112-4612-a2ad-b4a706b2d4de" (UID: "48141f58-f112-4612-a2ad-b4a706b2d4de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:20.286861 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.286785    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48141f58-f112-4612-a2ad-b4a706b2d4de-kube-api-access-zjxb9" (OuterVolumeSpecName: "kube-api-access-zjxb9") pod "48141f58-f112-4612-a2ad-b4a706b2d4de" (UID: "48141f58-f112-4612-a2ad-b4a706b2d4de"). InnerVolumeSpecName "kube-api-access-zjxb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:14:20.287044 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.287028    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48141f58-f112-4612-a2ad-b4a706b2d4de-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "48141f58-f112-4612-a2ad-b4a706b2d4de" (UID: "48141f58-f112-4612-a2ad-b4a706b2d4de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:14:20.386231 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.386202    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjxb9\" (UniqueName: \"kubernetes.io/projected/48141f58-f112-4612-a2ad-b4a706b2d4de-kube-api-access-zjxb9\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:20.386231 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.386226    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-home\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:20.386231 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.386236    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48141f58-f112-4612-a2ad-b4a706b2d4de-dshm\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:20.386454 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:20.386245    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48141f58-f112-4612-a2ad-b4a706b2d4de-tls-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:21.065356 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:21.065320    2563 generic.go:356] "Generic (PLEG): container finished" podID="48141f58-f112-4612-a2ad-b4a706b2d4de" containerID="692ff19b29cbb30c7c1565cae98767fbdd99f71b1f976cb842d48f40d5d07999" exitCode=0
Jul 28 20:14:21.065557 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:21.065365    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"
Jul 28 20:14:21.065557 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:21.065384    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg" event={"ID":"48141f58-f112-4612-a2ad-b4a706b2d4de","Type":"ContainerDied","Data":"692ff19b29cbb30c7c1565cae98767fbdd99f71b1f976cb842d48f40d5d07999"}
Jul 28 20:14:21.065557 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:21.065422    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg" event={"ID":"48141f58-f112-4612-a2ad-b4a706b2d4de","Type":"ContainerDied","Data":"83a01e4aec5f4a5668149c4e1b2a2a6e703d263b5beb56a97434af8f29c74e74"}
Jul 28 20:14:21.065557 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:21.065445    2563 scope.go:117] "RemoveContainer" containerID="692ff19b29cbb30c7c1565cae98767fbdd99f71b1f976cb842d48f40d5d07999"
Jul 28 20:14:21.074661 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:21.074644    2563 scope.go:117] "RemoveContainer" containerID="692ff19b29cbb30c7c1565cae98767fbdd99f71b1f976cb842d48f40d5d07999"
Jul 28 20:14:21.074896 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:14:21.074874    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"692ff19b29cbb30c7c1565cae98767fbdd99f71b1f976cb842d48f40d5d07999\": container with ID starting with 692ff19b29cbb30c7c1565cae98767fbdd99f71b1f976cb842d48f40d5d07999 not found: ID does not exist" containerID="692ff19b29cbb30c7c1565cae98767fbdd99f71b1f976cb842d48f40d5d07999"
Jul 28 20:14:21.074956 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:21.074902    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"692ff19b29cbb30c7c1565cae98767fbdd99f71b1f976cb842d48f40d5d07999"} err="failed to get container status \"692ff19b29cbb30c7c1565cae98767fbdd99f71b1f976cb842d48f40d5d07999\": rpc error: code = NotFound desc = could not find container \"692ff19b29cbb30c7c1565cae98767fbdd99f71b1f976cb842d48f40d5d07999\": container with ID starting with 692ff19b29cbb30c7c1565cae98767fbdd99f71b1f976cb842d48f40d5d07999 not found: ID does not exist"
Jul 28 20:14:21.085776 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:21.085753    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"]
Jul 28 20:14:21.089801 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:21.089780    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-ba3d8d/test-model-ba3d8d-kserve-84b5768db9-5znwg"]
Jul 28 20:14:21.604599 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:21.604568    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc" path="/var/lib/kubelet/pods/1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc/volumes"
Jul 28 20:14:21.604960 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:21.604946    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48141f58-f112-4612-a2ad-b4a706b2d4de" path="/var/lib/kubelet/pods/48141f58-f112-4612-a2ad-b4a706b2d4de/volumes"
Jul 28 20:14:22.362136 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:22.362092    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"]
Jul 28 20:14:22.362583 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:22.362321    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x" podUID="470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" containerName="istio-proxy" containerID="cri-o://888e5c2e887ac10111b665cb787ba694d3a9577f02da41e73ccab3f50e4c9b37" gracePeriod=30
Jul 28 20:14:24.630226 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:24.630186    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:14:27.603071 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.603048    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:14:27.650819 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.650752    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-data\") pod \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") "
Jul 28 20:14:27.650819 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.650789    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istiod-ca-cert\") pod \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") "
Jul 28 20:14:27.651017 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.650850    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd8j6\" (UniqueName: \"kubernetes.io/projected/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-kube-api-access-dd8j6\") pod \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") "
Jul 28 20:14:27.651017 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.650883    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-token\") pod \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") "
Jul 28 20:14:27.651017 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.650902    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-envoy\") pod \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") "
Jul 28 20:14:27.651017 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.650917    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-podinfo\") pod \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") "
Jul 28 20:14:27.651017 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.650941    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-credential-socket\") pod \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") "
Jul 28 20:14:27.651017 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.650989    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-workload-certs\") pod \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") "
Jul 28 20:14:27.651315 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.651020    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-workload-socket\") pod \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\" (UID: \"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a\") "
Jul 28 20:14:27.651387 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.651313    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" (UID: "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:14:27.651487 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.651466    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" (UID: "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:27.651567 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.651487    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" (UID: "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:27.651567 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.651560    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" (UID: "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:27.651716 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.651694    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-data" (OuterVolumeSpecName: "istio-data") pod "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" (UID: "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:27.653194 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.653162    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-token" (OuterVolumeSpecName: "istio-token") pod "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" (UID: "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:14:27.653325 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.653190    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" (UID: "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:14:27.653434 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.653416    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-kube-api-access-dd8j6" (OuterVolumeSpecName: "kube-api-access-dd8j6") pod "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" (UID: "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a"). InnerVolumeSpecName "kube-api-access-dd8j6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:14:27.653841 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.653820    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" (UID: "470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:14:27.752367 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.752317    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd8j6\" (UniqueName: \"kubernetes.io/projected/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-kube-api-access-dd8j6\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:27.752367 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.752363    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-token\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:27.752367 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.752374    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-envoy\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:27.752367 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.752382    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-podinfo\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:27.752679 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.752390    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-credential-socket\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:27.752679 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.752398    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-workload-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:27.752679 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.752406    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-workload-socket\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:27.752679 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.752413    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istio-data\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:27.752679 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:27.752421    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a-istiod-ca-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:14:28.101248 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:28.101217    2563 generic.go:356] "Generic (PLEG): container finished" podID="470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" containerID="888e5c2e887ac10111b665cb787ba694d3a9577f02da41e73ccab3f50e4c9b37" exitCode=0
Jul 28 20:14:28.101420 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:28.101260    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"
Jul 28 20:14:28.101420 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:28.101301    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x" event={"ID":"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a","Type":"ContainerDied","Data":"888e5c2e887ac10111b665cb787ba694d3a9577f02da41e73ccab3f50e4c9b37"}
Jul 28 20:14:28.101420 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:28.101355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x" event={"ID":"470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a","Type":"ContainerDied","Data":"57e91aaf533841bc42b2303f5ebc93c17f7bd4c68e714c84bc8f3864f625e953"}
Jul 28 20:14:28.101420 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:28.101378    2563 scope.go:117] "RemoveContainer" containerID="888e5c2e887ac10111b665cb787ba694d3a9577f02da41e73ccab3f50e4c9b37"
Jul 28 20:14:28.110320 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:28.110305    2563 scope.go:117] "RemoveContainer" containerID="59cae490dc60fd3c2f4a88c37b515865fbd70550cf7d30b8bf687d271ce6c79b"
Jul 28 20:14:28.118099 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:28.118080    2563 scope.go:117] "RemoveContainer" containerID="888e5c2e887ac10111b665cb787ba694d3a9577f02da41e73ccab3f50e4c9b37"
Jul 28 20:14:28.118352 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:14:28.118335    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"888e5c2e887ac10111b665cb787ba694d3a9577f02da41e73ccab3f50e4c9b37\": container with ID starting with 888e5c2e887ac10111b665cb787ba694d3a9577f02da41e73ccab3f50e4c9b37 not found: ID does not exist" containerID="888e5c2e887ac10111b665cb787ba694d3a9577f02da41e73ccab3f50e4c9b37"
Jul 28 20:14:28.118398 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:28.118362    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"888e5c2e887ac10111b665cb787ba694d3a9577f02da41e73ccab3f50e4c9b37"} err="failed to get container status \"888e5c2e887ac10111b665cb787ba694d3a9577f02da41e73ccab3f50e4c9b37\": rpc error: code = NotFound desc = could not find container \"888e5c2e887ac10111b665cb787ba694d3a9577f02da41e73ccab3f50e4c9b37\": container with ID starting with 888e5c2e887ac10111b665cb787ba694d3a9577f02da41e73ccab3f50e4c9b37 not found: ID does not exist"
Jul 28 20:14:28.118398 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:28.118379    2563 scope.go:117] "RemoveContainer" containerID="59cae490dc60fd3c2f4a88c37b515865fbd70550cf7d30b8bf687d271ce6c79b"
Jul 28 20:14:28.118624 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:14:28.118607    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59cae490dc60fd3c2f4a88c37b515865fbd70550cf7d30b8bf687d271ce6c79b\": container with ID starting with 59cae490dc60fd3c2f4a88c37b515865fbd70550cf7d30b8bf687d271ce6c79b not found: ID does not exist" containerID="59cae490dc60fd3c2f4a88c37b515865fbd70550cf7d30b8bf687d271ce6c79b"
Jul 28 20:14:28.118717 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:28.118627    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59cae490dc60fd3c2f4a88c37b515865fbd70550cf7d30b8bf687d271ce6c79b"} err="failed to get container status \"59cae490dc60fd3c2f4a88c37b515865fbd70550cf7d30b8bf687d271ce6c79b\": rpc error: code = NotFound desc = could not find container \"59cae490dc60fd3c2f4a88c37b515865fbd70550cf7d30b8bf687d271ce6c79b\": container with ID starting with 59cae490dc60fd3c2f4a88c37b515865fbd70550cf7d30b8bf687d271ce6c79b not found: ID does not exist"
Jul 28 20:14:28.124912 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:28.124889    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"]
Jul 28 20:14:28.131076 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:28.131055    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-188d8c-openshift-default-5dff4fd8db-xvb7x"]
Jul 28 20:14:29.604435 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:29.604403    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" path="/var/lib/kubelet/pods/470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a/volumes"
Jul 28 20:14:36.529926 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:36.529887    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:14:41.125627 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.125591    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"]
Jul 28 20:14:41.126024 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.125939    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc" containerName="main"
Jul 28 20:14:41.126024 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.125950    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc" containerName="main"
Jul 28 20:14:41.126024 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.125960    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" containerName="istio-proxy"
Jul 28 20:14:41.126024 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.125966    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" containerName="istio-proxy"
Jul 28 20:14:41.126024 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.125979    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48141f58-f112-4612-a2ad-b4a706b2d4de" containerName="main"
Jul 28 20:14:41.126024 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.125985    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="48141f58-f112-4612-a2ad-b4a706b2d4de" containerName="main"
Jul 28 20:14:41.126233 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.126042    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf34ad4-fa5a-4dd6-bdad-b4e2410258fc" containerName="main"
Jul 28 20:14:41.126233 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.126052    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="48141f58-f112-4612-a2ad-b4a706b2d4de" containerName="main"
Jul 28 20:14:41.126233 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.126059    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" containerName="istio-proxy"
Jul 28 20:14:41.126233 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.126065    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" containerName="istio-proxy"
Jul 28 20:14:41.130526 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.130510    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.133315 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.133296    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-6e8ba4-openshift-default-dockercfg-b72nf\""
Jul 28 20:14:41.140525 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.140499    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"]
Jul 28 20:14:41.264583 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.264524    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a226af06-0811-4b86-b456-fdfe2f8a190f-istiod-ca-cert\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.264773 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.264602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-workload-certs\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.264773 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.264625    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6xjk\" (UniqueName: \"kubernetes.io/projected/a226af06-0811-4b86-b456-fdfe2f8a190f-kube-api-access-p6xjk\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.264773 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.264645    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-podinfo\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.264773 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.264748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-data\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.264953 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.264789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-credential-socket\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.264953 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.264856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-workload-socket\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.264953 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.264890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-envoy\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.264953 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.264905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-token\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.365995 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.365953    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-workload-socket\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.365995 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.365991    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-envoy\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.366293 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.366012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-token\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.366293 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.366039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a226af06-0811-4b86-b456-fdfe2f8a190f-istiod-ca-cert\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.366293 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.366064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-workload-certs\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.366293 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.366081    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6xjk\" (UniqueName: \"kubernetes.io/projected/a226af06-0811-4b86-b456-fdfe2f8a190f-kube-api-access-p6xjk\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.366293 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.366109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-podinfo\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.366293 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.366167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-data\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.366293 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.366199    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-credential-socket\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.366702 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.366515    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-workload-socket\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.366702 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.366583    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-credential-socket\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.366809 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.366723    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-workload-certs\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.366915 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.366897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a226af06-0811-4b86-b456-fdfe2f8a190f-istiod-ca-cert\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.367059 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.367039    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-data\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.368486 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.368468    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-envoy\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.368815 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.368793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-podinfo\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.374160 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.374127    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-token\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.374258 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.374225    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6xjk\" (UniqueName: \"kubernetes.io/projected/a226af06-0811-4b86-b456-fdfe2f8a190f-kube-api-access-p6xjk\") pod \"e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") " pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.441535 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.441466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:41.577149 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.577125    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"]
Jul 28 20:14:41.579656 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:14:41.579630    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda226af06_0811_4b86_b456_fdfe2f8a190f.slice/crio-f34e7bac321fb8ccc8f59dd50f8994e20efdc441c70c319b3d7173bd06310316 WatchSource:0}: Error finding container f34e7bac321fb8ccc8f59dd50f8994e20efdc441c70c319b3d7173bd06310316: Status 404 returned error can't find the container with id f34e7bac321fb8ccc8f59dd50f8994e20efdc441c70c319b3d7173bd06310316
Jul 28 20:14:41.581932 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.581894    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:14:41.582014 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.581962    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:14:41.582014 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:41.581991    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:14:42.179962 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:42.179930    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69" event={"ID":"a226af06-0811-4b86-b456-fdfe2f8a190f","Type":"ContainerStarted","Data":"1e740898f0195e50ff7d1bae547692980ed84d47914fc51de5fc43504f97e3ab"}
Jul 28 20:14:42.180326 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:42.179977    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69" event={"ID":"a226af06-0811-4b86-b456-fdfe2f8a190f","Type":"ContainerStarted","Data":"f34e7bac321fb8ccc8f59dd50f8994e20efdc441c70c319b3d7173bd06310316"}
Jul 28 20:14:42.201596 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:42.201530    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69" podStartSLOduration=1.201512862 podStartE2EDuration="1.201512862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:14:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:14:42.19969081 +0000 UTC m=+2367.221986397" watchObservedRunningTime="2026-07-28 20:14:42.201512862 +0000 UTC m=+2367.223808450"
Jul 28 20:14:42.442342 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:42.442248    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:42.447152 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:42.447125    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:43.184896 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:43.184867    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:43.185737 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:43.185712    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:14:50.823688 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:50.823654    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:14:58.530737 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:58.530686    2563 patch_prober.go:28] interesting pod/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:34512->10.133.0.46:15021: read: connection reset by peer" start-of-body=
Jul 28 20:14:58.531229 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:58.530768    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69" podUID="a226af06-0811-4b86-b456-fdfe2f8a190f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:34512->10.133.0.46:15021: read: connection reset by peer"
Jul 28 20:14:59.264811 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:59.264772    2563 generic.go:356] "Generic (PLEG): container finished" podID="a226af06-0811-4b86-b456-fdfe2f8a190f" containerID="1e740898f0195e50ff7d1bae547692980ed84d47914fc51de5fc43504f97e3ab" exitCode=0
Jul 28 20:14:59.264994 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:59.264826    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69" event={"ID":"a226af06-0811-4b86-b456-fdfe2f8a190f","Type":"ContainerDied","Data":"1e740898f0195e50ff7d1bae547692980ed84d47914fc51de5fc43504f97e3ab"}
Jul 28 20:14:59.265202 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:59.265189    2563 scope.go:117] "RemoveContainer" containerID="1e740898f0195e50ff7d1bae547692980ed84d47914fc51de5fc43504f97e3ab"
Jul 28 20:14:59.266178 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:59.266145    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:14:59.266270 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:59.266234    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:14:59.266337 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:14:59.266284    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:15:00.285576 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:15:00.285520    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69" event={"ID":"a226af06-0811-4b86-b456-fdfe2f8a190f","Type":"ContainerStarted","Data":"a9dacf848b054d638e3f8b8206e555814de084a91f6652c5676ce16109f965cd"}
Jul 28 20:15:00.442736 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:15:00.442697    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:15:00.442966 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:15:00.442943    2563 patch_prober.go:28] interesting pod/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 28 20:15:00.443011 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:15:00.442991    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69" podUID="a226af06-0811-4b86-b456-fdfe2f8a190f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 28 20:15:01.442533 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:15:01.442495    2563 patch_prober.go:28] interesting pod/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 28 20:15:01.442937 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:15:01.442584    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69" podUID="a226af06-0811-4b86-b456-fdfe2f8a190f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 28 20:15:02.442553 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:15:02.442496    2563 patch_prober.go:28] interesting pod/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 28 20:15:02.442936 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:15:02.442573    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69" podUID="a226af06-0811-4b86-b456-fdfe2f8a190f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 28 20:15:03.442328 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:15:03.442291    2563 patch_prober.go:28] interesting pod/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 28 20:15:03.442517 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:15:03.442355    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69" podUID="a226af06-0811-4b86-b456-fdfe2f8a190f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 28 20:15:04.445611 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:15:04.445580    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:15:04.445987 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:15:04.445829    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:15:04.446418 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:15:04.446396    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:15:21.625802 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:15:21.625770    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:15:59.637981 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:15:59.637945    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:16:03.837557 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:03.837512    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"]
Jul 28 20:16:03.838016 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:03.837789    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69" podUID="a226af06-0811-4b86-b456-fdfe2f8a190f" containerName="istio-proxy" containerID="cri-o://a9dacf848b054d638e3f8b8206e555814de084a91f6652c5676ce16109f965cd" gracePeriod=30
Jul 28 20:16:04.448612 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:04.448576    2563 patch_prober.go:28] interesting pod/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 20:16:04.448779 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:04.448646    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69" podUID="a226af06-0811-4b86-b456-fdfe2f8a190f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 20:16:09.082943 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.082921    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:16:09.139327 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139254    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-data\") pod \"a226af06-0811-4b86-b456-fdfe2f8a190f\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") "
Jul 28 20:16:09.139327 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139294    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-credential-socket\") pod \"a226af06-0811-4b86-b456-fdfe2f8a190f\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") "
Jul 28 20:16:09.139499 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139339    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6xjk\" (UniqueName: \"kubernetes.io/projected/a226af06-0811-4b86-b456-fdfe2f8a190f-kube-api-access-p6xjk\") pod \"a226af06-0811-4b86-b456-fdfe2f8a190f\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") "
Jul 28 20:16:09.139499 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139360    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-workload-certs\") pod \"a226af06-0811-4b86-b456-fdfe2f8a190f\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") "
Jul 28 20:16:09.139499 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139377    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-workload-socket\") pod \"a226af06-0811-4b86-b456-fdfe2f8a190f\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") "
Jul 28 20:16:09.139499 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139451    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-podinfo\") pod \"a226af06-0811-4b86-b456-fdfe2f8a190f\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") "
Jul 28 20:16:09.139499 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139491    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a226af06-0811-4b86-b456-fdfe2f8a190f-istiod-ca-cert\") pod \"a226af06-0811-4b86-b456-fdfe2f8a190f\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") "
Jul 28 20:16:09.139780 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139514    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-token\") pod \"a226af06-0811-4b86-b456-fdfe2f8a190f\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") "
Jul 28 20:16:09.139780 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139558    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-envoy\") pod \"a226af06-0811-4b86-b456-fdfe2f8a190f\" (UID: \"a226af06-0811-4b86-b456-fdfe2f8a190f\") "
Jul 28 20:16:09.139780 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139666    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a226af06-0811-4b86-b456-fdfe2f8a190f" (UID: "a226af06-0811-4b86-b456-fdfe2f8a190f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:16:09.139780 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139696    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a226af06-0811-4b86-b456-fdfe2f8a190f" (UID: "a226af06-0811-4b86-b456-fdfe2f8a190f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:16:09.139992 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139800    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a226af06-0811-4b86-b456-fdfe2f8a190f" (UID: "a226af06-0811-4b86-b456-fdfe2f8a190f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:16:09.139992 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139906    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-credential-socket\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:16:09.139992 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139924    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-workload-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:16:09.139992 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139934    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-workload-socket\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:16:09.139992 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.139947    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a226af06-0811-4b86-b456-fdfe2f8a190f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a226af06-0811-4b86-b456-fdfe2f8a190f" (UID: "a226af06-0811-4b86-b456-fdfe2f8a190f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:16:09.140225 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.140087    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-data" (OuterVolumeSpecName: "istio-data") pod "a226af06-0811-4b86-b456-fdfe2f8a190f" (UID: "a226af06-0811-4b86-b456-fdfe2f8a190f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:16:09.141482 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.141460    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a226af06-0811-4b86-b456-fdfe2f8a190f-kube-api-access-p6xjk" (OuterVolumeSpecName: "kube-api-access-p6xjk") pod "a226af06-0811-4b86-b456-fdfe2f8a190f" (UID: "a226af06-0811-4b86-b456-fdfe2f8a190f"). InnerVolumeSpecName "kube-api-access-p6xjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:16:09.141843 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.141825    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-token" (OuterVolumeSpecName: "istio-token") pod "a226af06-0811-4b86-b456-fdfe2f8a190f" (UID: "a226af06-0811-4b86-b456-fdfe2f8a190f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:16:09.141983 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.141959    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a226af06-0811-4b86-b456-fdfe2f8a190f" (UID: "a226af06-0811-4b86-b456-fdfe2f8a190f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:16:09.142110 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.141980    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a226af06-0811-4b86-b456-fdfe2f8a190f" (UID: "a226af06-0811-4b86-b456-fdfe2f8a190f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:16:09.240597 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.240571    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-data\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:16:09.240597 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.240595    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6xjk\" (UniqueName: \"kubernetes.io/projected/a226af06-0811-4b86-b456-fdfe2f8a190f-kube-api-access-p6xjk\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:16:09.240597 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.240604    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-podinfo\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:16:09.240849 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.240613    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a226af06-0811-4b86-b456-fdfe2f8a190f-istiod-ca-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:16:09.240849 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.240621    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-token\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:16:09.240849 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.240628    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a226af06-0811-4b86-b456-fdfe2f8a190f-istio-envoy\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:16:09.631945 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.631913    2563 generic.go:356] "Generic (PLEG): container finished" podID="a226af06-0811-4b86-b456-fdfe2f8a190f" containerID="a9dacf848b054d638e3f8b8206e555814de084a91f6652c5676ce16109f965cd" exitCode=0
Jul 28 20:16:09.632074 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.631971    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"
Jul 28 20:16:09.632074 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.631975    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69" event={"ID":"a226af06-0811-4b86-b456-fdfe2f8a190f","Type":"ContainerDied","Data":"a9dacf848b054d638e3f8b8206e555814de084a91f6652c5676ce16109f965cd"}
Jul 28 20:16:09.632147 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.632085    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69" event={"ID":"a226af06-0811-4b86-b456-fdfe2f8a190f","Type":"ContainerDied","Data":"f34e7bac321fb8ccc8f59dd50f8994e20efdc441c70c319b3d7173bd06310316"}
Jul 28 20:16:09.632147 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.632104    2563 scope.go:117] "RemoveContainer" containerID="a9dacf848b054d638e3f8b8206e555814de084a91f6652c5676ce16109f965cd"
Jul 28 20:16:09.640644 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.640613    2563 scope.go:117] "RemoveContainer" containerID="1e740898f0195e50ff7d1bae547692980ed84d47914fc51de5fc43504f97e3ab"
Jul 28 20:16:09.648849 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.648725    2563 scope.go:117] "RemoveContainer" containerID="a9dacf848b054d638e3f8b8206e555814de084a91f6652c5676ce16109f965cd"
Jul 28 20:16:09.649130 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:16:09.649105    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9dacf848b054d638e3f8b8206e555814de084a91f6652c5676ce16109f965cd\": container with ID starting with a9dacf848b054d638e3f8b8206e555814de084a91f6652c5676ce16109f965cd not found: ID does not exist" containerID="a9dacf848b054d638e3f8b8206e555814de084a91f6652c5676ce16109f965cd"
Jul 28 20:16:09.649229 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.649151    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9dacf848b054d638e3f8b8206e555814de084a91f6652c5676ce16109f965cd"} err="failed to get container status \"a9dacf848b054d638e3f8b8206e555814de084a91f6652c5676ce16109f965cd\": rpc error: code = NotFound desc = could not find container \"a9dacf848b054d638e3f8b8206e555814de084a91f6652c5676ce16109f965cd\": container with ID starting with a9dacf848b054d638e3f8b8206e555814de084a91f6652c5676ce16109f965cd not found: ID does not exist"
Jul 28 20:16:09.649229 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.649174    2563 scope.go:117] "RemoveContainer" containerID="1e740898f0195e50ff7d1bae547692980ed84d47914fc51de5fc43504f97e3ab"
Jul 28 20:16:09.649500 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:16:09.649470    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e740898f0195e50ff7d1bae547692980ed84d47914fc51de5fc43504f97e3ab\": container with ID starting with 1e740898f0195e50ff7d1bae547692980ed84d47914fc51de5fc43504f97e3ab not found: ID does not exist" containerID="1e740898f0195e50ff7d1bae547692980ed84d47914fc51de5fc43504f97e3ab"
Jul 28 20:16:09.649618 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.649507    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e740898f0195e50ff7d1bae547692980ed84d47914fc51de5fc43504f97e3ab"} err="failed to get container status \"1e740898f0195e50ff7d1bae547692980ed84d47914fc51de5fc43504f97e3ab\": rpc error: code = NotFound desc = could not find container \"1e740898f0195e50ff7d1bae547692980ed84d47914fc51de5fc43504f97e3ab\": container with ID starting with 1e740898f0195e50ff7d1bae547692980ed84d47914fc51de5fc43504f97e3ab not found: ID does not exist"
Jul 28 20:16:09.651119 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.651099    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"]
Jul 28 20:16:09.655029 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:09.655008    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-6e8ba4-openshift-default-65bfbff7bd-hpm69"]
Jul 28 20:16:11.603849 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:11.603821    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a226af06-0811-4b86-b456-fdfe2f8a190f" path="/var/lib/kubelet/pods/a226af06-0811-4b86-b456-fdfe2f8a190f/volumes"
Jul 28 20:16:17.920402 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:17.920370    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:16:21.151606 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.151575    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"]
Jul 28 20:16:21.151961 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.151889    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a226af06-0811-4b86-b456-fdfe2f8a190f" containerName="istio-proxy"
Jul 28 20:16:21.151961 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.151900    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a226af06-0811-4b86-b456-fdfe2f8a190f" containerName="istio-proxy"
Jul 28 20:16:21.151961 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.151911    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a226af06-0811-4b86-b456-fdfe2f8a190f" containerName="istio-proxy"
Jul 28 20:16:21.151961 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.151917    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a226af06-0811-4b86-b456-fdfe2f8a190f" containerName="istio-proxy"
Jul 28 20:16:21.151961 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.151930    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" containerName="istio-proxy"
Jul 28 20:16:21.151961 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.151936    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="470fb9a9-c3e3-4737-abd2-5fdd7f31fb3a" containerName="istio-proxy"
Jul 28 20:16:21.152155 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.151985    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a226af06-0811-4b86-b456-fdfe2f8a190f" containerName="istio-proxy"
Jul 28 20:16:21.152155 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.151993    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a226af06-0811-4b86-b456-fdfe2f8a190f" containerName="istio-proxy"
Jul 28 20:16:21.153863 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.153848    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.156308 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.156289    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-bd928b-openshift-default-dockercfg-6rck2\""
Jul 28 20:16:21.165877 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.165854    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"]
Jul 28 20:16:21.242391 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.242360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8de5642b-3d88-4a3c-b239-d63024aacc98-istiod-ca-cert\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.242581 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.242397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-credential-socket\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.242581 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.242419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blbxn\" (UniqueName: \"kubernetes.io/projected/8de5642b-3d88-4a3c-b239-d63024aacc98-kube-api-access-blbxn\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.242581 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.242494    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-workload-socket\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.242723 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.242588    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-data\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.242723 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.242605    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-token\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.242723 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.242633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-envoy\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.242723 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.242698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-workload-certs\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.242858 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.242723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-podinfo\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.343834 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.343803    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8de5642b-3d88-4a3c-b239-d63024aacc98-istiod-ca-cert\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.343834 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.343838    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-credential-socket\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.344104 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.343861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blbxn\" (UniqueName: \"kubernetes.io/projected/8de5642b-3d88-4a3c-b239-d63024aacc98-kube-api-access-blbxn\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.344104 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.343992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-workload-socket\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.344104 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.344043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-data\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.344104 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.344073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-token\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.344321 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.344118    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-envoy\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.344321 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.344165    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-workload-certs\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.344321 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.344197    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-podinfo\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.344321 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.344204    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-credential-socket\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.344521 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.344339    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-workload-socket\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.344521 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.344382    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-data\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.344648 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.344579    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8de5642b-3d88-4a3c-b239-d63024aacc98-istiod-ca-cert\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.344648 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.344598    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-workload-certs\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.346431 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.346406    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-envoy\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.346646 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.346627    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-podinfo\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.351866 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.351846    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blbxn\" (UniqueName: \"kubernetes.io/projected/8de5642b-3d88-4a3c-b239-d63024aacc98-kube-api-access-blbxn\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.351974 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.351956    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-token\") pod \"e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") " pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.464186 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.464111    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:21.596288 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.596258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"]
Jul 28 20:16:21.597482 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:16:21.597451    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8de5642b_3d88_4a3c_b239_d63024aacc98.slice/crio-a60eb21c80e54b549b0f31fb33b19300c7b962f720aaac709f85c6e95ea8c044 WatchSource:0}: Error finding container a60eb21c80e54b549b0f31fb33b19300c7b962f720aaac709f85c6e95ea8c044: Status 404 returned error can't find the container with id a60eb21c80e54b549b0f31fb33b19300c7b962f720aaac709f85c6e95ea8c044
Jul 28 20:16:21.599605 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.599561    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:16:21.599725 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.599644    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:16:21.599725 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.599685    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:16:21.706606 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.706572    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb" event={"ID":"8de5642b-3d88-4a3c-b239-d63024aacc98","Type":"ContainerStarted","Data":"a9d6838dbc446ee75e67bf364975fd568f12438fcc44c0326908f000e9c5b1c9"}
Jul 28 20:16:21.706771 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.706629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb" event={"ID":"8de5642b-3d88-4a3c-b239-d63024aacc98","Type":"ContainerStarted","Data":"a60eb21c80e54b549b0f31fb33b19300c7b962f720aaac709f85c6e95ea8c044"}
Jul 28 20:16:21.729433 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:21.729327    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb" podStartSLOduration=0.729305217 podStartE2EDuration="729.305217ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:16:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:16:21.728962595 +0000 UTC m=+2466.751258186" watchObservedRunningTime="2026-07-28 20:16:21.729305217 +0000 UTC m=+2466.751600804"
Jul 28 20:16:22.464951 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:22.464901    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:22.469882 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:22.469857    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:22.711486 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:22.711452    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:22.712249 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:22.712230    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:29.030631 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:29.030594    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:16:37.713617 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:37.713576    2563 patch_prober.go:28] interesting pod/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 28 20:16:37.714053 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:37.713642    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb" podUID="8de5642b-3d88-4a3c-b239-d63024aacc98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 28 20:16:37.791687 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:37.791650    2563 generic.go:356] "Generic (PLEG): container finished" podID="8de5642b-3d88-4a3c-b239-d63024aacc98" containerID="a9d6838dbc446ee75e67bf364975fd568f12438fcc44c0326908f000e9c5b1c9" exitCode=0
Jul 28 20:16:37.791862 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:37.791722    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb" event={"ID":"8de5642b-3d88-4a3c-b239-d63024aacc98","Type":"ContainerDied","Data":"a9d6838dbc446ee75e67bf364975fd568f12438fcc44c0326908f000e9c5b1c9"}
Jul 28 20:16:37.792099 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:37.792085    2563 scope.go:117] "RemoveContainer" containerID="a9d6838dbc446ee75e67bf364975fd568f12438fcc44c0326908f000e9c5b1c9"
Jul 28 20:16:37.793160 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:37.793129    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:16:37.793242 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:37.793200    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:16:37.793242 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:37.793229    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:16:38.799332 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:38.799301    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb" event={"ID":"8de5642b-3d88-4a3c-b239-d63024aacc98","Type":"ContainerStarted","Data":"e9e71a08723950fbaf58f9720274c1b62abfa4cd99315eeed3073ac629a9cd3c"}
Jul 28 20:16:39.464584 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:39.464534    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:39.464907 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:39.464878    2563 patch_prober.go:28] interesting pod/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 28 20:16:39.465009 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:39.464961    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb" podUID="8de5642b-3d88-4a3c-b239-d63024aacc98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 28 20:16:40.465577 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:40.465515    2563 patch_prober.go:28] interesting pod/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 28 20:16:40.466076 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:40.465623    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb" podUID="8de5642b-3d88-4a3c-b239-d63024aacc98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 28 20:16:41.465381 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:41.465339    2563 patch_prober.go:28] interesting pod/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 28 20:16:41.465720 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:41.465686    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb" podUID="8de5642b-3d88-4a3c-b239-d63024aacc98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 28 20:16:42.464723 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:42.464684    2563 patch_prober.go:28] interesting pod/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 28 20:16:42.465026 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:42.464995    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb" podUID="8de5642b-3d88-4a3c-b239-d63024aacc98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 28 20:16:43.469249 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:43.469211    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:43.469643 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:43.469464    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:16:43.470194 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:16:43.470180    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:17:00.623826 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:00.623775    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:17:23.840464 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:23.840386    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"]
Jul 28 20:17:23.842928 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:23.842910    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:23.846335 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:23.846315    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bd928b\"/\"auth-test-model-bd928b-kserve-self-signed-certs\""
Jul 28 20:17:23.846456 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:23.846350    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bd928b\"/\"default-dockercfg-slk5d\""
Jul 28 20:17:23.846456 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:23.846448    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bd928b\"/\"kube-root-ca.crt\""
Jul 28 20:17:23.846604 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:23.846510    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bd928b\"/\"openshift-service-ca.crt\""
Jul 28 20:17:23.851979 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:23.851954    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"]
Jul 28 20:17:23.982856 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:23.982822    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60ab643f-2665-4e6a-bfc5-22f83d932670-tls-certs\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:23.982856 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:23.982861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rg9n\" (UniqueName: \"kubernetes.io/projected/60ab643f-2665-4e6a-bfc5-22f83d932670-kube-api-access-9rg9n\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:23.983088 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:23.982883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-tmp-dir\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:23.983088 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:23.982962    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-model-cache\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:23.983088 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:23.983029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-home\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:23.983088 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:23.983061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-dshm\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:24.084250 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:24.084214    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60ab643f-2665-4e6a-bfc5-22f83d932670-tls-certs\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:24.084250 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:24.084256    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rg9n\" (UniqueName: \"kubernetes.io/projected/60ab643f-2665-4e6a-bfc5-22f83d932670-kube-api-access-9rg9n\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:24.084560 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:24.084278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-tmp-dir\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:24.084560 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:24.084302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-model-cache\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:24.084560 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:24.084333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-home\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:24.084560 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:24.084349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-dshm\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:24.084818 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:24.084796    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-model-cache\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:24.084888 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:24.084860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-tmp-dir\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:24.084940 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:24.084883    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-home\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:24.086666 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:24.086648    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-dshm\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:24.086737 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:24.086720    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60ab643f-2665-4e6a-bfc5-22f83d932670-tls-certs\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:24.092019 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:24.091968    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rg9n\" (UniqueName: \"kubernetes.io/projected/60ab643f-2665-4e6a-bfc5-22f83d932670-kube-api-access-9rg9n\") pod \"auth-test-model-bd928b-kserve-7675cf9679-ds8wh\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") " pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:24.153172 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:24.153083    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:24.283962 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:24.283934    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"]
Jul 28 20:17:24.285434 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:17:24.285407    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60ab643f_2665_4e6a_bfc5_22f83d932670.slice/crio-1cdb2b63619be1ff1f943361965c0836013545e4f6ed5f46a69c641115246e57 WatchSource:0}: Error finding container 1cdb2b63619be1ff1f943361965c0836013545e4f6ed5f46a69c641115246e57: Status 404 returned error can't find the container with id 1cdb2b63619be1ff1f943361965c0836013545e4f6ed5f46a69c641115246e57
Jul 28 20:17:25.027091 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:25.027056    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh" event={"ID":"60ab643f-2665-4e6a-bfc5-22f83d932670","Type":"ContainerStarted","Data":"1e13b23485c586f39846b73f1c2aafdcd4109cc001031b3216dcb4b12b8dfda6"}
Jul 28 20:17:25.027091 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:25.027096    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh" event={"ID":"60ab643f-2665-4e6a-bfc5-22f83d932670","Type":"ContainerStarted","Data":"1cdb2b63619be1ff1f943361965c0836013545e4f6ed5f46a69c641115246e57"}
Jul 28 20:17:25.044412 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:25.044360    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh" podStartSLOduration=2.044344009 podStartE2EDuration="2.044344009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:17:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:17:25.042333135 +0000 UTC m=+2530.064628748" watchObservedRunningTime="2026-07-28 20:17:25.044344009 +0000 UTC m=+2530.066639574"
Jul 28 20:17:27.233404 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:27.233365    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:17:34.153220 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:34.153185    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:34.153666 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:34.153235    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:34.165647 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:34.165626    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:35.086582 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:35.086530    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:17:48.655259 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.655215    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"]
Jul 28 20:17:48.657905 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.657889    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.661846 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.661813    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-60efb4\"/\"openshift-service-ca.crt\""
Jul 28 20:17:48.661846 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.661848    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-60efb4\"/\"default-dockercfg-fmvgp\""
Jul 28 20:17:48.662053 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.661852    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-60efb4\"/\"auth-test-model-60efb4-kserve-self-signed-certs\""
Jul 28 20:17:48.662053 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.661882    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-60efb4\"/\"kube-root-ca.crt\""
Jul 28 20:17:48.668535 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.668513    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"]
Jul 28 20:17:48.678239 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.678217    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-tmp-dir\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.678361 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.678246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-model-cache\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.678361 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.678274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-dshm\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.678361 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.678311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-home\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.678361 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.678357    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5624x\" (UniqueName: \"kubernetes.io/projected/fa68b6fa-54f5-4f69-86d6-01aa67743b89-kube-api-access-5624x\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.678626 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.678404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa68b6fa-54f5-4f69-86d6-01aa67743b89-tls-certs\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.779762 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.779720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-tmp-dir\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.779762 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.779768    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-model-cache\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.780012 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.779898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-dshm\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.780012 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.779973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-home\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.780089 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.780017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5624x\" (UniqueName: \"kubernetes.io/projected/fa68b6fa-54f5-4f69-86d6-01aa67743b89-kube-api-access-5624x\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.780139 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.780092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa68b6fa-54f5-4f69-86d6-01aa67743b89-tls-certs\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.780242 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.780225    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-tmp-dir\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.780296 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.780255    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-model-cache\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.780338 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.780316    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-home\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.782161 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.782139    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-dshm\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.782430 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.782414    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa68b6fa-54f5-4f69-86d6-01aa67743b89-tls-certs\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.789900 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.789879    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5624x\" (UniqueName: \"kubernetes.io/projected/fa68b6fa-54f5-4f69-86d6-01aa67743b89-kube-api-access-5624x\") pod \"auth-test-model-60efb4-kserve-6b98785f5-cnm2p\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") " pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:48.968842 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:48.968741    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:49.096571 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:49.096529    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"]
Jul 28 20:17:49.098220 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:17:49.098192    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa68b6fa_54f5_4f69_86d6_01aa67743b89.slice/crio-33a094811526d7f496bea2d9eff9f590003c922c18dd6b1b8a32f5f220f26438 WatchSource:0}: Error finding container 33a094811526d7f496bea2d9eff9f590003c922c18dd6b1b8a32f5f220f26438: Status 404 returned error can't find the container with id 33a094811526d7f496bea2d9eff9f590003c922c18dd6b1b8a32f5f220f26438
Jul 28 20:17:49.148275 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:49.148242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p" event={"ID":"fa68b6fa-54f5-4f69-86d6-01aa67743b89","Type":"ContainerStarted","Data":"33a094811526d7f496bea2d9eff9f590003c922c18dd6b1b8a32f5f220f26438"}
Jul 28 20:17:50.155494 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:50.155459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p" event={"ID":"fa68b6fa-54f5-4f69-86d6-01aa67743b89","Type":"ContainerStarted","Data":"04357f909ac3603a15c9cfa2675679f08a7a3e090f901edeac4f6a59297357f4"}
Jul 28 20:17:50.173124 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:50.173074    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p" podStartSLOduration=2.173059965 podStartE2EDuration="2.173059965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:17:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:17:50.172433678 +0000 UTC m=+2555.194729266" watchObservedRunningTime="2026-07-28 20:17:50.173059965 +0000 UTC m=+2555.195355553"
Jul 28 20:17:52.132495 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:52.132458    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:17:58.969354 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:58.969305    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:58.969905 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:58.969373    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:58.981847 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:58.981823    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:17:59.211759 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:17:59.211731    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:18:19.026435 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:18:19.026395    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:18:40.336792 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:18:40.336710    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:18:58.133569 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:18:58.133520    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:19:25.523130 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:19:25.523096    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:19:39.127917 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:19:39.127881    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:20:00.018424 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:20:00.018387    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:20:18.230804 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:20:18.230722    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:20:40.229819 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:20:40.229787    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:20:58.238556 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:20:58.238503    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:21:25.626295 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:21:25.626263    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:21:43.624308 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:21:43.624273    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:22:10.931769 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:10.931733    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:22:14.219245 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:14.219210    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"]
Jul 28 20:22:15.054807 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:15.054774    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"]
Jul 28 20:22:24.855120 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:24.855086    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"]
Jul 28 20:22:24.857582 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:24.857563    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:24.860130 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:24.860110    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bd928b\"/\"sub-test-model-bd928b-kserve-self-signed-certs\""
Jul 28 20:22:24.868182 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:24.868159    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"]
Jul 28 20:22:24.994586 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:24.994534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-model-cache\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:24.994586 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:24.994585    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-dshm\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:24.994813 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:24.994654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-tmp-dir\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:24.994813 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:24.994681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zww6h\" (UniqueName: \"kubernetes.io/projected/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-kube-api-access-zww6h\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:24.994813 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:24.994704    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-tls-certs\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:24.994813 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:24.994736    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-home\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:25.095576 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.095532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-model-cache\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:25.095576 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.095578    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-dshm\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:25.095819 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.095746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-tmp-dir\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:25.095819 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.095777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zww6h\" (UniqueName: \"kubernetes.io/projected/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-kube-api-access-zww6h\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:25.095819 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.095800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-tls-certs\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:25.095994 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.095932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-home\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:25.096053 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.096005    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-model-cache\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:25.096103 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.096051    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-tmp-dir\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:25.096241 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.096226    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-home\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:25.097728 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.097711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-dshm\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:25.098094 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.098080    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-tls-certs\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:25.105088 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.105065    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zww6h\" (UniqueName: \"kubernetes.io/projected/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-kube-api-access-zww6h\") pod \"sub-test-model-bd928b-kserve-9b9cb485c-9mmjn\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") " pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:25.167439 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.167367    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:25.309657 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.309631    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"]
Jul 28 20:22:25.310759 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:22:25.310731    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e3017ec_4f5c_4e84_a623_ade8cf53fc76.slice/crio-d5d7b256808943a7b68a9e0e8ffc6499ff344aee525234cf60078aec8147badf WatchSource:0}: Error finding container d5d7b256808943a7b68a9e0e8ffc6499ff344aee525234cf60078aec8147badf: Status 404 returned error can't find the container with id d5d7b256808943a7b68a9e0e8ffc6499ff344aee525234cf60078aec8147badf
Jul 28 20:22:25.549678 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.549648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn" event={"ID":"3e3017ec-4f5c-4e84-a623-ade8cf53fc76","Type":"ContainerStarted","Data":"e9016746c9d3a558bfa5fc266f6df836ddd16531277e8d6dea056fccacba5d9e"}
Jul 28 20:22:25.549678 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.549685    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn" event={"ID":"3e3017ec-4f5c-4e84-a623-ade8cf53fc76","Type":"ContainerStarted","Data":"d5d7b256808943a7b68a9e0e8ffc6499ff344aee525234cf60078aec8147badf"}
Jul 28 20:22:25.583294 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:25.583246    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn" podStartSLOduration=1.583232296 podStartE2EDuration="1.583232296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:22:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:22:25.580882219 +0000 UTC m=+2830.603177799" watchObservedRunningTime="2026-07-28 20:22:25.583232296 +0000 UTC m=+2830.605527884"
Jul 28 20:22:27.523840 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:27.523803    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:22:29.237933 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.237895    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh" podUID="60ab643f-2665-4e6a-bfc5-22f83d932670" containerName="main" containerID="cri-o://1e13b23485c586f39846b73f1c2aafdcd4109cc001031b3216dcb4b12b8dfda6" gracePeriod=45
Jul 28 20:22:29.482687 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.482665    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:22:29.534179 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.534155    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-home\") pod \"60ab643f-2665-4e6a-bfc5-22f83d932670\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") "
Jul 28 20:22:29.534355 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.534242    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-dshm\") pod \"60ab643f-2665-4e6a-bfc5-22f83d932670\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") "
Jul 28 20:22:29.534355 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.534266    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-tmp-dir\") pod \"60ab643f-2665-4e6a-bfc5-22f83d932670\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") "
Jul 28 20:22:29.534355 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.534290    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rg9n\" (UniqueName: \"kubernetes.io/projected/60ab643f-2665-4e6a-bfc5-22f83d932670-kube-api-access-9rg9n\") pod \"60ab643f-2665-4e6a-bfc5-22f83d932670\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") "
Jul 28 20:22:29.534355 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.534314    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-model-cache\") pod \"60ab643f-2665-4e6a-bfc5-22f83d932670\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") "
Jul 28 20:22:29.534355 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.534349    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60ab643f-2665-4e6a-bfc5-22f83d932670-tls-certs\") pod \"60ab643f-2665-4e6a-bfc5-22f83d932670\" (UID: \"60ab643f-2665-4e6a-bfc5-22f83d932670\") "
Jul 28 20:22:29.534648 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.534455    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-home" (OuterVolumeSpecName: "home") pod "60ab643f-2665-4e6a-bfc5-22f83d932670" (UID: "60ab643f-2665-4e6a-bfc5-22f83d932670"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:22:29.534648 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.534585    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "60ab643f-2665-4e6a-bfc5-22f83d932670" (UID: "60ab643f-2665-4e6a-bfc5-22f83d932670"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:22:29.534759 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.534642    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-model-cache" (OuterVolumeSpecName: "model-cache") pod "60ab643f-2665-4e6a-bfc5-22f83d932670" (UID: "60ab643f-2665-4e6a-bfc5-22f83d932670"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:22:29.534759 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.534676    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-home\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:22:29.534759 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.534694    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-tmp-dir\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:22:29.536611 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.536581    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60ab643f-2665-4e6a-bfc5-22f83d932670-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "60ab643f-2665-4e6a-bfc5-22f83d932670" (UID: "60ab643f-2665-4e6a-bfc5-22f83d932670"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:22:29.536712 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.536655    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-dshm" (OuterVolumeSpecName: "dshm") pod "60ab643f-2665-4e6a-bfc5-22f83d932670" (UID: "60ab643f-2665-4e6a-bfc5-22f83d932670"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:22:29.536712 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.536656    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60ab643f-2665-4e6a-bfc5-22f83d932670-kube-api-access-9rg9n" (OuterVolumeSpecName: "kube-api-access-9rg9n") pod "60ab643f-2665-4e6a-bfc5-22f83d932670" (UID: "60ab643f-2665-4e6a-bfc5-22f83d932670"). InnerVolumeSpecName "kube-api-access-9rg9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:22:29.570462 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.570438    2563 generic.go:356] "Generic (PLEG): container finished" podID="60ab643f-2665-4e6a-bfc5-22f83d932670" containerID="1e13b23485c586f39846b73f1c2aafdcd4109cc001031b3216dcb4b12b8dfda6" exitCode=0
Jul 28 20:22:29.570595 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.570480    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"
Jul 28 20:22:29.570595 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.570481    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh" event={"ID":"60ab643f-2665-4e6a-bfc5-22f83d932670","Type":"ContainerDied","Data":"1e13b23485c586f39846b73f1c2aafdcd4109cc001031b3216dcb4b12b8dfda6"}
Jul 28 20:22:29.570595 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.570579    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh" event={"ID":"60ab643f-2665-4e6a-bfc5-22f83d932670","Type":"ContainerDied","Data":"1cdb2b63619be1ff1f943361965c0836013545e4f6ed5f46a69c641115246e57"}
Jul 28 20:22:29.570595 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.570595    2563 scope.go:117] "RemoveContainer" containerID="1e13b23485c586f39846b73f1c2aafdcd4109cc001031b3216dcb4b12b8dfda6"
Jul 28 20:22:29.579142 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.579128    2563 scope.go:117] "RemoveContainer" containerID="1e13b23485c586f39846b73f1c2aafdcd4109cc001031b3216dcb4b12b8dfda6"
Jul 28 20:22:29.579384 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:22:29.579364    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e13b23485c586f39846b73f1c2aafdcd4109cc001031b3216dcb4b12b8dfda6\": container with ID starting with 1e13b23485c586f39846b73f1c2aafdcd4109cc001031b3216dcb4b12b8dfda6 not found: ID does not exist" containerID="1e13b23485c586f39846b73f1c2aafdcd4109cc001031b3216dcb4b12b8dfda6"
Jul 28 20:22:29.579444 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.579393    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e13b23485c586f39846b73f1c2aafdcd4109cc001031b3216dcb4b12b8dfda6"} err="failed to get container status \"1e13b23485c586f39846b73f1c2aafdcd4109cc001031b3216dcb4b12b8dfda6\": rpc error: code = NotFound desc = could not find container \"1e13b23485c586f39846b73f1c2aafdcd4109cc001031b3216dcb4b12b8dfda6\": container with ID starting with 1e13b23485c586f39846b73f1c2aafdcd4109cc001031b3216dcb4b12b8dfda6 not found: ID does not exist"
Jul 28 20:22:29.604679 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.604660    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"]
Jul 28 20:22:29.610252 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.610228    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/auth-test-model-bd928b-kserve-7675cf9679-ds8wh"]
Jul 28 20:22:29.635419 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.635399    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60ab643f-2665-4e6a-bfc5-22f83d932670-tls-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:22:29.635419 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.635418    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-dshm\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:22:29.635530 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.635426    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rg9n\" (UniqueName: \"kubernetes.io/projected/60ab643f-2665-4e6a-bfc5-22f83d932670-kube-api-access-9rg9n\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:22:29.635530 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:29.635436    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60ab643f-2665-4e6a-bfc5-22f83d932670-model-cache\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:22:30.073620 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.073578    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p" podUID="fa68b6fa-54f5-4f69-86d6-01aa67743b89" containerName="main" containerID="cri-o://04357f909ac3603a15c9cfa2675679f08a7a3e090f901edeac4f6a59297357f4" gracePeriod=45
Jul 28 20:22:30.305951 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.305926    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:22:30.442781 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.442703    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-dshm\") pod \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") "
Jul 28 20:22:30.442781 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.442763    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-tmp-dir\") pod \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") "
Jul 28 20:22:30.442781 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.442779    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-home\") pod \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") "
Jul 28 20:22:30.443085 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.442806    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-model-cache\") pod \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") "
Jul 28 20:22:30.443085 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.442853    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa68b6fa-54f5-4f69-86d6-01aa67743b89-tls-certs\") pod \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") "
Jul 28 20:22:30.443085 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.442902    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5624x\" (UniqueName: \"kubernetes.io/projected/fa68b6fa-54f5-4f69-86d6-01aa67743b89-kube-api-access-5624x\") pod \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\" (UID: \"fa68b6fa-54f5-4f69-86d6-01aa67743b89\") "
Jul 28 20:22:30.443085 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.443004    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fa68b6fa-54f5-4f69-86d6-01aa67743b89" (UID: "fa68b6fa-54f5-4f69-86d6-01aa67743b89"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:22:30.443309 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.443084    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-home" (OuterVolumeSpecName: "home") pod "fa68b6fa-54f5-4f69-86d6-01aa67743b89" (UID: "fa68b6fa-54f5-4f69-86d6-01aa67743b89"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:22:30.443309 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.443097    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-model-cache" (OuterVolumeSpecName: "model-cache") pod "fa68b6fa-54f5-4f69-86d6-01aa67743b89" (UID: "fa68b6fa-54f5-4f69-86d6-01aa67743b89"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:22:30.443309 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.443202    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-tmp-dir\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:22:30.443309 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.443212    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-home\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:22:30.443309 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.443221    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-model-cache\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:22:30.444936 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.444905    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-dshm" (OuterVolumeSpecName: "dshm") pod "fa68b6fa-54f5-4f69-86d6-01aa67743b89" (UID: "fa68b6fa-54f5-4f69-86d6-01aa67743b89"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:22:30.445038 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.444943    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa68b6fa-54f5-4f69-86d6-01aa67743b89-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fa68b6fa-54f5-4f69-86d6-01aa67743b89" (UID: "fa68b6fa-54f5-4f69-86d6-01aa67743b89"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:22:30.445038 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.445003    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa68b6fa-54f5-4f69-86d6-01aa67743b89-kube-api-access-5624x" (OuterVolumeSpecName: "kube-api-access-5624x") pod "fa68b6fa-54f5-4f69-86d6-01aa67743b89" (UID: "fa68b6fa-54f5-4f69-86d6-01aa67743b89"). InnerVolumeSpecName "kube-api-access-5624x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:22:30.543675 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.543638    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa68b6fa-54f5-4f69-86d6-01aa67743b89-tls-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:22:30.543675 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.543668    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5624x\" (UniqueName: \"kubernetes.io/projected/fa68b6fa-54f5-4f69-86d6-01aa67743b89-kube-api-access-5624x\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:22:30.543675 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.543677    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa68b6fa-54f5-4f69-86d6-01aa67743b89-dshm\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:22:30.581904 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.581868    2563 generic.go:356] "Generic (PLEG): container finished" podID="fa68b6fa-54f5-4f69-86d6-01aa67743b89" containerID="04357f909ac3603a15c9cfa2675679f08a7a3e090f901edeac4f6a59297357f4" exitCode=0
Jul 28 20:22:30.582067 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.581919    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"
Jul 28 20:22:30.582067 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.581960    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p" event={"ID":"fa68b6fa-54f5-4f69-86d6-01aa67743b89","Type":"ContainerDied","Data":"04357f909ac3603a15c9cfa2675679f08a7a3e090f901edeac4f6a59297357f4"}
Jul 28 20:22:30.582067 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.582004    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p" event={"ID":"fa68b6fa-54f5-4f69-86d6-01aa67743b89","Type":"ContainerDied","Data":"33a094811526d7f496bea2d9eff9f590003c922c18dd6b1b8a32f5f220f26438"}
Jul 28 20:22:30.582067 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.582027    2563 scope.go:117] "RemoveContainer" containerID="04357f909ac3603a15c9cfa2675679f08a7a3e090f901edeac4f6a59297357f4"
Jul 28 20:22:30.590860 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.590842    2563 scope.go:117] "RemoveContainer" containerID="04357f909ac3603a15c9cfa2675679f08a7a3e090f901edeac4f6a59297357f4"
Jul 28 20:22:30.591122 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:22:30.591104    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04357f909ac3603a15c9cfa2675679f08a7a3e090f901edeac4f6a59297357f4\": container with ID starting with 04357f909ac3603a15c9cfa2675679f08a7a3e090f901edeac4f6a59297357f4 not found: ID does not exist" containerID="04357f909ac3603a15c9cfa2675679f08a7a3e090f901edeac4f6a59297357f4"
Jul 28 20:22:30.591193 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.591127    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04357f909ac3603a15c9cfa2675679f08a7a3e090f901edeac4f6a59297357f4"} err="failed to get container status \"04357f909ac3603a15c9cfa2675679f08a7a3e090f901edeac4f6a59297357f4\": rpc error: code = NotFound desc = could not find container \"04357f909ac3603a15c9cfa2675679f08a7a3e090f901edeac4f6a59297357f4\": container with ID starting with 04357f909ac3603a15c9cfa2675679f08a7a3e090f901edeac4f6a59297357f4 not found: ID does not exist"
Jul 28 20:22:30.605054 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.605028    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"]
Jul 28 20:22:30.609927 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:30.609906    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/auth-test-model-60efb4-kserve-6b98785f5-cnm2p"]
Jul 28 20:22:31.603784 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:31.603751    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60ab643f-2665-4e6a-bfc5-22f83d932670" path="/var/lib/kubelet/pods/60ab643f-2665-4e6a-bfc5-22f83d932670/volumes"
Jul 28 20:22:31.604316 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:31.604296    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa68b6fa-54f5-4f69-86d6-01aa67743b89" path="/var/lib/kubelet/pods/fa68b6fa-54f5-4f69-86d6-01aa67743b89/volumes"
Jul 28 20:22:35.168368 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:35.168338    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:35.168804 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:35.168414    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:35.180857 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:35.180838    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:35.620955 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:35.620912    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:22:57.682435 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.682396    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"]
Jul 28 20:22:57.682921 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.682747    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60ab643f-2665-4e6a-bfc5-22f83d932670" containerName="main"
Jul 28 20:22:57.682921 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.682759    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="60ab643f-2665-4e6a-bfc5-22f83d932670" containerName="main"
Jul 28 20:22:57.682921 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.682769    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa68b6fa-54f5-4f69-86d6-01aa67743b89" containerName="main"
Jul 28 20:22:57.682921 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.682775    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa68b6fa-54f5-4f69-86d6-01aa67743b89" containerName="main"
Jul 28 20:22:57.682921 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.682838    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="60ab643f-2665-4e6a-bfc5-22f83d932670" containerName="main"
Jul 28 20:22:57.682921 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.682847    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa68b6fa-54f5-4f69-86d6-01aa67743b89" containerName="main"
Jul 28 20:22:57.684831 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.684814    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.687785 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.687764    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-60efb4\"/\"sub-test-model-60efb4-kserve-self-signed-certs\""
Jul 28 20:22:57.688795 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.688778    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-60efb4\"/\"kube-root-ca.crt\""
Jul 28 20:22:57.688891 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.688803    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-60efb4\"/\"openshift-service-ca.crt\""
Jul 28 20:22:57.688891 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.688840    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-60efb4\"/\"default-dockercfg-fmvgp\""
Jul 28 20:22:57.701280 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.701255    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"]
Jul 28 20:22:57.782966 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.782923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb9bb21c-5a62-4f91-a805-84ba23546282-tls-certs\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.782966 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.782965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-tmp-dir\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.783208 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.782983    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-dshm\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.783208 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.783072    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-home\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.783208 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.783159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-model-cache\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.783208 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.783204    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrbpk\" (UniqueName: \"kubernetes.io/projected/fb9bb21c-5a62-4f91-a805-84ba23546282-kube-api-access-wrbpk\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.884610 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.884573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrbpk\" (UniqueName: \"kubernetes.io/projected/fb9bb21c-5a62-4f91-a805-84ba23546282-kube-api-access-wrbpk\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.884802 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.884619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb9bb21c-5a62-4f91-a805-84ba23546282-tls-certs\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.884802 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.884639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-tmp-dir\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.884802 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.884662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-dshm\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.884802 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.884706    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-home\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.884802 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.884791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-model-cache\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.885093 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.885060    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-tmp-dir\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.885200 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.885124    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-model-cache\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.885200 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.885164    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-home\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.886899 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.886870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-dshm\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.887121 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.887105    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb9bb21c-5a62-4f91-a805-84ba23546282-tls-certs\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.893359 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.893338    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrbpk\" (UniqueName: \"kubernetes.io/projected/fb9bb21c-5a62-4f91-a805-84ba23546282-kube-api-access-wrbpk\") pod \"sub-test-model-60efb4-kserve-6846f74745-cf28d\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") " pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:57.994211 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:57.994121    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:22:58.126425 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:58.126393    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"]
Jul 28 20:22:58.129610 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:22:58.129587    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb9bb21c_5a62_4f91_a805_84ba23546282.slice/crio-bd519af1d347eeaef6ebaf944f18d8c5713b47f8a126d27604b9c57c60092357 WatchSource:0}: Error finding container bd519af1d347eeaef6ebaf944f18d8c5713b47f8a126d27604b9c57c60092357: Status 404 returned error can't find the container with id bd519af1d347eeaef6ebaf944f18d8c5713b47f8a126d27604b9c57c60092357
Jul 28 20:22:58.733838 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:58.733799    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d" event={"ID":"fb9bb21c-5a62-4f91-a805-84ba23546282","Type":"ContainerStarted","Data":"89c0b1845828f3d42beab8dc2580a0b220718041eecc663259aa9a9ce572df96"}
Jul 28 20:22:58.734244 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:58.733947    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d" event={"ID":"fb9bb21c-5a62-4f91-a805-84ba23546282","Type":"ContainerStarted","Data":"bd519af1d347eeaef6ebaf944f18d8c5713b47f8a126d27604b9c57c60092357"}
Jul 28 20:22:58.754138 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:22:58.754087    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d" podStartSLOduration=1.75407291 podStartE2EDuration="1.75407291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:22:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:22:58.753504565 +0000 UTC m=+2863.775800155" watchObservedRunningTime="2026-07-28 20:22:58.75407291 +0000 UTC m=+2863.776368498"
Jul 28 20:23:00.926627 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:23:00.926587    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:23:07.994382 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:23:07.994292    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:23:07.994382 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:23:07.994352    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:23:08.006700 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:23:08.006676    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:23:08.796105 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:23:08.796059    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:23:44.460813 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:23:44.460777    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:24:02.688744 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:02.688701    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:24:23.255055 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:23.255018    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:24:28.774356 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:28.774321    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"]
Jul 28 20:24:29.546086 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:29.546047    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"]
Jul 28 20:24:40.135838 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:40.135800    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:24:42.907864 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:42.907827    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"]
Jul 28 20:24:42.911134 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:42.911117    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:42.916899 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:42.916875    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bd928b\"/\"rate-test-model-bd928b-kserve-self-signed-certs\""
Jul 28 20:24:42.948861 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:42.948833    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"]
Jul 28 20:24:42.983477 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:42.983445    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b24db\" (UniqueName: \"kubernetes.io/projected/c534a445-7f5d-4fe5-b68f-03a86822698c-kube-api-access-b24db\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:42.983658 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:42.983481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-dshm\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:42.983658 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:42.983509    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-model-cache\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:42.983658 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:42.983618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c534a445-7f5d-4fe5-b68f-03a86822698c-tls-certs\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:42.983658 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:42.983656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-tmp-dir\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:42.983800 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:42.983684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-home\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:43.084891 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:43.084854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c534a445-7f5d-4fe5-b68f-03a86822698c-tls-certs\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:43.085047 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:43.084899    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-tmp-dir\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:43.085047 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:43.085013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-home\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:43.085119 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:43.085069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b24db\" (UniqueName: \"kubernetes.io/projected/c534a445-7f5d-4fe5-b68f-03a86822698c-kube-api-access-b24db\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:43.085119 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:43.085101    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-dshm\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:43.085199 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:43.085128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-model-cache\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:43.085313 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:43.085293    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-tmp-dir\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:43.085360 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:43.085321    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-home\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:43.085458 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:43.085437    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-model-cache\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:43.087209 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:43.087184    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-dshm\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:43.087432 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:43.087414    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c534a445-7f5d-4fe5-b68f-03a86822698c-tls-certs\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:43.095315 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:43.095294    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b24db\" (UniqueName: \"kubernetes.io/projected/c534a445-7f5d-4fe5-b68f-03a86822698c-kube-api-access-b24db\") pod \"rate-test-model-bd928b-kserve-bc4846467-2h8bj\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") " pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:43.219584 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:43.219481    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:43.367993 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:43.367961    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"]
Jul 28 20:24:43.792438 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:43.792385    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn" podUID="3e3017ec-4f5c-4e84-a623-ade8cf53fc76" containerName="main" containerID="cri-o://e9016746c9d3a558bfa5fc266f6df836ddd16531277e8d6dea056fccacba5d9e" gracePeriod=45
Jul 28 20:24:44.032787 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.032759    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:24:44.095483 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.095450    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-dshm\") pod \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") "
Jul 28 20:24:44.095639 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.095572    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-model-cache\") pod \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") "
Jul 28 20:24:44.095639 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.095603    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-tmp-dir\") pod \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") "
Jul 28 20:24:44.095754 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.095657    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-tls-certs\") pod \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") "
Jul 28 20:24:44.095754 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.095688    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zww6h\" (UniqueName: \"kubernetes.io/projected/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-kube-api-access-zww6h\") pod \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") "
Jul 28 20:24:44.095754 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.095721    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-home\") pod \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\" (UID: \"3e3017ec-4f5c-4e84-a623-ade8cf53fc76\") "
Jul 28 20:24:44.095977 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.095949    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3e3017ec-4f5c-4e84-a623-ade8cf53fc76" (UID: "3e3017ec-4f5c-4e84-a623-ade8cf53fc76"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:24:44.096170 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.096148    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-home" (OuterVolumeSpecName: "home") pod "3e3017ec-4f5c-4e84-a623-ade8cf53fc76" (UID: "3e3017ec-4f5c-4e84-a623-ade8cf53fc76"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:24:44.096270 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.096247    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-model-cache" (OuterVolumeSpecName: "model-cache") pod "3e3017ec-4f5c-4e84-a623-ade8cf53fc76" (UID: "3e3017ec-4f5c-4e84-a623-ade8cf53fc76"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:24:44.097930 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.097883    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3e3017ec-4f5c-4e84-a623-ade8cf53fc76" (UID: "3e3017ec-4f5c-4e84-a623-ade8cf53fc76"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:24:44.098202 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.098178    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-kube-api-access-zww6h" (OuterVolumeSpecName: "kube-api-access-zww6h") pod "3e3017ec-4f5c-4e84-a623-ade8cf53fc76" (UID: "3e3017ec-4f5c-4e84-a623-ade8cf53fc76"). InnerVolumeSpecName "kube-api-access-zww6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:24:44.098276 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.098238    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-dshm" (OuterVolumeSpecName: "dshm") pod "3e3017ec-4f5c-4e84-a623-ade8cf53fc76" (UID: "3e3017ec-4f5c-4e84-a623-ade8cf53fc76"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:24:44.197337 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.197280    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-dshm\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:24:44.197337 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.197326    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-model-cache\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:24:44.197337 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.197338    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-tmp-dir\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:24:44.197337 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.197346    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-tls-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:24:44.197337 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.197355    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zww6h\" (UniqueName: \"kubernetes.io/projected/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-kube-api-access-zww6h\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:24:44.197337 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.197363    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e3017ec-4f5c-4e84-a623-ade8cf53fc76-home\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:24:44.269230 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.269179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj" event={"ID":"c534a445-7f5d-4fe5-b68f-03a86822698c","Type":"ContainerStarted","Data":"f4276c3032bdccf6c152cf4bc86e648d745bbf7fd84ee63a9c8876cc1c7648d3"}
Jul 28 20:24:44.269230 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.269218    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj" event={"ID":"c534a445-7f5d-4fe5-b68f-03a86822698c","Type":"ContainerStarted","Data":"e3d9150a8a7649ee3795fce4f6981b36ed3de9d5c24e6156efba2edcf7725772"}
Jul 28 20:24:44.270352 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.270329    2563 generic.go:356] "Generic (PLEG): container finished" podID="3e3017ec-4f5c-4e84-a623-ade8cf53fc76" containerID="e9016746c9d3a558bfa5fc266f6df836ddd16531277e8d6dea056fccacba5d9e" exitCode=0
Jul 28 20:24:44.270475 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.270365    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"
Jul 28 20:24:44.270475 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.270411    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn" event={"ID":"3e3017ec-4f5c-4e84-a623-ade8cf53fc76","Type":"ContainerDied","Data":"e9016746c9d3a558bfa5fc266f6df836ddd16531277e8d6dea056fccacba5d9e"}
Jul 28 20:24:44.270475 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.270450    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn" event={"ID":"3e3017ec-4f5c-4e84-a623-ade8cf53fc76","Type":"ContainerDied","Data":"d5d7b256808943a7b68a9e0e8ffc6499ff344aee525234cf60078aec8147badf"}
Jul 28 20:24:44.270475 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.270473    2563 scope.go:117] "RemoveContainer" containerID="e9016746c9d3a558bfa5fc266f6df836ddd16531277e8d6dea056fccacba5d9e"
Jul 28 20:24:44.279381 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.279363    2563 scope.go:117] "RemoveContainer" containerID="e9016746c9d3a558bfa5fc266f6df836ddd16531277e8d6dea056fccacba5d9e"
Jul 28 20:24:44.279678 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:24:44.279660    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9016746c9d3a558bfa5fc266f6df836ddd16531277e8d6dea056fccacba5d9e\": container with ID starting with e9016746c9d3a558bfa5fc266f6df836ddd16531277e8d6dea056fccacba5d9e not found: ID does not exist" containerID="e9016746c9d3a558bfa5fc266f6df836ddd16531277e8d6dea056fccacba5d9e"
Jul 28 20:24:44.279723 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.279687    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9016746c9d3a558bfa5fc266f6df836ddd16531277e8d6dea056fccacba5d9e"} err="failed to get container status \"e9016746c9d3a558bfa5fc266f6df836ddd16531277e8d6dea056fccacba5d9e\": rpc error: code = NotFound desc = could not find container \"e9016746c9d3a558bfa5fc266f6df836ddd16531277e8d6dea056fccacba5d9e\": container with ID starting with e9016746c9d3a558bfa5fc266f6df836ddd16531277e8d6dea056fccacba5d9e not found: ID does not exist"
Jul 28 20:24:44.296905 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.296859    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj" podStartSLOduration=2.296844458 podStartE2EDuration="2.296844458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:24:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:24:44.295257038 +0000 UTC m=+2969.317552630" watchObservedRunningTime="2026-07-28 20:24:44.296844458 +0000 UTC m=+2969.319140045"
Jul 28 20:24:44.320717 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.320684    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"]
Jul 28 20:24:44.326414 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.326388    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/sub-test-model-bd928b-kserve-9b9cb485c-9mmjn"]
Jul 28 20:24:44.564276 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.564233    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d" podUID="fb9bb21c-5a62-4f91-a805-84ba23546282" containerName="main" containerID="cri-o://89c0b1845828f3d42beab8dc2580a0b220718041eecc663259aa9a9ce572df96" gracePeriod=45
Jul 28 20:24:44.813696 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.813670    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:24:44.902865 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.902777    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-home\") pod \"fb9bb21c-5a62-4f91-a805-84ba23546282\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") "
Jul 28 20:24:44.902865 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.902821    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrbpk\" (UniqueName: \"kubernetes.io/projected/fb9bb21c-5a62-4f91-a805-84ba23546282-kube-api-access-wrbpk\") pod \"fb9bb21c-5a62-4f91-a805-84ba23546282\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") "
Jul 28 20:24:44.902865 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.902847    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-tmp-dir\") pod \"fb9bb21c-5a62-4f91-a805-84ba23546282\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") "
Jul 28 20:24:44.903155 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.902879    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb9bb21c-5a62-4f91-a805-84ba23546282-tls-certs\") pod \"fb9bb21c-5a62-4f91-a805-84ba23546282\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") "
Jul 28 20:24:44.903155 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.902896    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-model-cache\") pod \"fb9bb21c-5a62-4f91-a805-84ba23546282\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") "
Jul 28 20:24:44.903155 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.902929    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-dshm\") pod \"fb9bb21c-5a62-4f91-a805-84ba23546282\" (UID: \"fb9bb21c-5a62-4f91-a805-84ba23546282\") "
Jul 28 20:24:44.903155 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.903091    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-home" (OuterVolumeSpecName: "home") pod "fb9bb21c-5a62-4f91-a805-84ba23546282" (UID: "fb9bb21c-5a62-4f91-a805-84ba23546282"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:24:44.903369 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.903186    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-model-cache" (OuterVolumeSpecName: "model-cache") pod "fb9bb21c-5a62-4f91-a805-84ba23546282" (UID: "fb9bb21c-5a62-4f91-a805-84ba23546282"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:24:44.903369 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.903209    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fb9bb21c-5a62-4f91-a805-84ba23546282" (UID: "fb9bb21c-5a62-4f91-a805-84ba23546282"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:24:44.905022 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.904999    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb9bb21c-5a62-4f91-a805-84ba23546282-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fb9bb21c-5a62-4f91-a805-84ba23546282" (UID: "fb9bb21c-5a62-4f91-a805-84ba23546282"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:24:44.905122 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.905022    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-dshm" (OuterVolumeSpecName: "dshm") pod "fb9bb21c-5a62-4f91-a805-84ba23546282" (UID: "fb9bb21c-5a62-4f91-a805-84ba23546282"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:24:44.905122 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:44.905030    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb9bb21c-5a62-4f91-a805-84ba23546282-kube-api-access-wrbpk" (OuterVolumeSpecName: "kube-api-access-wrbpk") pod "fb9bb21c-5a62-4f91-a805-84ba23546282" (UID: "fb9bb21c-5a62-4f91-a805-84ba23546282"). InnerVolumeSpecName "kube-api-access-wrbpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:24:45.004358 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.004307    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-home\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:24:45.004358 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.004351    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrbpk\" (UniqueName: \"kubernetes.io/projected/fb9bb21c-5a62-4f91-a805-84ba23546282-kube-api-access-wrbpk\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:24:45.004358 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.004362    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-tmp-dir\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:24:45.004358 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.004370    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb9bb21c-5a62-4f91-a805-84ba23546282-tls-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:24:45.004358 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.004380    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-model-cache\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:24:45.004691 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.004389    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb9bb21c-5a62-4f91-a805-84ba23546282-dshm\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:24:45.276802 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.276768    2563 generic.go:356] "Generic (PLEG): container finished" podID="fb9bb21c-5a62-4f91-a805-84ba23546282" containerID="89c0b1845828f3d42beab8dc2580a0b220718041eecc663259aa9a9ce572df96" exitCode=0
Jul 28 20:24:45.277221 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.276815    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"
Jul 28 20:24:45.277221 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.276854    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d" event={"ID":"fb9bb21c-5a62-4f91-a805-84ba23546282","Type":"ContainerDied","Data":"89c0b1845828f3d42beab8dc2580a0b220718041eecc663259aa9a9ce572df96"}
Jul 28 20:24:45.277221 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.276898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d" event={"ID":"fb9bb21c-5a62-4f91-a805-84ba23546282","Type":"ContainerDied","Data":"bd519af1d347eeaef6ebaf944f18d8c5713b47f8a126d27604b9c57c60092357"}
Jul 28 20:24:45.277221 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.276914    2563 scope.go:117] "RemoveContainer" containerID="89c0b1845828f3d42beab8dc2580a0b220718041eecc663259aa9a9ce572df96"
Jul 28 20:24:45.286353 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.286330    2563 scope.go:117] "RemoveContainer" containerID="89c0b1845828f3d42beab8dc2580a0b220718041eecc663259aa9a9ce572df96"
Jul 28 20:24:45.286670 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:24:45.286652    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89c0b1845828f3d42beab8dc2580a0b220718041eecc663259aa9a9ce572df96\": container with ID starting with 89c0b1845828f3d42beab8dc2580a0b220718041eecc663259aa9a9ce572df96 not found: ID does not exist" containerID="89c0b1845828f3d42beab8dc2580a0b220718041eecc663259aa9a9ce572df96"
Jul 28 20:24:45.286724 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.286683    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89c0b1845828f3d42beab8dc2580a0b220718041eecc663259aa9a9ce572df96"} err="failed to get container status \"89c0b1845828f3d42beab8dc2580a0b220718041eecc663259aa9a9ce572df96\": rpc error: code = NotFound desc = could not find container \"89c0b1845828f3d42beab8dc2580a0b220718041eecc663259aa9a9ce572df96\": container with ID starting with 89c0b1845828f3d42beab8dc2580a0b220718041eecc663259aa9a9ce572df96 not found: ID does not exist"
Jul 28 20:24:45.303098 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.303068    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"]
Jul 28 20:24:45.306857 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.306832    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/sub-test-model-60efb4-kserve-6846f74745-cf28d"]
Jul 28 20:24:45.605206 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.605121    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e3017ec-4f5c-4e84-a623-ade8cf53fc76" path="/var/lib/kubelet/pods/3e3017ec-4f5c-4e84-a623-ade8cf53fc76/volumes"
Jul 28 20:24:45.605495 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:45.605481    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb9bb21c-5a62-4f91-a805-84ba23546282" path="/var/lib/kubelet/pods/fb9bb21c-5a62-4f91-a805-84ba23546282/volumes"
Jul 28 20:24:53.219756 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:53.219717    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:53.219756 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:53.219767    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:53.232562 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:53.232524    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:53.329383 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:53.329358    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:24:54.189912 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:24:54.189876    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:25:07.180834 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.180796    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"]
Jul 28 20:25:07.181292 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.181131    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb9bb21c-5a62-4f91-a805-84ba23546282" containerName="main"
Jul 28 20:25:07.181292 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.181142    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb9bb21c-5a62-4f91-a805-84ba23546282" containerName="main"
Jul 28 20:25:07.181292 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.181155    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e3017ec-4f5c-4e84-a623-ade8cf53fc76" containerName="main"
Jul 28 20:25:07.181292 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.181160    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e3017ec-4f5c-4e84-a623-ade8cf53fc76" containerName="main"
Jul 28 20:25:07.181292 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.181211    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb9bb21c-5a62-4f91-a805-84ba23546282" containerName="main"
Jul 28 20:25:07.181292 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.181220    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e3017ec-4f5c-4e84-a623-ade8cf53fc76" containerName="main"
Jul 28 20:25:07.184108 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.184090    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.197271 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.197248    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-60efb4\"/\"default-dockercfg-fmvgp\""
Jul 28 20:25:07.197427 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.197409    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-60efb4\"/\"openshift-service-ca.crt\""
Jul 28 20:25:07.198443 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.198422    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-60efb4\"/\"rate-test-model-60efb4-kserve-self-signed-certs\""
Jul 28 20:25:07.198558 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.198530    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-60efb4\"/\"kube-root-ca.crt\""
Jul 28 20:25:07.227569 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.227519    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"]
Jul 28 20:25:07.293426 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.293391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-home\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.293426 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.293438    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-model-cache\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.293691 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.293477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-tmp-dir\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.293691 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.293528    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/747982d1-f32e-4204-9bf5-6f1816731e6f-tls-certs\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.293691 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.293670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-dshm\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.293839 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.293695    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ln92\" (UniqueName: \"kubernetes.io/projected/747982d1-f32e-4204-9bf5-6f1816731e6f-kube-api-access-7ln92\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.394153 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.394119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-tmp-dir\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.394153 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.394156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/747982d1-f32e-4204-9bf5-6f1816731e6f-tls-certs\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.394411 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.394181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-dshm\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.394411 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.394205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ln92\" (UniqueName: \"kubernetes.io/projected/747982d1-f32e-4204-9bf5-6f1816731e6f-kube-api-access-7ln92\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.394411 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.394273    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-home\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.394411 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.394311    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-model-cache\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.394665 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.394507    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-tmp-dir\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.394704 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.394668    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-model-cache\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.394753 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.394731    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-home\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.396396 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.396375    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-dshm\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.396742 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.396726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/747982d1-f32e-4204-9bf5-6f1816731e6f-tls-certs\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.412236 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.412207    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ln92\" (UniqueName: \"kubernetes.io/projected/747982d1-f32e-4204-9bf5-6f1816731e6f-kube-api-access-7ln92\") pod \"rate-test-model-60efb4-kserve-58ddb799-s577n\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") " pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.493409 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.493318    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:07.650594 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:25:07.650561    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod747982d1_f32e_4204_9bf5_6f1816731e6f.slice/crio-8261d933ce9a1fe92f2df6fa1fe18f10e3514b0fec8f49adcdb296f5fb899346 WatchSource:0}: Error finding container 8261d933ce9a1fe92f2df6fa1fe18f10e3514b0fec8f49adcdb296f5fb899346: Status 404 returned error can't find the container with id 8261d933ce9a1fe92f2df6fa1fe18f10e3514b0fec8f49adcdb296f5fb899346
Jul 28 20:25:07.655016 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:07.654994    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"]
Jul 28 20:25:08.398192 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:08.398150    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n" event={"ID":"747982d1-f32e-4204-9bf5-6f1816731e6f","Type":"ContainerStarted","Data":"1e728ec96d050396a900648ad38d6374ba95a03657fe51a8bdff1327dabd6a6b"}
Jul 28 20:25:08.398588 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:08.398206    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n" event={"ID":"747982d1-f32e-4204-9bf5-6f1816731e6f","Type":"ContainerStarted","Data":"8261d933ce9a1fe92f2df6fa1fe18f10e3514b0fec8f49adcdb296f5fb899346"}
Jul 28 20:25:08.449114 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:08.449059    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n" podStartSLOduration=1.449042278 podStartE2EDuration="1.449042278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:25:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:25:08.444048844 +0000 UTC m=+2993.466344432" watchObservedRunningTime="2026-07-28 20:25:08.449042278 +0000 UTC m=+2993.471337866"
Jul 28 20:25:10.756110 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:10.756067    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:25:17.493737 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:17.493699    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:17.494213 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:17.493755    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:17.506692 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:17.506665    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:18.464556 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:18.464515    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:25:43.740292 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:43.740259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:25:57.548419 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:25:57.548380    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:26:12.033277 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:12.033195    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:26:16.718116 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:16.718080    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"]
Jul 28 20:26:17.543536 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:17.543490    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"]
Jul 28 20:26:18.577557 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:18.577509    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7590-140504149720496"]
Jul 28 20:26:18.580337 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:18.580319    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149720496"
Jul 28 20:26:18.584487 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:18.584467    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fmppr\""
Jul 28 20:26:18.588687 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:18.588666    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7590-140504149720496"]
Jul 28 20:26:18.701810 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:18.701773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh957\" (UniqueName: \"kubernetes.io/projected/f3b4dfc5-8e4d-4f54-80e9-095004b83192-kube-api-access-lh957\") pod \"test-curl-7590-140504149720496\" (UID: \"f3b4dfc5-8e4d-4f54-80e9-095004b83192\") " pod="opendatahub/test-curl-7590-140504149720496"
Jul 28 20:26:18.802235 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:18.802198    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh957\" (UniqueName: \"kubernetes.io/projected/f3b4dfc5-8e4d-4f54-80e9-095004b83192-kube-api-access-lh957\") pod \"test-curl-7590-140504149720496\" (UID: \"f3b4dfc5-8e4d-4f54-80e9-095004b83192\") " pod="opendatahub/test-curl-7590-140504149720496"
Jul 28 20:26:18.811224 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:18.811192    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh957\" (UniqueName: \"kubernetes.io/projected/f3b4dfc5-8e4d-4f54-80e9-095004b83192-kube-api-access-lh957\") pod \"test-curl-7590-140504149720496\" (UID: \"f3b4dfc5-8e4d-4f54-80e9-095004b83192\") " pod="opendatahub/test-curl-7590-140504149720496"
Jul 28 20:26:18.890244 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:18.890166    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149720496"
Jul 28 20:26:19.041076 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:19.041037    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7590-140504149720496"]
Jul 28 20:26:19.043483 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:26:19.043455    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3b4dfc5_8e4d_4f54_80e9_095004b83192.slice/crio-77018431e092483d44024744a33baba133823fa9262970731e442fdbc688ce7b WatchSource:0}: Error finding container 77018431e092483d44024744a33baba133823fa9262970731e442fdbc688ce7b: Status 404 returned error can't find the container with id 77018431e092483d44024744a33baba133823fa9262970731e442fdbc688ce7b
Jul 28 20:26:19.044752 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:19.044733    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:26:19.756197 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:19.756171    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7590-140504149720496" event={"ID":"f3b4dfc5-8e4d-4f54-80e9-095004b83192","Type":"ContainerStarted","Data":"77018431e092483d44024744a33baba133823fa9262970731e442fdbc688ce7b"}
Jul 28 20:26:20.762811 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:20.762762    2563 generic.go:356] "Generic (PLEG): container finished" podID="f3b4dfc5-8e4d-4f54-80e9-095004b83192" containerID="7e3616797f76c368db2d3bd94522021501c0e0d6f6e6809ad8987a149f140fce" exitCode=0
Jul 28 20:26:20.763187 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:20.762832    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7590-140504149720496" event={"ID":"f3b4dfc5-8e4d-4f54-80e9-095004b83192","Type":"ContainerDied","Data":"7e3616797f76c368db2d3bd94522021501c0e0d6f6e6809ad8987a149f140fce"}
Jul 28 20:26:21.899124 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:21.899098    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149720496"
Jul 28 20:26:21.937321 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:21.937292    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7590-140504149720496_f3b4dfc5-8e4d-4f54-80e9-095004b83192/test-curl-7590-140504149720496/0.log"
Jul 28 20:26:21.963451 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:21.963418    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7590-140504149720496"]
Jul 28 20:26:21.968064 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:21.968041    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7590-140504149720496"]
Jul 28 20:26:22.032265 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.032179    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh957\" (UniqueName: \"kubernetes.io/projected/f3b4dfc5-8e4d-4f54-80e9-095004b83192-kube-api-access-lh957\") pod \"f3b4dfc5-8e4d-4f54-80e9-095004b83192\" (UID: \"f3b4dfc5-8e4d-4f54-80e9-095004b83192\") "
Jul 28 20:26:22.034331 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.034303    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b4dfc5-8e4d-4f54-80e9-095004b83192-kube-api-access-lh957" (OuterVolumeSpecName: "kube-api-access-lh957") pod "f3b4dfc5-8e4d-4f54-80e9-095004b83192" (UID: "f3b4dfc5-8e4d-4f54-80e9-095004b83192"). InnerVolumeSpecName "kube-api-access-lh957". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:26:22.099329 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.099290    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7590-140504149701424"]
Jul 28 20:26:22.099655 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.099641    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3b4dfc5-8e4d-4f54-80e9-095004b83192" containerName="test-curl-7590-140504149720496"
Jul 28 20:26:22.099716 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.099658    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3b4dfc5-8e4d-4f54-80e9-095004b83192" containerName="test-curl-7590-140504149720496"
Jul 28 20:26:22.099752 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.099719    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3b4dfc5-8e4d-4f54-80e9-095004b83192" containerName="test-curl-7590-140504149720496"
Jul 28 20:26:22.102555 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.102527    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149701424"
Jul 28 20:26:22.108198 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.108171    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7590-140504149701424"]
Jul 28 20:26:22.133276 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.133243    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh957\" (UniqueName: \"kubernetes.io/projected/f3b4dfc5-8e4d-4f54-80e9-095004b83192-kube-api-access-lh957\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:22.234651 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.234614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhjnl\" (UniqueName: \"kubernetes.io/projected/bd183384-6036-4afa-b20c-7486f2f6fea7-kube-api-access-bhjnl\") pod \"test-curl-7590-140504149701424\" (UID: \"bd183384-6036-4afa-b20c-7486f2f6fea7\") " pod="opendatahub/test-curl-7590-140504149701424"
Jul 28 20:26:22.335323 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.335213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhjnl\" (UniqueName: \"kubernetes.io/projected/bd183384-6036-4afa-b20c-7486f2f6fea7-kube-api-access-bhjnl\") pod \"test-curl-7590-140504149701424\" (UID: \"bd183384-6036-4afa-b20c-7486f2f6fea7\") " pod="opendatahub/test-curl-7590-140504149701424"
Jul 28 20:26:22.344762 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.344733    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhjnl\" (UniqueName: \"kubernetes.io/projected/bd183384-6036-4afa-b20c-7486f2f6fea7-kube-api-access-bhjnl\") pod \"test-curl-7590-140504149701424\" (UID: \"bd183384-6036-4afa-b20c-7486f2f6fea7\") " pod="opendatahub/test-curl-7590-140504149701424"
Jul 28 20:26:22.412514 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.412476    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149701424"
Jul 28 20:26:22.547662 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.547633    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7590-140504149701424"]
Jul 28 20:26:22.549034 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:26:22.549010    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd183384_6036_4afa_b20c_7486f2f6fea7.slice/crio-ef9131a5ff2d5ee47aa1ab3a7fffd96c377ddec415126fc5ddf163d7f24408b6 WatchSource:0}: Error finding container ef9131a5ff2d5ee47aa1ab3a7fffd96c377ddec415126fc5ddf163d7f24408b6: Status 404 returned error can't find the container with id ef9131a5ff2d5ee47aa1ab3a7fffd96c377ddec415126fc5ddf163d7f24408b6
Jul 28 20:26:22.774724 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.774695    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149720496"
Jul 28 20:26:22.774910 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.774740    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77018431e092483d44024744a33baba133823fa9262970731e442fdbc688ce7b"
Jul 28 20:26:22.776011 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:22.775986    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7590-140504149701424" event={"ID":"bd183384-6036-4afa-b20c-7486f2f6fea7","Type":"ContainerStarted","Data":"ef9131a5ff2d5ee47aa1ab3a7fffd96c377ddec415126fc5ddf163d7f24408b6"}
Jul 28 20:26:22.785815 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:26:22.785786    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7590-140504149720496\" is forbidden: User \"system:node:ip-10-0-128-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-52.ec2.internal' and this object" podUID="f3b4dfc5-8e4d-4f54-80e9-095004b83192" pod="opendatahub/test-curl-7590-140504149720496"
Jul 28 20:26:23.604330 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:23.604298    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3b4dfc5-8e4d-4f54-80e9-095004b83192" path="/var/lib/kubelet/pods/f3b4dfc5-8e4d-4f54-80e9-095004b83192/volumes"
Jul 28 20:26:23.782288 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:23.782257    2563 generic.go:356] "Generic (PLEG): container finished" podID="bd183384-6036-4afa-b20c-7486f2f6fea7" containerID="30c8d129997c926f540e4e37fede6e2cb052b0a90843ad56e9292dba7d8266fb" exitCode=0
Jul 28 20:26:23.782469 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:23.782345    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7590-140504149701424" event={"ID":"bd183384-6036-4afa-b20c-7486f2f6fea7","Type":"ContainerDied","Data":"30c8d129997c926f540e4e37fede6e2cb052b0a90843ad56e9292dba7d8266fb"}
Jul 28 20:26:24.921980 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:24.921953    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149701424"
Jul 28 20:26:24.945306 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:24.945278    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7590-140504149701424_bd183384-6036-4afa-b20c-7486f2f6fea7/test-curl-7590-140504149701424/0.log"
Jul 28 20:26:24.973844 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:24.973806    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7590-140504149701424"]
Jul 28 20:26:24.977830 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:24.977804    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7590-140504149701424"]
Jul 28 20:26:25.060996 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.060903    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhjnl\" (UniqueName: \"kubernetes.io/projected/bd183384-6036-4afa-b20c-7486f2f6fea7-kube-api-access-bhjnl\") pod \"bd183384-6036-4afa-b20c-7486f2f6fea7\" (UID: \"bd183384-6036-4afa-b20c-7486f2f6fea7\") "
Jul 28 20:26:25.062926 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.062902    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd183384-6036-4afa-b20c-7486f2f6fea7-kube-api-access-bhjnl" (OuterVolumeSpecName: "kube-api-access-bhjnl") pod "bd183384-6036-4afa-b20c-7486f2f6fea7" (UID: "bd183384-6036-4afa-b20c-7486f2f6fea7"). InnerVolumeSpecName "kube-api-access-bhjnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:26:25.156082 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.156043    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7590-140504149792784"]
Jul 28 20:26:25.156419 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.156407    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd183384-6036-4afa-b20c-7486f2f6fea7" containerName="test-curl-7590-140504149701424"
Jul 28 20:26:25.156467 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.156422    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd183384-6036-4afa-b20c-7486f2f6fea7" containerName="test-curl-7590-140504149701424"
Jul 28 20:26:25.156503 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.156485    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd183384-6036-4afa-b20c-7486f2f6fea7" containerName="test-curl-7590-140504149701424"
Jul 28 20:26:25.159426 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.159410    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149792784"
Jul 28 20:26:25.161909 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.161889    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhjnl\" (UniqueName: \"kubernetes.io/projected/bd183384-6036-4afa-b20c-7486f2f6fea7-kube-api-access-bhjnl\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:25.167292 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.167271    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7590-140504149792784"]
Jul 28 20:26:25.263091 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.263051    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cl5w\" (UniqueName: \"kubernetes.io/projected/006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50-kube-api-access-7cl5w\") pod \"test-curl-7590-140504149792784\" (UID: \"006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50\") " pod="opendatahub/test-curl-7590-140504149792784"
Jul 28 20:26:25.363841 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.363757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cl5w\" (UniqueName: \"kubernetes.io/projected/006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50-kube-api-access-7cl5w\") pod \"test-curl-7590-140504149792784\" (UID: \"006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50\") " pod="opendatahub/test-curl-7590-140504149792784"
Jul 28 20:26:25.371978 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.371955    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cl5w\" (UniqueName: \"kubernetes.io/projected/006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50-kube-api-access-7cl5w\") pod \"test-curl-7590-140504149792784\" (UID: \"006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50\") " pod="opendatahub/test-curl-7590-140504149792784"
Jul 28 20:26:25.470111 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.470077    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149792784"
Jul 28 20:26:25.600676 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:26:25.600646    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod006e6b2f_d51f_49cd_a72d_c2b5b0fb8b50.slice/crio-af18ae8a3191d793f5b96449466611b3937dfe353cca06bd922103d90518ee88 WatchSource:0}: Error finding container af18ae8a3191d793f5b96449466611b3937dfe353cca06bd922103d90518ee88: Status 404 returned error can't find the container with id af18ae8a3191d793f5b96449466611b3937dfe353cca06bd922103d90518ee88
Jul 28 20:26:25.605102 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.605078    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd183384-6036-4afa-b20c-7486f2f6fea7" path="/var/lib/kubelet/pods/bd183384-6036-4afa-b20c-7486f2f6fea7/volumes"
Jul 28 20:26:25.605393 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.605380    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7590-140504149792784"]
Jul 28 20:26:25.793785 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.793750    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7590-140504149792784" event={"ID":"006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50","Type":"ContainerStarted","Data":"af18ae8a3191d793f5b96449466611b3937dfe353cca06bd922103d90518ee88"}
Jul 28 20:26:25.794874 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.794855    2563 scope.go:117] "RemoveContainer" containerID="30c8d129997c926f540e4e37fede6e2cb052b0a90843ad56e9292dba7d8266fb"
Jul 28 20:26:25.794986 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:25.794876    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149701424"
Jul 28 20:26:26.801591 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:26.801535    2563 generic.go:356] "Generic (PLEG): container finished" podID="006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50" containerID="e35a069fab611cdc6fa542e0f38711155cf5080a5697b53dc9b91454af061f5f" exitCode=0
Jul 28 20:26:26.802041 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:26.801644    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7590-140504149792784" event={"ID":"006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50","Type":"ContainerDied","Data":"e35a069fab611cdc6fa542e0f38711155cf5080a5697b53dc9b91454af061f5f"}
Jul 28 20:26:27.939047 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:27.939025    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149792784"
Jul 28 20:26:27.959632 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:27.959609    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7590-140504149792784_006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50/test-curl-7590-140504149792784/0.log"
Jul 28 20:26:27.986764 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:27.986740    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7590-140504149792784"]
Jul 28 20:26:27.988745 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:27.988724    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7590-140504149792784"]
Jul 28 20:26:28.089218 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.089142    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cl5w\" (UniqueName: \"kubernetes.io/projected/006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50-kube-api-access-7cl5w\") pod \"006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50\" (UID: \"006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50\") "
Jul 28 20:26:28.091314 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.091291    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50-kube-api-access-7cl5w" (OuterVolumeSpecName: "kube-api-access-7cl5w") pod "006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50" (UID: "006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50"). InnerVolumeSpecName "kube-api-access-7cl5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:26:28.122386 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.122360    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7590-140504149792784"]
Jul 28 20:26:28.122703 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.122689    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50" containerName="test-curl-7590-140504149792784"
Jul 28 20:26:28.122703 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.122703    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50" containerName="test-curl-7590-140504149792784"
Jul 28 20:26:28.122792 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.122762    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50" containerName="test-curl-7590-140504149792784"
Jul 28 20:26:28.125533 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.125518    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149792784"
Jul 28 20:26:28.132669 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.132608    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7590-140504149792784"]
Jul 28 20:26:28.189816 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.189780    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cl5w\" (UniqueName: \"kubernetes.io/projected/006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50-kube-api-access-7cl5w\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:28.290317 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.290283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz9np\" (UniqueName: \"kubernetes.io/projected/015eecf2-0f12-42d7-8680-210e22a8a634-kube-api-access-fz9np\") pod \"test-curl-7590-140504149792784\" (UID: \"015eecf2-0f12-42d7-8680-210e22a8a634\") " pod="opendatahub/test-curl-7590-140504149792784"
Jul 28 20:26:28.390822 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.390740    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz9np\" (UniqueName: \"kubernetes.io/projected/015eecf2-0f12-42d7-8680-210e22a8a634-kube-api-access-fz9np\") pod \"test-curl-7590-140504149792784\" (UID: \"015eecf2-0f12-42d7-8680-210e22a8a634\") " pod="opendatahub/test-curl-7590-140504149792784"
Jul 28 20:26:28.402312 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.402288    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz9np\" (UniqueName: \"kubernetes.io/projected/015eecf2-0f12-42d7-8680-210e22a8a634-kube-api-access-fz9np\") pod \"test-curl-7590-140504149792784\" (UID: \"015eecf2-0f12-42d7-8680-210e22a8a634\") " pod="opendatahub/test-curl-7590-140504149792784"
Jul 28 20:26:28.435829 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.435806    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149792784"
Jul 28 20:26:28.563751 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.563727    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7590-140504149792784"]
Jul 28 20:26:28.566147 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:26:28.566127    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod015eecf2_0f12_42d7_8680_210e22a8a634.slice/crio-cf7be2ebfd4813d2a99383658daf115555678c224cffd99cf888e0f726b970f7 WatchSource:0}: Error finding container cf7be2ebfd4813d2a99383658daf115555678c224cffd99cf888e0f726b970f7: Status 404 returned error can't find the container with id cf7be2ebfd4813d2a99383658daf115555678c224cffd99cf888e0f726b970f7
Jul 28 20:26:28.819883 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.819845    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7590-140504149792784" event={"ID":"015eecf2-0f12-42d7-8680-210e22a8a634","Type":"ContainerStarted","Data":"cf7be2ebfd4813d2a99383658daf115555678c224cffd99cf888e0f726b970f7"}
Jul 28 20:26:28.821068 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.821047    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149792784"
Jul 28 20:26:28.821068 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.821057    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af18ae8a3191d793f5b96449466611b3937dfe353cca06bd922103d90518ee88"
Jul 28 20:26:28.832649 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.832618    2563 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7590-140504149792784" oldPodUID="006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50" podUID="015eecf2-0f12-42d7-8680-210e22a8a634"
Jul 28 20:26:28.933779 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:28.933753    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:26:29.604331 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:29.604297    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50" path="/var/lib/kubelet/pods/006e6b2f-d51f-49cd-a72d-c2b5b0fb8b50/volumes"
Jul 28 20:26:29.827992 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:29.827957    2563 generic.go:356] "Generic (PLEG): container finished" podID="015eecf2-0f12-42d7-8680-210e22a8a634" containerID="0f2bbed4073de783f559173f9aa9ff3c08eba94df426fa040a18620e446e4e09" exitCode=0
Jul 28 20:26:29.828152 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:29.828042    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7590-140504149792784" event={"ID":"015eecf2-0f12-42d7-8680-210e22a8a634","Type":"ContainerDied","Data":"0f2bbed4073de783f559173f9aa9ff3c08eba94df426fa040a18620e446e4e09"}
Jul 28 20:26:30.964638 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:30.964618    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149792784"
Jul 28 20:26:30.987666 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:30.987642    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7590-140504149792784_015eecf2-0f12-42d7-8680-210e22a8a634/test-curl-7590-140504149792784/0.log"
Jul 28 20:26:31.012630 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.012598    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7590-140504149792784"]
Jul 28 20:26:31.016271 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.016248    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7590-140504149792784"]
Jul 28 20:26:31.114901 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.114809    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz9np\" (UniqueName: \"kubernetes.io/projected/015eecf2-0f12-42d7-8680-210e22a8a634-kube-api-access-fz9np\") pod \"015eecf2-0f12-42d7-8680-210e22a8a634\" (UID: \"015eecf2-0f12-42d7-8680-210e22a8a634\") "
Jul 28 20:26:31.116837 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.116815    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/015eecf2-0f12-42d7-8680-210e22a8a634-kube-api-access-fz9np" (OuterVolumeSpecName: "kube-api-access-fz9np") pod "015eecf2-0f12-42d7-8680-210e22a8a634" (UID: "015eecf2-0f12-42d7-8680-210e22a8a634"). InnerVolumeSpecName "kube-api-access-fz9np". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:26:31.146892 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.146863    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7590-140504149793792"]
Jul 28 20:26:31.147210 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.147197    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="015eecf2-0f12-42d7-8680-210e22a8a634" containerName="test-curl-7590-140504149792784"
Jul 28 20:26:31.147259 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.147212    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="015eecf2-0f12-42d7-8680-210e22a8a634" containerName="test-curl-7590-140504149792784"
Jul 28 20:26:31.147294 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.147276    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="015eecf2-0f12-42d7-8680-210e22a8a634" containerName="test-curl-7590-140504149792784"
Jul 28 20:26:31.150111 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.150094    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149793792"
Jul 28 20:26:31.155193 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.155172    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7590-140504149793792"]
Jul 28 20:26:31.215908 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.215879    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz9np\" (UniqueName: \"kubernetes.io/projected/015eecf2-0f12-42d7-8680-210e22a8a634-kube-api-access-fz9np\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:31.316798 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.316765    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rgj2\" (UniqueName: \"kubernetes.io/projected/6b54a17f-5951-4cbb-b5da-c239e83d2bdd-kube-api-access-4rgj2\") pod \"test-curl-7590-140504149793792\" (UID: \"6b54a17f-5951-4cbb-b5da-c239e83d2bdd\") " pod="opendatahub/test-curl-7590-140504149793792"
Jul 28 20:26:31.418133 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.418051    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rgj2\" (UniqueName: \"kubernetes.io/projected/6b54a17f-5951-4cbb-b5da-c239e83d2bdd-kube-api-access-4rgj2\") pod \"test-curl-7590-140504149793792\" (UID: \"6b54a17f-5951-4cbb-b5da-c239e83d2bdd\") " pod="opendatahub/test-curl-7590-140504149793792"
Jul 28 20:26:31.427910 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.427885    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rgj2\" (UniqueName: \"kubernetes.io/projected/6b54a17f-5951-4cbb-b5da-c239e83d2bdd-kube-api-access-4rgj2\") pod \"test-curl-7590-140504149793792\" (UID: \"6b54a17f-5951-4cbb-b5da-c239e83d2bdd\") " pod="opendatahub/test-curl-7590-140504149793792"
Jul 28 20:26:31.459906 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.459882    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149793792"
Jul 28 20:26:31.587983 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.587955    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7590-140504149793792"]
Jul 28 20:26:31.589869 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:26:31.589842    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b54a17f_5951_4cbb_b5da_c239e83d2bdd.slice/crio-82d3dc869e067555e277d185fbe06d67944861085ad9d2357f95ba639c784649 WatchSource:0}: Error finding container 82d3dc869e067555e277d185fbe06d67944861085ad9d2357f95ba639c784649: Status 404 returned error can't find the container with id 82d3dc869e067555e277d185fbe06d67944861085ad9d2357f95ba639c784649
Jul 28 20:26:31.604306 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.604283    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="015eecf2-0f12-42d7-8680-210e22a8a634" path="/var/lib/kubelet/pods/015eecf2-0f12-42d7-8680-210e22a8a634/volumes"
Jul 28 20:26:31.736555 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.736457    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj" podUID="c534a445-7f5d-4fe5-b68f-03a86822698c" containerName="main" containerID="cri-o://f4276c3032bdccf6c152cf4bc86e648d745bbf7fd84ee63a9c8876cc1c7648d3" gracePeriod=45
Jul 28 20:26:31.840509 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.840467    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7590-140504149793792" event={"ID":"6b54a17f-5951-4cbb-b5da-c239e83d2bdd","Type":"ContainerStarted","Data":"82d3dc869e067555e277d185fbe06d67944861085ad9d2357f95ba639c784649"}
Jul 28 20:26:31.841670 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.841651    2563 scope.go:117] "RemoveContainer" containerID="0f2bbed4073de783f559173f9aa9ff3c08eba94df426fa040a18620e446e4e09"
Jul 28 20:26:31.841797 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:31.841682    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149792784"
Jul 28 20:26:32.046553 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.046523    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:26:32.225965 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.225932    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-home\") pod \"c534a445-7f5d-4fe5-b68f-03a86822698c\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") "
Jul 28 20:26:32.226146 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.225999    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-model-cache\") pod \"c534a445-7f5d-4fe5-b68f-03a86822698c\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") "
Jul 28 20:26:32.226146 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.226025    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-tmp-dir\") pod \"c534a445-7f5d-4fe5-b68f-03a86822698c\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") "
Jul 28 20:26:32.226146 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.226063    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c534a445-7f5d-4fe5-b68f-03a86822698c-tls-certs\") pod \"c534a445-7f5d-4fe5-b68f-03a86822698c\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") "
Jul 28 20:26:32.226146 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.226092    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-dshm\") pod \"c534a445-7f5d-4fe5-b68f-03a86822698c\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") "
Jul 28 20:26:32.226146 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.226136    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b24db\" (UniqueName: \"kubernetes.io/projected/c534a445-7f5d-4fe5-b68f-03a86822698c-kube-api-access-b24db\") pod \"c534a445-7f5d-4fe5-b68f-03a86822698c\" (UID: \"c534a445-7f5d-4fe5-b68f-03a86822698c\") "
Jul 28 20:26:32.226372 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.226277    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-home" (OuterVolumeSpecName: "home") pod "c534a445-7f5d-4fe5-b68f-03a86822698c" (UID: "c534a445-7f5d-4fe5-b68f-03a86822698c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:26:32.226372 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.226298    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c534a445-7f5d-4fe5-b68f-03a86822698c" (UID: "c534a445-7f5d-4fe5-b68f-03a86822698c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:26:32.226372 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.226320    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-model-cache" (OuterVolumeSpecName: "model-cache") pod "c534a445-7f5d-4fe5-b68f-03a86822698c" (UID: "c534a445-7f5d-4fe5-b68f-03a86822698c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:26:32.226559 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.226456    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-home\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:32.226559 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.226476    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-model-cache\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:32.226559 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.226489    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-tmp-dir\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:32.228239 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.228215    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c534a445-7f5d-4fe5-b68f-03a86822698c-kube-api-access-b24db" (OuterVolumeSpecName: "kube-api-access-b24db") pod "c534a445-7f5d-4fe5-b68f-03a86822698c" (UID: "c534a445-7f5d-4fe5-b68f-03a86822698c"). InnerVolumeSpecName "kube-api-access-b24db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:26:32.228320 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.228251    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-dshm" (OuterVolumeSpecName: "dshm") pod "c534a445-7f5d-4fe5-b68f-03a86822698c" (UID: "c534a445-7f5d-4fe5-b68f-03a86822698c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:26:32.228320 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.228262    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c534a445-7f5d-4fe5-b68f-03a86822698c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c534a445-7f5d-4fe5-b68f-03a86822698c" (UID: "c534a445-7f5d-4fe5-b68f-03a86822698c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:26:32.327504 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.327472    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c534a445-7f5d-4fe5-b68f-03a86822698c-tls-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:32.327504 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.327499    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c534a445-7f5d-4fe5-b68f-03a86822698c-dshm\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:32.327504 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.327510    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b24db\" (UniqueName: \"kubernetes.io/projected/c534a445-7f5d-4fe5-b68f-03a86822698c-kube-api-access-b24db\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:32.561666 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.561588    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n" podUID="747982d1-f32e-4204-9bf5-6f1816731e6f" containerName="main" containerID="cri-o://1e728ec96d050396a900648ad38d6374ba95a03657fe51a8bdff1327dabd6a6b" gracePeriod=45
Jul 28 20:26:32.801188 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.801164    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:26:32.851209 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.851173    2563 generic.go:356] "Generic (PLEG): container finished" podID="6b54a17f-5951-4cbb-b5da-c239e83d2bdd" containerID="52e836ad41931d5408de49e7bb927b0241a0e21326b1d31172d514a0359fbadb" exitCode=0
Jul 28 20:26:32.851382 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.851262    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7590-140504149793792" event={"ID":"6b54a17f-5951-4cbb-b5da-c239e83d2bdd","Type":"ContainerDied","Data":"52e836ad41931d5408de49e7bb927b0241a0e21326b1d31172d514a0359fbadb"}
Jul 28 20:26:32.852456 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.852431    2563 generic.go:356] "Generic (PLEG): container finished" podID="747982d1-f32e-4204-9bf5-6f1816731e6f" containerID="1e728ec96d050396a900648ad38d6374ba95a03657fe51a8bdff1327dabd6a6b" exitCode=0
Jul 28 20:26:32.852571 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.852474    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"
Jul 28 20:26:32.852571 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.852520    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n" event={"ID":"747982d1-f32e-4204-9bf5-6f1816731e6f","Type":"ContainerDied","Data":"1e728ec96d050396a900648ad38d6374ba95a03657fe51a8bdff1327dabd6a6b"}
Jul 28 20:26:32.852676 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.852573    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n" event={"ID":"747982d1-f32e-4204-9bf5-6f1816731e6f","Type":"ContainerDied","Data":"8261d933ce9a1fe92f2df6fa1fe18f10e3514b0fec8f49adcdb296f5fb899346"}
Jul 28 20:26:32.852676 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.852591    2563 scope.go:117] "RemoveContainer" containerID="1e728ec96d050396a900648ad38d6374ba95a03657fe51a8bdff1327dabd6a6b"
Jul 28 20:26:32.853875 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.853579    2563 generic.go:356] "Generic (PLEG): container finished" podID="c534a445-7f5d-4fe5-b68f-03a86822698c" containerID="f4276c3032bdccf6c152cf4bc86e648d745bbf7fd84ee63a9c8876cc1c7648d3" exitCode=0
Jul 28 20:26:32.853875 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.853602    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj" event={"ID":"c534a445-7f5d-4fe5-b68f-03a86822698c","Type":"ContainerDied","Data":"f4276c3032bdccf6c152cf4bc86e648d745bbf7fd84ee63a9c8876cc1c7648d3"}
Jul 28 20:26:32.853875 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.853617    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"
Jul 28 20:26:32.853875 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.853628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj" event={"ID":"c534a445-7f5d-4fe5-b68f-03a86822698c","Type":"ContainerDied","Data":"e3d9150a8a7649ee3795fce4f6981b36ed3de9d5c24e6156efba2edcf7725772"}
Jul 28 20:26:32.861303 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.861286    2563 scope.go:117] "RemoveContainer" containerID="1e728ec96d050396a900648ad38d6374ba95a03657fe51a8bdff1327dabd6a6b"
Jul 28 20:26:32.861609 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:26:32.861585    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e728ec96d050396a900648ad38d6374ba95a03657fe51a8bdff1327dabd6a6b\": container with ID starting with 1e728ec96d050396a900648ad38d6374ba95a03657fe51a8bdff1327dabd6a6b not found: ID does not exist" containerID="1e728ec96d050396a900648ad38d6374ba95a03657fe51a8bdff1327dabd6a6b"
Jul 28 20:26:32.861680 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.861616    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e728ec96d050396a900648ad38d6374ba95a03657fe51a8bdff1327dabd6a6b"} err="failed to get container status \"1e728ec96d050396a900648ad38d6374ba95a03657fe51a8bdff1327dabd6a6b\": rpc error: code = NotFound desc = could not find container \"1e728ec96d050396a900648ad38d6374ba95a03657fe51a8bdff1327dabd6a6b\": container with ID starting with 1e728ec96d050396a900648ad38d6374ba95a03657fe51a8bdff1327dabd6a6b not found: ID does not exist"
Jul 28 20:26:32.861680 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.861633    2563 scope.go:117] "RemoveContainer" containerID="f4276c3032bdccf6c152cf4bc86e648d745bbf7fd84ee63a9c8876cc1c7648d3"
Jul 28 20:26:32.869670 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.869651    2563 scope.go:117] "RemoveContainer" containerID="f4276c3032bdccf6c152cf4bc86e648d745bbf7fd84ee63a9c8876cc1c7648d3"
Jul 28 20:26:32.869939 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:26:32.869923    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4276c3032bdccf6c152cf4bc86e648d745bbf7fd84ee63a9c8876cc1c7648d3\": container with ID starting with f4276c3032bdccf6c152cf4bc86e648d745bbf7fd84ee63a9c8876cc1c7648d3 not found: ID does not exist" containerID="f4276c3032bdccf6c152cf4bc86e648d745bbf7fd84ee63a9c8876cc1c7648d3"
Jul 28 20:26:32.869994 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.869946    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4276c3032bdccf6c152cf4bc86e648d745bbf7fd84ee63a9c8876cc1c7648d3"} err="failed to get container status \"f4276c3032bdccf6c152cf4bc86e648d745bbf7fd84ee63a9c8876cc1c7648d3\": rpc error: code = NotFound desc = could not find container \"f4276c3032bdccf6c152cf4bc86e648d745bbf7fd84ee63a9c8876cc1c7648d3\": container with ID starting with f4276c3032bdccf6c152cf4bc86e648d745bbf7fd84ee63a9c8876cc1c7648d3 not found: ID does not exist"
Jul 28 20:26:32.885635 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.885613    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"]
Jul 28 20:26:32.891795 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.891772    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bd928b/rate-test-model-bd928b-kserve-bc4846467-2h8bj"]
Jul 28 20:26:32.931935 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.931879    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-home\") pod \"747982d1-f32e-4204-9bf5-6f1816731e6f\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") "
Jul 28 20:26:32.931935 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.931911    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-tmp-dir\") pod \"747982d1-f32e-4204-9bf5-6f1816731e6f\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") "
Jul 28 20:26:32.932090 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.931972    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-dshm\") pod \"747982d1-f32e-4204-9bf5-6f1816731e6f\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") "
Jul 28 20:26:32.932090 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.932001    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/747982d1-f32e-4204-9bf5-6f1816731e6f-tls-certs\") pod \"747982d1-f32e-4204-9bf5-6f1816731e6f\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") "
Jul 28 20:26:32.932090 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.932024    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-model-cache\") pod \"747982d1-f32e-4204-9bf5-6f1816731e6f\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") "
Jul 28 20:26:32.932090 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.932046    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ln92\" (UniqueName: \"kubernetes.io/projected/747982d1-f32e-4204-9bf5-6f1816731e6f-kube-api-access-7ln92\") pod \"747982d1-f32e-4204-9bf5-6f1816731e6f\" (UID: \"747982d1-f32e-4204-9bf5-6f1816731e6f\") "
Jul 28 20:26:32.932295 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.932140    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-home" (OuterVolumeSpecName: "home") pod "747982d1-f32e-4204-9bf5-6f1816731e6f" (UID: "747982d1-f32e-4204-9bf5-6f1816731e6f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:26:32.932295 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.932247    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-model-cache" (OuterVolumeSpecName: "model-cache") pod "747982d1-f32e-4204-9bf5-6f1816731e6f" (UID: "747982d1-f32e-4204-9bf5-6f1816731e6f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:26:32.932295 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.932265    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "747982d1-f32e-4204-9bf5-6f1816731e6f" (UID: "747982d1-f32e-4204-9bf5-6f1816731e6f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:26:32.932434 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.932338    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-model-cache\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:32.932434 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.932356    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-home\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:32.932434 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.932370    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-tmp-dir\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:32.934086 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.934064    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-dshm" (OuterVolumeSpecName: "dshm") pod "747982d1-f32e-4204-9bf5-6f1816731e6f" (UID: "747982d1-f32e-4204-9bf5-6f1816731e6f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:26:32.934160 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.934122    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/747982d1-f32e-4204-9bf5-6f1816731e6f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "747982d1-f32e-4204-9bf5-6f1816731e6f" (UID: "747982d1-f32e-4204-9bf5-6f1816731e6f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:26:32.934160 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:32.934129    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/747982d1-f32e-4204-9bf5-6f1816731e6f-kube-api-access-7ln92" (OuterVolumeSpecName: "kube-api-access-7ln92") pod "747982d1-f32e-4204-9bf5-6f1816731e6f" (UID: "747982d1-f32e-4204-9bf5-6f1816731e6f"). InnerVolumeSpecName "kube-api-access-7ln92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:26:33.033307 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:33.033281    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/747982d1-f32e-4204-9bf5-6f1816731e6f-dshm\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:33.033307 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:33.033304    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/747982d1-f32e-4204-9bf5-6f1816731e6f-tls-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:33.033455 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:33.033315    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ln92\" (UniqueName: \"kubernetes.io/projected/747982d1-f32e-4204-9bf5-6f1816731e6f-kube-api-access-7ln92\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:33.176419 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:33.176390    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"]
Jul 28 20:26:33.183536 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:33.183475    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-60efb4/rate-test-model-60efb4-kserve-58ddb799-s577n"]
Jul 28 20:26:33.604499 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:33.604466    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="747982d1-f32e-4204-9bf5-6f1816731e6f" path="/var/lib/kubelet/pods/747982d1-f32e-4204-9bf5-6f1816731e6f/volumes"
Jul 28 20:26:33.604892 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:33.604877    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c534a445-7f5d-4fe5-b68f-03a86822698c" path="/var/lib/kubelet/pods/c534a445-7f5d-4fe5-b68f-03a86822698c/volumes"
Jul 28 20:26:33.990939 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:33.990915    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149793792"
Jul 28 20:26:34.012334 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.012293    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7590-140504149793792_6b54a17f-5951-4cbb-b5da-c239e83d2bdd/test-curl-7590-140504149793792/0.log"
Jul 28 20:26:34.040275 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.040247    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7590-140504149793792"]
Jul 28 20:26:34.043473 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.043449    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7590-140504149793792"]
Jul 28 20:26:34.141827 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.141751    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rgj2\" (UniqueName: \"kubernetes.io/projected/6b54a17f-5951-4cbb-b5da-c239e83d2bdd-kube-api-access-4rgj2\") pod \"6b54a17f-5951-4cbb-b5da-c239e83d2bdd\" (UID: \"6b54a17f-5951-4cbb-b5da-c239e83d2bdd\") "
Jul 28 20:26:34.143712 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.143683    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b54a17f-5951-4cbb-b5da-c239e83d2bdd-kube-api-access-4rgj2" (OuterVolumeSpecName: "kube-api-access-4rgj2") pod "6b54a17f-5951-4cbb-b5da-c239e83d2bdd" (UID: "6b54a17f-5951-4cbb-b5da-c239e83d2bdd"). InnerVolumeSpecName "kube-api-access-4rgj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:26:34.174238 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.174212    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7590-140504149793792"]
Jul 28 20:26:34.174573 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.174560    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b54a17f-5951-4cbb-b5da-c239e83d2bdd" containerName="test-curl-7590-140504149793792"
Jul 28 20:26:34.174621 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.174575    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b54a17f-5951-4cbb-b5da-c239e83d2bdd" containerName="test-curl-7590-140504149793792"
Jul 28 20:26:34.174621 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.174600    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="747982d1-f32e-4204-9bf5-6f1816731e6f" containerName="main"
Jul 28 20:26:34.174621 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.174608    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="747982d1-f32e-4204-9bf5-6f1816731e6f" containerName="main"
Jul 28 20:26:34.174621 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.174619    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c534a445-7f5d-4fe5-b68f-03a86822698c" containerName="main"
Jul 28 20:26:34.174752 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.174625    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c534a445-7f5d-4fe5-b68f-03a86822698c" containerName="main"
Jul 28 20:26:34.174752 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.174685    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c534a445-7f5d-4fe5-b68f-03a86822698c" containerName="main"
Jul 28 20:26:34.174752 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.174697    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="747982d1-f32e-4204-9bf5-6f1816731e6f" containerName="main"
Jul 28 20:26:34.174752 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.174704    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b54a17f-5951-4cbb-b5da-c239e83d2bdd" containerName="test-curl-7590-140504149793792"
Jul 28 20:26:34.177694 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.177677    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149793792"
Jul 28 20:26:34.185195 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.184894    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7590-140504149793792"]
Jul 28 20:26:34.242391 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.242349    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rgj2\" (UniqueName: \"kubernetes.io/projected/6b54a17f-5951-4cbb-b5da-c239e83d2bdd-kube-api-access-4rgj2\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:34.342964 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.342919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67r27\" (UniqueName: \"kubernetes.io/projected/a72f431d-5655-4b53-941c-2f8b9c4af4cf-kube-api-access-67r27\") pod \"test-curl-7590-140504149793792\" (UID: \"a72f431d-5655-4b53-941c-2f8b9c4af4cf\") " pod="opendatahub/test-curl-7590-140504149793792"
Jul 28 20:26:34.444267 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.444173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67r27\" (UniqueName: \"kubernetes.io/projected/a72f431d-5655-4b53-941c-2f8b9c4af4cf-kube-api-access-67r27\") pod \"test-curl-7590-140504149793792\" (UID: \"a72f431d-5655-4b53-941c-2f8b9c4af4cf\") " pod="opendatahub/test-curl-7590-140504149793792"
Jul 28 20:26:34.453149 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.453122    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67r27\" (UniqueName: \"kubernetes.io/projected/a72f431d-5655-4b53-941c-2f8b9c4af4cf-kube-api-access-67r27\") pod \"test-curl-7590-140504149793792\" (UID: \"a72f431d-5655-4b53-941c-2f8b9c4af4cf\") " pod="opendatahub/test-curl-7590-140504149793792"
Jul 28 20:26:34.488199 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.488173    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149793792"
Jul 28 20:26:34.614120 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.614094    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7590-140504149793792"]
Jul 28 20:26:34.615376 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:26:34.615348    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda72f431d_5655_4b53_941c_2f8b9c4af4cf.slice/crio-7956832466a462a5aee32d6b69023ac17b05fc96127cdd922e62b8d50ae3c23f WatchSource:0}: Error finding container 7956832466a462a5aee32d6b69023ac17b05fc96127cdd922e62b8d50ae3c23f: Status 404 returned error can't find the container with id 7956832466a462a5aee32d6b69023ac17b05fc96127cdd922e62b8d50ae3c23f
Jul 28 20:26:34.867767 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.867728    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7590-140504149793792" event={"ID":"a72f431d-5655-4b53-941c-2f8b9c4af4cf","Type":"ContainerStarted","Data":"7956832466a462a5aee32d6b69023ac17b05fc96127cdd922e62b8d50ae3c23f"}
Jul 28 20:26:34.868882 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.868858    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82d3dc869e067555e277d185fbe06d67944861085ad9d2357f95ba639c784649"
Jul 28 20:26:34.868998 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.868888    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149793792"
Jul 28 20:26:34.880247 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:34.880223    2563 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7590-140504149793792" oldPodUID="6b54a17f-5951-4cbb-b5da-c239e83d2bdd" podUID="a72f431d-5655-4b53-941c-2f8b9c4af4cf"
Jul 28 20:26:35.604615 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:35.604584    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b54a17f-5951-4cbb-b5da-c239e83d2bdd" path="/var/lib/kubelet/pods/6b54a17f-5951-4cbb-b5da-c239e83d2bdd/volumes"
Jul 28 20:26:35.874976 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:35.874892    2563 generic.go:356] "Generic (PLEG): container finished" podID="a72f431d-5655-4b53-941c-2f8b9c4af4cf" containerID="1b871d3bdaf6071f45da117e0636f045937ee32b5ecfafbc047611a1e4942d38" exitCode=0
Jul 28 20:26:35.875136 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:35.874977    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7590-140504149793792" event={"ID":"a72f431d-5655-4b53-941c-2f8b9c4af4cf","Type":"ContainerDied","Data":"1b871d3bdaf6071f45da117e0636f045937ee32b5ecfafbc047611a1e4942d38"}
Jul 28 20:26:37.007653 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.007633    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149793792"
Jul 28 20:26:37.030892 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.030870    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7590-140504149793792_a72f431d-5655-4b53-941c-2f8b9c4af4cf/test-curl-7590-140504149793792/0.log"
Jul 28 20:26:37.057327 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.057298    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7590-140504149793792"]
Jul 28 20:26:37.060799 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.060776    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7590-140504149793792"]
Jul 28 20:26:37.169243 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.169159    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67r27\" (UniqueName: \"kubernetes.io/projected/a72f431d-5655-4b53-941c-2f8b9c4af4cf-kube-api-access-67r27\") pod \"a72f431d-5655-4b53-941c-2f8b9c4af4cf\" (UID: \"a72f431d-5655-4b53-941c-2f8b9c4af4cf\") "
Jul 28 20:26:37.171170 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.171144    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a72f431d-5655-4b53-941c-2f8b9c4af4cf-kube-api-access-67r27" (OuterVolumeSpecName: "kube-api-access-67r27") pod "a72f431d-5655-4b53-941c-2f8b9c4af4cf" (UID: "a72f431d-5655-4b53-941c-2f8b9c4af4cf"). InnerVolumeSpecName "kube-api-access-67r27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:26:37.270115 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.270078    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67r27\" (UniqueName: \"kubernetes.io/projected/a72f431d-5655-4b53-941c-2f8b9c4af4cf-kube-api-access-67r27\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:26:37.604188 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.604145    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a72f431d-5655-4b53-941c-2f8b9c4af4cf" path="/var/lib/kubelet/pods/a72f431d-5655-4b53-941c-2f8b9c4af4cf/volumes"
Jul 28 20:26:37.886969 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.886885    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7590-140504149793792"
Jul 28 20:26:37.886969 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.886948    2563 scope.go:117] "RemoveContainer" containerID="1b871d3bdaf6071f45da117e0636f045937ee32b5ecfafbc047611a1e4942d38"
Jul 28 20:26:37.908289 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.908256    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"]
Jul 28 20:26:37.909356 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.909330    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a72f431d-5655-4b53-941c-2f8b9c4af4cf" containerName="test-curl-7590-140504149793792"
Jul 28 20:26:37.909504 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.909493    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a72f431d-5655-4b53-941c-2f8b9c4af4cf" containerName="test-curl-7590-140504149793792"
Jul 28 20:26:37.909781 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.909766    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a72f431d-5655-4b53-941c-2f8b9c4af4cf" containerName="test-curl-7590-140504149793792"
Jul 28 20:26:37.914930 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.914904    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:37.917456 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.917437    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-d7a9b9-openshift-default-dockercfg-d7lvf\""
Jul 28 20:26:37.923898 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:37.923874    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"]
Jul 28 20:26:38.077632 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.077594    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-podinfo\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.077632 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.077631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/878ebedf-be68-4f49-b07c-60f5f1963f0e-istiod-ca-cert\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.078064 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.077679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-credential-socket\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.078064 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.077740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-workload-socket\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.078064 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.077781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-workload-certs\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.078064 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.077797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-token\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.078064 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.077824    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-data\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.078064 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.077883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-envoy\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.078064 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.077903    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb6s5\" (UniqueName: \"kubernetes.io/projected/878ebedf-be68-4f49-b07c-60f5f1963f0e-kube-api-access-gb6s5\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.179188 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.179091    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-credential-socket\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.179188 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.179131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-workload-socket\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.179188 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.179152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-workload-certs\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.179188 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.179168    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-token\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.179575 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.179298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-data\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.179575 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.179360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-envoy\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.179575 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.179389    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb6s5\" (UniqueName: \"kubernetes.io/projected/878ebedf-be68-4f49-b07c-60f5f1963f0e-kube-api-access-gb6s5\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.179575 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.179422    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-podinfo\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.179575 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.179444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/878ebedf-be68-4f49-b07c-60f5f1963f0e-istiod-ca-cert\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.179575 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.179481    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-credential-socket\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.179575 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.179532    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-workload-socket\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.179841 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.179624    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-workload-certs\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.179841 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.179657    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-data\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.180096 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.180074    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/878ebedf-be68-4f49-b07c-60f5f1963f0e-istiod-ca-cert\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.181689 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.181672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-envoy\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.181891 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.181875    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-podinfo\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.188202 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.188168    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-token\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.188332 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.188313    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb6s5\" (UniqueName: \"kubernetes.io/projected/878ebedf-be68-4f49-b07c-60f5f1963f0e-kube-api-access-gb6s5\") pod \"e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") " pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.225627 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.225597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:38.363748 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.363722    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"]
Jul 28 20:26:38.365250 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:26:38.365222    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod878ebedf_be68_4f49_b07c_60f5f1963f0e.slice/crio-5be683080837d49aa3d3e919002a8a9cf3dcfdf54d0e7109d02f41103e677e6a WatchSource:0}: Error finding container 5be683080837d49aa3d3e919002a8a9cf3dcfdf54d0e7109d02f41103e677e6a: Status 404 returned error can't find the container with id 5be683080837d49aa3d3e919002a8a9cf3dcfdf54d0e7109d02f41103e677e6a
Jul 28 20:26:38.367910 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.367873    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:26:38.367999 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.367955    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:26:38.367999 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.367984    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:26:38.893414 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.893376    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n" event={"ID":"878ebedf-be68-4f49-b07c-60f5f1963f0e","Type":"ContainerStarted","Data":"81f2ac2d062dd6863e43f325a7def65225162badf4fd0343aea8b22b87eade13"}
Jul 28 20:26:38.893632 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.893430    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n" event={"ID":"878ebedf-be68-4f49-b07c-60f5f1963f0e","Type":"ContainerStarted","Data":"5be683080837d49aa3d3e919002a8a9cf3dcfdf54d0e7109d02f41103e677e6a"}
Jul 28 20:26:38.918088 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:38.918028    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n" podStartSLOduration=1.918011854 podStartE2EDuration="1.918011854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:26:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:38.916425757 +0000 UTC m=+3083.938721344" watchObservedRunningTime="2026-07-28 20:26:38.918011854 +0000 UTC m=+3083.940307486"
Jul 28 20:26:39.226468 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:39.226376    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:39.231415 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:39.231392    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:39.899979 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:39.899945    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:39.900964 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:39.900930    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:48.497413 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:48.497382    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mkfd2"]
Jul 28 20:26:48.500620 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:48.500605    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mkfd2"
Jul 28 20:26:48.503489 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:48.503470    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2x2v4\""
Jul 28 20:26:48.510424 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:48.510403    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mkfd2"]
Jul 28 20:26:48.565747 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:48.565715    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zxvp\" (UniqueName: \"kubernetes.io/projected/efa893ed-f42c-4129-a601-0c995bf61f04-kube-api-access-8zxvp\") pod \"kuadrant-operator-catalog-mkfd2\" (UID: \"efa893ed-f42c-4129-a601-0c995bf61f04\") " pod="kuadrant-system/kuadrant-operator-catalog-mkfd2"
Jul 28 20:26:48.667037 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:48.667000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zxvp\" (UniqueName: \"kubernetes.io/projected/efa893ed-f42c-4129-a601-0c995bf61f04-kube-api-access-8zxvp\") pod \"kuadrant-operator-catalog-mkfd2\" (UID: \"efa893ed-f42c-4129-a601-0c995bf61f04\") " pod="kuadrant-system/kuadrant-operator-catalog-mkfd2"
Jul 28 20:26:48.676879 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:48.676851    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zxvp\" (UniqueName: \"kubernetes.io/projected/efa893ed-f42c-4129-a601-0c995bf61f04-kube-api-access-8zxvp\") pod \"kuadrant-operator-catalog-mkfd2\" (UID: \"efa893ed-f42c-4129-a601-0c995bf61f04\") " pod="kuadrant-system/kuadrant-operator-catalog-mkfd2"
Jul 28 20:26:48.811198 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:48.811104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mkfd2"
Jul 28 20:26:48.943264 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:48.943238    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mkfd2"]
Jul 28 20:26:48.945174 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:26:48.945144    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa893ed_f42c_4129_a601_0c995bf61f04.slice/crio-871d62a0ac5dfc4e4a1076b47db11fe7c2c83edef95d5d645e37c52b58f7e8a9 WatchSource:0}: Error finding container 871d62a0ac5dfc4e4a1076b47db11fe7c2c83edef95d5d645e37c52b58f7e8a9: Status 404 returned error can't find the container with id 871d62a0ac5dfc4e4a1076b47db11fe7c2c83edef95d5d645e37c52b58f7e8a9
Jul 28 20:26:49.230234 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:49.230143    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:26:49.955503 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:49.955463    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mkfd2" event={"ID":"efa893ed-f42c-4129-a601-0c995bf61f04","Type":"ContainerStarted","Data":"871d62a0ac5dfc4e4a1076b47db11fe7c2c83edef95d5d645e37c52b58f7e8a9"}
Jul 28 20:26:51.987937 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:51.987889    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mkfd2" event={"ID":"efa893ed-f42c-4129-a601-0c995bf61f04","Type":"ContainerStarted","Data":"c2779692fbb398694c3cbe1cfee972a2e9952cf4d7e1c02219586ceee9970e9d"}
Jul 28 20:26:52.007476 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:52.007434    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mkfd2" podStartSLOduration=1.5030494559999998 podStartE2EDuration="4.007419608s" totalImagesPullingTime="2.504370152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:26:52.006432352 +0000 UTC m=+3097.028727936" watchObservedRunningTime="2026-07-28 20:26:52.007419608 +0000 UTC m=+3097.029715232"
Jul 28 20:26:55.940723 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:55.940682    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 20:26:55.941107 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:55.940757    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n" podUID="878ebedf-be68-4f49-b07c-60f5f1963f0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 20:26:57.015749 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:57.015717    2563 generic.go:356] "Generic (PLEG): container finished" podID="878ebedf-be68-4f49-b07c-60f5f1963f0e" containerID="81f2ac2d062dd6863e43f325a7def65225162badf4fd0343aea8b22b87eade13" exitCode=0
Jul 28 20:26:57.016139 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:57.015764    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n" event={"ID":"878ebedf-be68-4f49-b07c-60f5f1963f0e","Type":"ContainerDied","Data":"81f2ac2d062dd6863e43f325a7def65225162badf4fd0343aea8b22b87eade13"}
Jul 28 20:26:57.016139 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:57.016114    2563 scope.go:117] "RemoveContainer" containerID="81f2ac2d062dd6863e43f325a7def65225162badf4fd0343aea8b22b87eade13"
Jul 28 20:26:57.017183 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:57.017147    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:26:57.017252 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:57.017225    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:26:57.017292 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:57.017260    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:26:58.022491 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:58.022456    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n" event={"ID":"878ebedf-be68-4f49-b07c-60f5f1963f0e","Type":"ContainerStarted","Data":"138399f8a0fdb09671bd00b09f429c4e35aa0da841789a717b1cd546c9753e4f"}
Jul 28 20:26:58.226478 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:58.226440    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:26:58.226696 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:58.226671    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 28 20:26:58.226751 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:58.226734    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n" podUID="878ebedf-be68-4f49-b07c-60f5f1963f0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 28 20:26:58.811969 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:58.811917    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mkfd2"
Jul 28 20:26:58.812161 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:58.811990    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mkfd2"
Jul 28 20:26:58.833350 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:58.833318    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mkfd2"
Jul 28 20:26:59.049221 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:59.049195    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mkfd2"
Jul 28 20:26:59.089069 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:59.088978    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mkfd2"]
Jul 28 20:26:59.227020 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:59.226982    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 28 20:26:59.227210 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:26:59.227065    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n" podUID="878ebedf-be68-4f49-b07c-60f5f1963f0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 28 20:27:00.226915 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:00.226875    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 28 20:27:00.227305 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:00.226931    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n" podUID="878ebedf-be68-4f49-b07c-60f5f1963f0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 28 20:27:01.039416 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:01.039372    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-mkfd2" podUID="efa893ed-f42c-4129-a601-0c995bf61f04" containerName="registry-server" containerID="cri-o://c2779692fbb398694c3cbe1cfee972a2e9952cf4d7e1c02219586ceee9970e9d" gracePeriod=2
Jul 28 20:27:01.226985 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:01.226954    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 28 20:27:01.227335 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:01.227021    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n" podUID="878ebedf-be68-4f49-b07c-60f5f1963f0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 28 20:27:01.334163 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:01.334141    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mkfd2"
Jul 28 20:27:01.387160 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:01.387129    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zxvp\" (UniqueName: \"kubernetes.io/projected/efa893ed-f42c-4129-a601-0c995bf61f04-kube-api-access-8zxvp\") pod \"efa893ed-f42c-4129-a601-0c995bf61f04\" (UID: \"efa893ed-f42c-4129-a601-0c995bf61f04\") "
Jul 28 20:27:01.389308 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:01.389281    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efa893ed-f42c-4129-a601-0c995bf61f04-kube-api-access-8zxvp" (OuterVolumeSpecName: "kube-api-access-8zxvp") pod "efa893ed-f42c-4129-a601-0c995bf61f04" (UID: "efa893ed-f42c-4129-a601-0c995bf61f04"). InnerVolumeSpecName "kube-api-access-8zxvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:27:01.488112 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:01.488077    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zxvp\" (UniqueName: \"kubernetes.io/projected/efa893ed-f42c-4129-a601-0c995bf61f04-kube-api-access-8zxvp\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:27:02.045398 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:02.045364    2563 generic.go:356] "Generic (PLEG): container finished" podID="efa893ed-f42c-4129-a601-0c995bf61f04" containerID="c2779692fbb398694c3cbe1cfee972a2e9952cf4d7e1c02219586ceee9970e9d" exitCode=0
Jul 28 20:27:02.045599 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:02.045408    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mkfd2"
Jul 28 20:27:02.045599 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:02.045442    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mkfd2" event={"ID":"efa893ed-f42c-4129-a601-0c995bf61f04","Type":"ContainerDied","Data":"c2779692fbb398694c3cbe1cfee972a2e9952cf4d7e1c02219586ceee9970e9d"}
Jul 28 20:27:02.045599 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:02.045489    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mkfd2" event={"ID":"efa893ed-f42c-4129-a601-0c995bf61f04","Type":"ContainerDied","Data":"871d62a0ac5dfc4e4a1076b47db11fe7c2c83edef95d5d645e37c52b58f7e8a9"}
Jul 28 20:27:02.045599 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:02.045510    2563 scope.go:117] "RemoveContainer" containerID="c2779692fbb398694c3cbe1cfee972a2e9952cf4d7e1c02219586ceee9970e9d"
Jul 28 20:27:02.054499 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:02.054482    2563 scope.go:117] "RemoveContainer" containerID="c2779692fbb398694c3cbe1cfee972a2e9952cf4d7e1c02219586ceee9970e9d"
Jul 28 20:27:02.054764 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:27:02.054747    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2779692fbb398694c3cbe1cfee972a2e9952cf4d7e1c02219586ceee9970e9d\": container with ID starting with c2779692fbb398694c3cbe1cfee972a2e9952cf4d7e1c02219586ceee9970e9d not found: ID does not exist" containerID="c2779692fbb398694c3cbe1cfee972a2e9952cf4d7e1c02219586ceee9970e9d"
Jul 28 20:27:02.054831 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:02.054776    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2779692fbb398694c3cbe1cfee972a2e9952cf4d7e1c02219586ceee9970e9d"} err="failed to get container status \"c2779692fbb398694c3cbe1cfee972a2e9952cf4d7e1c02219586ceee9970e9d\": rpc error: code = NotFound desc = could not find container \"c2779692fbb398694c3cbe1cfee972a2e9952cf4d7e1c02219586ceee9970e9d\": container with ID starting with c2779692fbb398694c3cbe1cfee972a2e9952cf4d7e1c02219586ceee9970e9d not found: ID does not exist"
Jul 28 20:27:02.074599 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:02.074223    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mkfd2"]
Jul 28 20:27:02.078364 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:02.078336    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mkfd2"]
Jul 28 20:27:02.226246 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:02.226207    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 28 20:27:02.226446 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:02.226268    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n" podUID="878ebedf-be68-4f49-b07c-60f5f1963f0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 28 20:27:03.230063 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:03.230032    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:27:03.230440 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:03.230321    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:27:03.231087 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:03.231069    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:27:03.603978 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:03.603948    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efa893ed-f42c-4129-a601-0c995bf61f04" path="/var/lib/kubelet/pods/efa893ed-f42c-4129-a601-0c995bf61f04/volumes"
Jul 28 20:27:07.081511 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.081480    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"]
Jul 28 20:27:07.081888 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.081832    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa893ed-f42c-4129-a601-0c995bf61f04" containerName="registry-server"
Jul 28 20:27:07.081888 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.081844    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa893ed-f42c-4129-a601-0c995bf61f04" containerName="registry-server"
Jul 28 20:27:07.081960 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.081906    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="efa893ed-f42c-4129-a601-0c995bf61f04" containerName="registry-server"
Jul 28 20:27:07.084902 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.084886    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.087418 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.087398    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-f11e93-openshift-default-dockercfg-mwglp\""
Jul 28 20:27:07.101354 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.101334    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"]
Jul 28 20:27:07.143348 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.143318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-podinfo\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.143484 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.143353    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lc99\" (UniqueName: \"kubernetes.io/projected/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-kube-api-access-7lc99\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.143484 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.143372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-data\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.143484 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.143448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-envoy\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.143629 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.143486    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-workload-socket\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.143629 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.143510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-token\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.143629 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.143584    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-workload-certs\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.143629 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.143625    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istiod-ca-cert\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.143769 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.143659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-credential-socket\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.244983 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.244947    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-workload-socket\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.245156 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.244990    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-token\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.245156 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.245107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-workload-certs\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.245253 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.245157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istiod-ca-cert\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.245253 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.245198    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-credential-socket\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.245253 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.245227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-podinfo\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.245413 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.245259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lc99\" (UniqueName: \"kubernetes.io/projected/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-kube-api-access-7lc99\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.245413 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.245288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-data\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.245413 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.245332    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-envoy\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.245413 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.245333    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-workload-socket\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.245664 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.245531    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-workload-certs\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.245664 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.245632    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-credential-socket\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.245780 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.245732    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-data\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.245993 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.245975    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istiod-ca-cert\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.247517 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.247500    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-envoy\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.247783 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.247768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-podinfo\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.253046 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.253026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-token\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.253384 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.253364    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lc99\" (UniqueName: \"kubernetes.io/projected/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-kube-api-access-7lc99\") pod \"e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") " pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.394580 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.394485    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:07.532498 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.532446    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"]
Jul 28 20:27:07.533465 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:27:07.533439    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded1df08b_4ef7_4b15_8bd2_539bd388cb1b.slice/crio-6f2c692ea6c8bdbd5f1c9cbefda638b292dd90e183f968412c108a4e78f03cf4 WatchSource:0}: Error finding container 6f2c692ea6c8bdbd5f1c9cbefda638b292dd90e183f968412c108a4e78f03cf4: Status 404 returned error can't find the container with id 6f2c692ea6c8bdbd5f1c9cbefda638b292dd90e183f968412c108a4e78f03cf4
Jul 28 20:27:07.535694 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.535663    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:27:07.535771 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.535725    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:27:07.535771 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:07.535752    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:27:08.080889 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:08.080852    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2" event={"ID":"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b","Type":"ContainerStarted","Data":"e77bc1a1fde78b0a6962e60509fffa4f141f3dfc5389390a88d56d1cde54d282"}
Jul 28 20:27:08.081073 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:08.080913    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2" event={"ID":"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b","Type":"ContainerStarted","Data":"6f2c692ea6c8bdbd5f1c9cbefda638b292dd90e183f968412c108a4e78f03cf4"}
Jul 28 20:27:08.104781 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:08.104733    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2" podStartSLOduration=1.104719208 podStartE2EDuration="1.104719208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:27:08.101433819 +0000 UTC m=+3113.123729408" watchObservedRunningTime="2026-07-28 20:27:08.104719208 +0000 UTC m=+3113.127014867"
Jul 28 20:27:08.395683 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:08.395591    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:08.400360 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:08.400335    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:09.086867 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:09.086832    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:09.087649 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:09.087633    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:19.741224 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:19.741187    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:27:28.186121 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:28.186085    2563 generic.go:356] "Generic (PLEG): container finished" podID="ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" containerID="e77bc1a1fde78b0a6962e60509fffa4f141f3dfc5389390a88d56d1cde54d282" exitCode=0
Jul 28 20:27:28.186532 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:28.186152    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2" event={"ID":"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b","Type":"ContainerDied","Data":"e77bc1a1fde78b0a6962e60509fffa4f141f3dfc5389390a88d56d1cde54d282"}
Jul 28 20:27:28.186592 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:28.186564    2563 scope.go:117] "RemoveContainer" containerID="e77bc1a1fde78b0a6962e60509fffa4f141f3dfc5389390a88d56d1cde54d282"
Jul 28 20:27:28.187636 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:28.187607    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:27:28.187709 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:28.187692    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:27:28.187766 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:28.187732    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 28 20:27:29.192855 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:29.192823    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2" event={"ID":"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b","Type":"ContainerStarted","Data":"61286d204d5cb90ae9667b568c3f4a3a78265eb8eb83242981f0dba7556abe1f"}
Jul 28 20:27:29.394892 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:29.394848    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:29.395106 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:29.395084    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 28 20:27:29.395162 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:29.395129    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2" podUID="ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 28 20:27:30.395427 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:30.395389    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 28 20:27:30.395860 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:30.395449    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2" podUID="ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 28 20:27:31.395314 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:31.395269    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 28 20:27:31.395509 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:31.395339    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2" podUID="ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 28 20:27:32.395251 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:32.395216    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 28 20:27:32.395422 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:32.395276    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2" podUID="ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 28 20:27:33.395080 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:33.395044    2563 patch_prober.go:28] interesting pod/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 28 20:27:33.395461 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:33.395113    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2" podUID="ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 28 20:27:34.399614 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:34.399584    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:34.399997 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:34.399836    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:34.400449 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:34.400432    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:27:45.050678 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.050645    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"]
Jul 28 20:27:45.053111 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.053095    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.056136 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.056114    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-d7a9b9\"/\"default-dockercfg-2nl84\""
Jul 28 20:27:45.056435 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.056415    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-d7a9b9\"/\"openshift-service-ca.crt\""
Jul 28 20:27:45.057023 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.057008    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-d7a9b9\"/\"kube-root-ca.crt\""
Jul 28 20:27:45.057186 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.057168    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-d7a9b9\"/\"ipp-route-d7a9b9-kserve-self-signed-certs\""
Jul 28 20:27:45.066909 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.066887    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"]
Jul 28 20:27:45.087901 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.087862    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-home\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.088061 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.087905    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-model-cache\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.088061 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.087941    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-dshm\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.088061 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.087985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb59m\" (UniqueName: \"kubernetes.io/projected/26a971dd-501c-423c-86f1-6c075f194e93-kube-api-access-cb59m\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.088061 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.088011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-tmp-dir\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.088226 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.088102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26a971dd-501c-423c-86f1-6c075f194e93-tls-certs\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.189456 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.189417    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26a971dd-501c-423c-86f1-6c075f194e93-tls-certs\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.189456 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.189462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-home\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.189765 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.189480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-model-cache\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.189765 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.189609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-dshm\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.189765 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.189675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb59m\" (UniqueName: \"kubernetes.io/projected/26a971dd-501c-423c-86f1-6c075f194e93-kube-api-access-cb59m\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.189765 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.189715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-tmp-dir\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.189995 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.189970    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-home\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.190045 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.189988    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-model-cache\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.190098 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.190078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-tmp-dir\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.191768 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.191743    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-dshm\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.192037 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.192021    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26a971dd-501c-423c-86f1-6c075f194e93-tls-certs\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.198316 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.198292    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb59m\" (UniqueName: \"kubernetes.io/projected/26a971dd-501c-423c-86f1-6c075f194e93-kube-api-access-cb59m\") pod \"ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") " pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.362060 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.361955    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:45.491386 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:45.491353    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"]
Jul 28 20:27:45.492589 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:27:45.492564    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26a971dd_501c_423c_86f1_6c075f194e93.slice/crio-e7e726e410fbeadcf517e3110261a31e51269e235f89bd96820a3918ecd17f0a WatchSource:0}: Error finding container e7e726e410fbeadcf517e3110261a31e51269e235f89bd96820a3918ecd17f0a: Status 404 returned error can't find the container with id e7e726e410fbeadcf517e3110261a31e51269e235f89bd96820a3918ecd17f0a
Jul 28 20:27:46.278778 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:46.278741    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675" event={"ID":"26a971dd-501c-423c-86f1-6c075f194e93","Type":"ContainerStarted","Data":"80f7400ca1ec5a6a654adaf4a897575b69d7ac1f60beeeeb4ea9028d34ca6f6e"}
Jul 28 20:27:46.278778 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:46.278786    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675" event={"ID":"26a971dd-501c-423c-86f1-6c075f194e93","Type":"ContainerStarted","Data":"e7e726e410fbeadcf517e3110261a31e51269e235f89bd96820a3918ecd17f0a"}
Jul 28 20:27:46.297184 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:46.297136    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675" podStartSLOduration=1.297120409 podStartE2EDuration="1.297120409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:27:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:27:46.296023609 +0000 UTC m=+3151.318319216" watchObservedRunningTime="2026-07-28 20:27:46.297120409 +0000 UTC m=+3151.319416035"
Jul 28 20:27:48.637256 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:48.637215    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:27:55.362620 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:55.362589    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:55.362620 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:55.362629    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:55.375343 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:55.375316    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:27:56.349135 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:27:56.349104    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:28:37.333336 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:28:37.333301    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:28:58.037848 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:28:58.037814    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:29:27.439820 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:29:27.439739    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:29:48.937897 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:29:48.937862    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:29:55.385531 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:29:55.385497    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"]
Jul 28 20:29:59.634263 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:29:59.634225    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:30:10.404412 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.404345    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675" podUID="26a971dd-501c-423c-86f1-6c075f194e93" containerName="main" containerID="cri-o://80f7400ca1ec5a6a654adaf4a897575b69d7ac1f60beeeeb4ea9028d34ca6f6e" gracePeriod=45
Jul 28 20:30:10.652037 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.652014    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:30:10.761233 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.761203    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-dshm\") pod \"26a971dd-501c-423c-86f1-6c075f194e93\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") "
Jul 28 20:30:10.761402 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.761237    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb59m\" (UniqueName: \"kubernetes.io/projected/26a971dd-501c-423c-86f1-6c075f194e93-kube-api-access-cb59m\") pod \"26a971dd-501c-423c-86f1-6c075f194e93\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") "
Jul 28 20:30:10.761402 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.761257    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-tmp-dir\") pod \"26a971dd-501c-423c-86f1-6c075f194e93\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") "
Jul 28 20:30:10.761402 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.761326    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26a971dd-501c-423c-86f1-6c075f194e93-tls-certs\") pod \"26a971dd-501c-423c-86f1-6c075f194e93\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") "
Jul 28 20:30:10.761402 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.761353    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-home\") pod \"26a971dd-501c-423c-86f1-6c075f194e93\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") "
Jul 28 20:30:10.761402 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.761378    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-model-cache\") pod \"26a971dd-501c-423c-86f1-6c075f194e93\" (UID: \"26a971dd-501c-423c-86f1-6c075f194e93\") "
Jul 28 20:30:10.761688 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.761605    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "26a971dd-501c-423c-86f1-6c075f194e93" (UID: "26a971dd-501c-423c-86f1-6c075f194e93"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:30:10.761688 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.761666    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-home" (OuterVolumeSpecName: "home") pod "26a971dd-501c-423c-86f1-6c075f194e93" (UID: "26a971dd-501c-423c-86f1-6c075f194e93"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:30:10.761803 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.761760    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-model-cache" (OuterVolumeSpecName: "model-cache") pod "26a971dd-501c-423c-86f1-6c075f194e93" (UID: "26a971dd-501c-423c-86f1-6c075f194e93"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:30:10.763479 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.763449    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26a971dd-501c-423c-86f1-6c075f194e93-kube-api-access-cb59m" (OuterVolumeSpecName: "kube-api-access-cb59m") pod "26a971dd-501c-423c-86f1-6c075f194e93" (UID: "26a971dd-501c-423c-86f1-6c075f194e93"). InnerVolumeSpecName "kube-api-access-cb59m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:30:10.763479 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.763455    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-dshm" (OuterVolumeSpecName: "dshm") pod "26a971dd-501c-423c-86f1-6c075f194e93" (UID: "26a971dd-501c-423c-86f1-6c075f194e93"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:30:10.763664 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.763490    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26a971dd-501c-423c-86f1-6c075f194e93-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "26a971dd-501c-423c-86f1-6c075f194e93" (UID: "26a971dd-501c-423c-86f1-6c075f194e93"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 20:30:10.862245 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.862211    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26a971dd-501c-423c-86f1-6c075f194e93-tls-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:30:10.862245 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.862239    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-home\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:30:10.862245 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.862249    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-model-cache\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:30:10.862456 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.862256    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-dshm\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:30:10.862456 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.862265    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb59m\" (UniqueName: \"kubernetes.io/projected/26a971dd-501c-423c-86f1-6c075f194e93-kube-api-access-cb59m\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:30:10.862456 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:10.862274    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26a971dd-501c-423c-86f1-6c075f194e93-tmp-dir\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:30:11.041864 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:11.041772    2563 generic.go:356] "Generic (PLEG): container finished" podID="26a971dd-501c-423c-86f1-6c075f194e93" containerID="80f7400ca1ec5a6a654adaf4a897575b69d7ac1f60beeeeb4ea9028d34ca6f6e" exitCode=0
Jul 28 20:30:11.041864 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:11.041816    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"
Jul 28 20:30:11.042055 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:11.041856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675" event={"ID":"26a971dd-501c-423c-86f1-6c075f194e93","Type":"ContainerDied","Data":"80f7400ca1ec5a6a654adaf4a897575b69d7ac1f60beeeeb4ea9028d34ca6f6e"}
Jul 28 20:30:11.042055 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:11.041905    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675" event={"ID":"26a971dd-501c-423c-86f1-6c075f194e93","Type":"ContainerDied","Data":"e7e726e410fbeadcf517e3110261a31e51269e235f89bd96820a3918ecd17f0a"}
Jul 28 20:30:11.042055 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:11.041929    2563 scope.go:117] "RemoveContainer" containerID="80f7400ca1ec5a6a654adaf4a897575b69d7ac1f60beeeeb4ea9028d34ca6f6e"
Jul 28 20:30:11.051790 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:11.051769    2563 scope.go:117] "RemoveContainer" containerID="80f7400ca1ec5a6a654adaf4a897575b69d7ac1f60beeeeb4ea9028d34ca6f6e"
Jul 28 20:30:11.052042 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:30:11.052023    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80f7400ca1ec5a6a654adaf4a897575b69d7ac1f60beeeeb4ea9028d34ca6f6e\": container with ID starting with 80f7400ca1ec5a6a654adaf4a897575b69d7ac1f60beeeeb4ea9028d34ca6f6e not found: ID does not exist" containerID="80f7400ca1ec5a6a654adaf4a897575b69d7ac1f60beeeeb4ea9028d34ca6f6e"
Jul 28 20:30:11.052093 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:11.052052    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80f7400ca1ec5a6a654adaf4a897575b69d7ac1f60beeeeb4ea9028d34ca6f6e"} err="failed to get container status \"80f7400ca1ec5a6a654adaf4a897575b69d7ac1f60beeeeb4ea9028d34ca6f6e\": rpc error: code = NotFound desc = could not find container \"80f7400ca1ec5a6a654adaf4a897575b69d7ac1f60beeeeb4ea9028d34ca6f6e\": container with ID starting with 80f7400ca1ec5a6a654adaf4a897575b69d7ac1f60beeeeb4ea9028d34ca6f6e not found: ID does not exist"
Jul 28 20:30:11.071385 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:11.071365    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"]
Jul 28 20:30:11.076346 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:11.076324    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-d7a9b9/ipp-route-d7a9b9-kserve-6c7b5cb75f-mh675"]
Jul 28 20:30:11.078994 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:30:11.078974    2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26a971dd_501c_423c_86f1_6c075f194e93.slice\": RecentStats: unable to find data in memory cache]"
Jul 28 20:30:11.605396 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:30:11.605363    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26a971dd-501c-423c-86f1-6c075f194e93" path="/var/lib/kubelet/pods/26a971dd-501c-423c-86f1-6c075f194e93/volumes"
Jul 28 20:31:04.969499 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:04.969464    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"]
Jul 28 20:31:04.969993 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:04.969700    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n" podUID="878ebedf-be68-4f49-b07c-60f5f1963f0e" containerName="istio-proxy" containerID="cri-o://138399f8a0fdb09671bd00b09f429c4e35aa0da841789a717b1cd546c9753e4f" gracePeriod=30
Jul 28 20:31:10.223074 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.223045    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:31:10.281733 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.281698    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/878ebedf-be68-4f49-b07c-60f5f1963f0e-istiod-ca-cert\") pod \"878ebedf-be68-4f49-b07c-60f5f1963f0e\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") "
Jul 28 20:31:10.281906 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.281754    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-workload-socket\") pod \"878ebedf-be68-4f49-b07c-60f5f1963f0e\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") "
Jul 28 20:31:10.281954 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.281895    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-token\") pod \"878ebedf-be68-4f49-b07c-60f5f1963f0e\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") "
Jul 28 20:31:10.281954 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.281935    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-workload-certs\") pod \"878ebedf-be68-4f49-b07c-60f5f1963f0e\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") "
Jul 28 20:31:10.281954 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.281953    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-envoy\") pod \"878ebedf-be68-4f49-b07c-60f5f1963f0e\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") "
Jul 28 20:31:10.282117 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.281996    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-podinfo\") pod \"878ebedf-be68-4f49-b07c-60f5f1963f0e\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") "
Jul 28 20:31:10.282117 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.282000    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "878ebedf-be68-4f49-b07c-60f5f1963f0e" (UID: "878ebedf-be68-4f49-b07c-60f5f1963f0e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:10.282117 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.282032    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-credential-socket\") pod \"878ebedf-be68-4f49-b07c-60f5f1963f0e\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") "
Jul 28 20:31:10.282117 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.282072    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb6s5\" (UniqueName: \"kubernetes.io/projected/878ebedf-be68-4f49-b07c-60f5f1963f0e-kube-api-access-gb6s5\") pod \"878ebedf-be68-4f49-b07c-60f5f1963f0e\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") "
Jul 28 20:31:10.282117 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.282079    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/878ebedf-be68-4f49-b07c-60f5f1963f0e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "878ebedf-be68-4f49-b07c-60f5f1963f0e" (UID: "878ebedf-be68-4f49-b07c-60f5f1963f0e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:31:10.282502 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.282463    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "878ebedf-be68-4f49-b07c-60f5f1963f0e" (UID: "878ebedf-be68-4f49-b07c-60f5f1963f0e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:10.282600 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.282576    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-data\") pod \"878ebedf-be68-4f49-b07c-60f5f1963f0e\" (UID: \"878ebedf-be68-4f49-b07c-60f5f1963f0e\") "
Jul 28 20:31:10.282799 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.282762    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "878ebedf-be68-4f49-b07c-60f5f1963f0e" (UID: "878ebedf-be68-4f49-b07c-60f5f1963f0e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:10.285003 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.283302    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-credential-socket\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:10.285003 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.283328    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/878ebedf-be68-4f49-b07c-60f5f1963f0e-istiod-ca-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:10.285003 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.283345    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-workload-socket\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:10.285003 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.283365    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-workload-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:10.285003 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.283853    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-data" (OuterVolumeSpecName: "istio-data") pod "878ebedf-be68-4f49-b07c-60f5f1963f0e" (UID: "878ebedf-be68-4f49-b07c-60f5f1963f0e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:10.285003 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.284951    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "878ebedf-be68-4f49-b07c-60f5f1963f0e" (UID: "878ebedf-be68-4f49-b07c-60f5f1963f0e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:10.285394 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.285049    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "878ebedf-be68-4f49-b07c-60f5f1963f0e" (UID: "878ebedf-be68-4f49-b07c-60f5f1963f0e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:31:10.285394 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.285175    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/878ebedf-be68-4f49-b07c-60f5f1963f0e-kube-api-access-gb6s5" (OuterVolumeSpecName: "kube-api-access-gb6s5") pod "878ebedf-be68-4f49-b07c-60f5f1963f0e" (UID: "878ebedf-be68-4f49-b07c-60f5f1963f0e"). InnerVolumeSpecName "kube-api-access-gb6s5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:10.291138 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.291112    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-token" (OuterVolumeSpecName: "istio-token") pod "878ebedf-be68-4f49-b07c-60f5f1963f0e" (UID: "878ebedf-be68-4f49-b07c-60f5f1963f0e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:10.348436 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.348401    2563 generic.go:356] "Generic (PLEG): container finished" podID="878ebedf-be68-4f49-b07c-60f5f1963f0e" containerID="138399f8a0fdb09671bd00b09f429c4e35aa0da841789a717b1cd546c9753e4f" exitCode=0
Jul 28 20:31:10.348611 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.348441    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n" event={"ID":"878ebedf-be68-4f49-b07c-60f5f1963f0e","Type":"ContainerDied","Data":"138399f8a0fdb09671bd00b09f429c4e35aa0da841789a717b1cd546c9753e4f"}
Jul 28 20:31:10.348611 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.348461    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"
Jul 28 20:31:10.348611 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.348528    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n" event={"ID":"878ebedf-be68-4f49-b07c-60f5f1963f0e","Type":"ContainerDied","Data":"5be683080837d49aa3d3e919002a8a9cf3dcfdf54d0e7109d02f41103e677e6a"}
Jul 28 20:31:10.348611 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.348574    2563 scope.go:117] "RemoveContainer" containerID="138399f8a0fdb09671bd00b09f429c4e35aa0da841789a717b1cd546c9753e4f"
Jul 28 20:31:10.358164 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.358148    2563 scope.go:117] "RemoveContainer" containerID="81f2ac2d062dd6863e43f325a7def65225162badf4fd0343aea8b22b87eade13"
Jul 28 20:31:10.366192 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.366176    2563 scope.go:117] "RemoveContainer" containerID="138399f8a0fdb09671bd00b09f429c4e35aa0da841789a717b1cd546c9753e4f"
Jul 28 20:31:10.366418 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:31:10.366399    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"138399f8a0fdb09671bd00b09f429c4e35aa0da841789a717b1cd546c9753e4f\": container with ID starting with 138399f8a0fdb09671bd00b09f429c4e35aa0da841789a717b1cd546c9753e4f not found: ID does not exist" containerID="138399f8a0fdb09671bd00b09f429c4e35aa0da841789a717b1cd546c9753e4f"
Jul 28 20:31:10.366484 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.366431    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"138399f8a0fdb09671bd00b09f429c4e35aa0da841789a717b1cd546c9753e4f"} err="failed to get container status \"138399f8a0fdb09671bd00b09f429c4e35aa0da841789a717b1cd546c9753e4f\": rpc error: code = NotFound desc = could not find container \"138399f8a0fdb09671bd00b09f429c4e35aa0da841789a717b1cd546c9753e4f\": container with ID starting with 138399f8a0fdb09671bd00b09f429c4e35aa0da841789a717b1cd546c9753e4f not found: ID does not exist"
Jul 28 20:31:10.366484 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.366454    2563 scope.go:117] "RemoveContainer" containerID="81f2ac2d062dd6863e43f325a7def65225162badf4fd0343aea8b22b87eade13"
Jul 28 20:31:10.366720 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:31:10.366701    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81f2ac2d062dd6863e43f325a7def65225162badf4fd0343aea8b22b87eade13\": container with ID starting with 81f2ac2d062dd6863e43f325a7def65225162badf4fd0343aea8b22b87eade13 not found: ID does not exist" containerID="81f2ac2d062dd6863e43f325a7def65225162badf4fd0343aea8b22b87eade13"
Jul 28 20:31:10.366764 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.366727    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81f2ac2d062dd6863e43f325a7def65225162badf4fd0343aea8b22b87eade13"} err="failed to get container status \"81f2ac2d062dd6863e43f325a7def65225162badf4fd0343aea8b22b87eade13\": rpc error: code = NotFound desc = could not find container \"81f2ac2d062dd6863e43f325a7def65225162badf4fd0343aea8b22b87eade13\": container with ID starting with 81f2ac2d062dd6863e43f325a7def65225162badf4fd0343aea8b22b87eade13 not found: ID does not exist"
Jul 28 20:31:10.377156 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.377135    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"]
Jul 28 20:31:10.380790 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.380771    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-d7a9b9-openshift-default-544cb44c86-jv97n"]
Jul 28 20:31:10.384777 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.384758    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb6s5\" (UniqueName: \"kubernetes.io/projected/878ebedf-be68-4f49-b07c-60f5f1963f0e-kube-api-access-gb6s5\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:10.384845 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.384781    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-data\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:10.384845 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.384792    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-token\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:10.384845 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.384801    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-envoy\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:10.384845 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:10.384808    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/878ebedf-be68-4f49-b07c-60f5f1963f0e-istio-podinfo\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:11.604434 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:11.604401    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="878ebedf-be68-4f49-b07c-60f5f1963f0e" path="/var/lib/kubelet/pods/878ebedf-be68-4f49-b07c-60f5f1963f0e/volumes"
Jul 28 20:31:19.567168 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:19.567135    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:31:23.876989 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:23.876946    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"]
Jul 28 20:31:23.877382 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:23.877153    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2" podUID="ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" containerName="istio-proxy" containerID="cri-o://61286d204d5cb90ae9667b568c3f4a3a78265eb8eb83242981f0dba7556abe1f" gracePeriod=30
Jul 28 20:31:29.117284 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.117261    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:31:29.153122 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.153054    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-envoy\") pod \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") "
Jul 28 20:31:29.153122 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.153091    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istiod-ca-cert\") pod \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") "
Jul 28 20:31:29.153333 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.153121    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lc99\" (UniqueName: \"kubernetes.io/projected/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-kube-api-access-7lc99\") pod \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") "
Jul 28 20:31:29.153333 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.153173    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-credential-socket\") pod \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") "
Jul 28 20:31:29.153333 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.153226    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-data\") pod \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") "
Jul 28 20:31:29.153333 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.153260    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-workload-certs\") pod \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") "
Jul 28 20:31:29.153333 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.153286    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-workload-socket\") pod \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") "
Jul 28 20:31:29.153333 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.153331    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-podinfo\") pod \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") "
Jul 28 20:31:29.153692 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.153397    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-token\") pod \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\" (UID: \"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b\") "
Jul 28 20:31:29.153692 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.153569    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" (UID: "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:31:29.153692 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.153637    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" (UID: "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:29.153852 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.153723    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" (UID: "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:29.153852 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.153743    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" (UID: "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:29.153852 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.153773    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istiod-ca-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:29.154594 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.154565    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-data" (OuterVolumeSpecName: "istio-data") pod "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" (UID: "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:29.155273 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.155250    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" (UID: "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:29.155457 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.155436    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-kube-api-access-7lc99" (OuterVolumeSpecName: "kube-api-access-7lc99") pod "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" (UID: "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b"). InnerVolumeSpecName "kube-api-access-7lc99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:29.155899 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.155875    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" (UID: "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:31:29.155899 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.155885    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-token" (OuterVolumeSpecName: "istio-token") pod "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" (UID: "ed1df08b-4ef7-4b15-8bd2-539bd388cb1b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:29.254164 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.254132    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-workload-socket\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:29.254164 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.254161    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-podinfo\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:29.254164 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.254172    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-token\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:29.254401 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.254181    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-envoy\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:29.254401 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.254190    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lc99\" (UniqueName: \"kubernetes.io/projected/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-kube-api-access-7lc99\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:29.254401 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.254199    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-credential-socket\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:29.254401 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.254206    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-istio-data\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:29.254401 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.254214    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b-workload-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:29.452110 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.452019    2563 generic.go:356] "Generic (PLEG): container finished" podID="ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" containerID="61286d204d5cb90ae9667b568c3f4a3a78265eb8eb83242981f0dba7556abe1f" exitCode=0
Jul 28 20:31:29.452110 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.452063    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2" event={"ID":"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b","Type":"ContainerDied","Data":"61286d204d5cb90ae9667b568c3f4a3a78265eb8eb83242981f0dba7556abe1f"}
Jul 28 20:31:29.452110 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.452074    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"
Jul 28 20:31:29.452379 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.452129    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2" event={"ID":"ed1df08b-4ef7-4b15-8bd2-539bd388cb1b","Type":"ContainerDied","Data":"6f2c692ea6c8bdbd5f1c9cbefda638b292dd90e183f968412c108a4e78f03cf4"}
Jul 28 20:31:29.452379 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.452150    2563 scope.go:117] "RemoveContainer" containerID="61286d204d5cb90ae9667b568c3f4a3a78265eb8eb83242981f0dba7556abe1f"
Jul 28 20:31:29.461913 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.461895    2563 scope.go:117] "RemoveContainer" containerID="e77bc1a1fde78b0a6962e60509fffa4f141f3dfc5389390a88d56d1cde54d282"
Jul 28 20:31:29.470118 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.470100    2563 scope.go:117] "RemoveContainer" containerID="61286d204d5cb90ae9667b568c3f4a3a78265eb8eb83242981f0dba7556abe1f"
Jul 28 20:31:29.470358 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:31:29.470341    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61286d204d5cb90ae9667b568c3f4a3a78265eb8eb83242981f0dba7556abe1f\": container with ID starting with 61286d204d5cb90ae9667b568c3f4a3a78265eb8eb83242981f0dba7556abe1f not found: ID does not exist" containerID="61286d204d5cb90ae9667b568c3f4a3a78265eb8eb83242981f0dba7556abe1f"
Jul 28 20:31:29.470397 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.470368    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61286d204d5cb90ae9667b568c3f4a3a78265eb8eb83242981f0dba7556abe1f"} err="failed to get container status \"61286d204d5cb90ae9667b568c3f4a3a78265eb8eb83242981f0dba7556abe1f\": rpc error: code = NotFound desc = could not find container \"61286d204d5cb90ae9667b568c3f4a3a78265eb8eb83242981f0dba7556abe1f\": container with ID starting with 61286d204d5cb90ae9667b568c3f4a3a78265eb8eb83242981f0dba7556abe1f not found: ID does not exist"
Jul 28 20:31:29.470397 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.470383    2563 scope.go:117] "RemoveContainer" containerID="e77bc1a1fde78b0a6962e60509fffa4f141f3dfc5389390a88d56d1cde54d282"
Jul 28 20:31:29.470638 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:31:29.470619    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e77bc1a1fde78b0a6962e60509fffa4f141f3dfc5389390a88d56d1cde54d282\": container with ID starting with e77bc1a1fde78b0a6962e60509fffa4f141f3dfc5389390a88d56d1cde54d282 not found: ID does not exist" containerID="e77bc1a1fde78b0a6962e60509fffa4f141f3dfc5389390a88d56d1cde54d282"
Jul 28 20:31:29.470679 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.470648    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e77bc1a1fde78b0a6962e60509fffa4f141f3dfc5389390a88d56d1cde54d282"} err="failed to get container status \"e77bc1a1fde78b0a6962e60509fffa4f141f3dfc5389390a88d56d1cde54d282\": rpc error: code = NotFound desc = could not find container \"e77bc1a1fde78b0a6962e60509fffa4f141f3dfc5389390a88d56d1cde54d282\": container with ID starting with e77bc1a1fde78b0a6962e60509fffa4f141f3dfc5389390a88d56d1cde54d282 not found: ID does not exist"
Jul 28 20:31:29.483470 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.483447    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"]
Jul 28 20:31:29.495170 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.495148    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-f11e93-openshift-default-d98748bb-twhv2"]
Jul 28 20:31:29.604150 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:29.604122    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" path="/var/lib/kubelet/pods/ed1df08b-4ef7-4b15-8bd2-539bd388cb1b/volumes"
Jul 28 20:31:38.490781 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:38.490746    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:31:43.943556 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:43.943513    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"]
Jul 28 20:31:43.943961 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:43.943740    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb" podUID="8de5642b-3d88-4a3c-b239-d63024aacc98" containerName="istio-proxy" containerID="cri-o://e9e71a08723950fbaf58f9720274c1b62abfa4cd99315eeed3073ac629a9cd3c" gracePeriod=30
Jul 28 20:31:49.195784 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.195758    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:31:49.339696 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.339660    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8de5642b-3d88-4a3c-b239-d63024aacc98-istiod-ca-cert\") pod \"8de5642b-3d88-4a3c-b239-d63024aacc98\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") "
Jul 28 20:31:49.339696 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.339700    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-data\") pod \"8de5642b-3d88-4a3c-b239-d63024aacc98\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") "
Jul 28 20:31:49.339923 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.339741    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-envoy\") pod \"8de5642b-3d88-4a3c-b239-d63024aacc98\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") "
Jul 28 20:31:49.339923 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.339761    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-workload-certs\") pod \"8de5642b-3d88-4a3c-b239-d63024aacc98\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") "
Jul 28 20:31:49.339923 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.339802    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-workload-socket\") pod \"8de5642b-3d88-4a3c-b239-d63024aacc98\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") "
Jul 28 20:31:49.339923 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.339832    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-credential-socket\") pod \"8de5642b-3d88-4a3c-b239-d63024aacc98\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") "
Jul 28 20:31:49.339923 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.339874    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-podinfo\") pod \"8de5642b-3d88-4a3c-b239-d63024aacc98\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") "
Jul 28 20:31:49.339923 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.339906    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-token\") pod \"8de5642b-3d88-4a3c-b239-d63024aacc98\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") "
Jul 28 20:31:49.340229 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.339985    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blbxn\" (UniqueName: \"kubernetes.io/projected/8de5642b-3d88-4a3c-b239-d63024aacc98-kube-api-access-blbxn\") pod \"8de5642b-3d88-4a3c-b239-d63024aacc98\" (UID: \"8de5642b-3d88-4a3c-b239-d63024aacc98\") "
Jul 28 20:31:49.340229 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.340045    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8de5642b-3d88-4a3c-b239-d63024aacc98" (UID: "8de5642b-3d88-4a3c-b239-d63024aacc98"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:49.340229 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.340101    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8de5642b-3d88-4a3c-b239-d63024aacc98" (UID: "8de5642b-3d88-4a3c-b239-d63024aacc98"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:49.340229 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.340121    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8de5642b-3d88-4a3c-b239-d63024aacc98-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8de5642b-3d88-4a3c-b239-d63024aacc98" (UID: "8de5642b-3d88-4a3c-b239-d63024aacc98"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 20:31:49.340437 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.340241    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8de5642b-3d88-4a3c-b239-d63024aacc98" (UID: "8de5642b-3d88-4a3c-b239-d63024aacc98"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:49.340437 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.340289    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8de5642b-3d88-4a3c-b239-d63024aacc98-istiod-ca-cert\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:49.340437 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.340307    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-workload-certs\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:49.340437 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.340322    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-workload-socket\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:49.340909 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.340880    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-data" (OuterVolumeSpecName: "istio-data") pod "8de5642b-3d88-4a3c-b239-d63024aacc98" (UID: "8de5642b-3d88-4a3c-b239-d63024aacc98"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:49.342083 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.342057    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8de5642b-3d88-4a3c-b239-d63024aacc98" (UID: "8de5642b-3d88-4a3c-b239-d63024aacc98"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 20:31:49.342182 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.342170    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8de5642b-3d88-4a3c-b239-d63024aacc98-kube-api-access-blbxn" (OuterVolumeSpecName: "kube-api-access-blbxn") pod "8de5642b-3d88-4a3c-b239-d63024aacc98" (UID: "8de5642b-3d88-4a3c-b239-d63024aacc98"). InnerVolumeSpecName "kube-api-access-blbxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:49.342241 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.342176    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8de5642b-3d88-4a3c-b239-d63024aacc98" (UID: "8de5642b-3d88-4a3c-b239-d63024aacc98"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 20:31:49.342241 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.342198    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-token" (OuterVolumeSpecName: "istio-token") pod "8de5642b-3d88-4a3c-b239-d63024aacc98" (UID: "8de5642b-3d88-4a3c-b239-d63024aacc98"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 20:31:49.441292 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.441262    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blbxn\" (UniqueName: \"kubernetes.io/projected/8de5642b-3d88-4a3c-b239-d63024aacc98-kube-api-access-blbxn\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:49.441292 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.441289    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-data\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:49.441292 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.441300    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-envoy\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:49.441519 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.441308    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8de5642b-3d88-4a3c-b239-d63024aacc98-credential-socket\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:49.441519 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.441318    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-podinfo\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:49.441519 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.441326    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8de5642b-3d88-4a3c-b239-d63024aacc98-istio-token\") on node \"ip-10-0-128-52.ec2.internal\" DevicePath \"\""
Jul 28 20:31:49.555651 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.555614    2563 generic.go:356] "Generic (PLEG): container finished" podID="8de5642b-3d88-4a3c-b239-d63024aacc98" containerID="e9e71a08723950fbaf58f9720274c1b62abfa4cd99315eeed3073ac629a9cd3c" exitCode=0
Jul 28 20:31:49.555826 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.555660    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"
Jul 28 20:31:49.555826 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.555690    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb" event={"ID":"8de5642b-3d88-4a3c-b239-d63024aacc98","Type":"ContainerDied","Data":"e9e71a08723950fbaf58f9720274c1b62abfa4cd99315eeed3073ac629a9cd3c"}
Jul 28 20:31:49.555826 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.555741    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb" event={"ID":"8de5642b-3d88-4a3c-b239-d63024aacc98","Type":"ContainerDied","Data":"a60eb21c80e54b549b0f31fb33b19300c7b962f720aaac709f85c6e95ea8c044"}
Jul 28 20:31:49.555826 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.555763    2563 scope.go:117] "RemoveContainer" containerID="e9e71a08723950fbaf58f9720274c1b62abfa4cd99315eeed3073ac629a9cd3c"
Jul 28 20:31:49.568853 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.568831    2563 scope.go:117] "RemoveContainer" containerID="a9d6838dbc446ee75e67bf364975fd568f12438fcc44c0326908f000e9c5b1c9"
Jul 28 20:31:49.576324 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.576308    2563 scope.go:117] "RemoveContainer" containerID="e9e71a08723950fbaf58f9720274c1b62abfa4cd99315eeed3073ac629a9cd3c"
Jul 28 20:31:49.576579 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:31:49.576563    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9e71a08723950fbaf58f9720274c1b62abfa4cd99315eeed3073ac629a9cd3c\": container with ID starting with e9e71a08723950fbaf58f9720274c1b62abfa4cd99315eeed3073ac629a9cd3c not found: ID does not exist" containerID="e9e71a08723950fbaf58f9720274c1b62abfa4cd99315eeed3073ac629a9cd3c"
Jul 28 20:31:49.576641 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.576586    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9e71a08723950fbaf58f9720274c1b62abfa4cd99315eeed3073ac629a9cd3c"} err="failed to get container status \"e9e71a08723950fbaf58f9720274c1b62abfa4cd99315eeed3073ac629a9cd3c\": rpc error: code = NotFound desc = could not find container \"e9e71a08723950fbaf58f9720274c1b62abfa4cd99315eeed3073ac629a9cd3c\": container with ID starting with e9e71a08723950fbaf58f9720274c1b62abfa4cd99315eeed3073ac629a9cd3c not found: ID does not exist"
Jul 28 20:31:49.576641 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.576603    2563 scope.go:117] "RemoveContainer" containerID="a9d6838dbc446ee75e67bf364975fd568f12438fcc44c0326908f000e9c5b1c9"
Jul 28 20:31:49.576839 ip-10-0-128-52 kubenswrapper[2563]: E0728 20:31:49.576819    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9d6838dbc446ee75e67bf364975fd568f12438fcc44c0326908f000e9c5b1c9\": container with ID starting with a9d6838dbc446ee75e67bf364975fd568f12438fcc44c0326908f000e9c5b1c9 not found: ID does not exist" containerID="a9d6838dbc446ee75e67bf364975fd568f12438fcc44c0326908f000e9c5b1c9"
Jul 28 20:31:49.576885 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.576845    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d6838dbc446ee75e67bf364975fd568f12438fcc44c0326908f000e9c5b1c9"} err="failed to get container status \"a9d6838dbc446ee75e67bf364975fd568f12438fcc44c0326908f000e9c5b1c9\": rpc error: code = NotFound desc = could not find container \"a9d6838dbc446ee75e67bf364975fd568f12438fcc44c0326908f000e9c5b1c9\": container with ID starting with a9d6838dbc446ee75e67bf364975fd568f12438fcc44c0326908f000e9c5b1c9 not found: ID does not exist"
Jul 28 20:31:49.593059 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.593010    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"]
Jul 28 20:31:49.597338 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.597316    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-bd928b-openshift-default-5fd7ddd844-7ktlb"]
Jul 28 20:31:49.603687 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:49.603666    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8de5642b-3d88-4a3c-b239-d63024aacc98" path="/var/lib/kubelet/pods/8de5642b-3d88-4a3c-b239-d63024aacc98/volumes"
Jul 28 20:31:58.037009 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:31:58.036970    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gkzgr"]
Jul 28 20:32:02.892058 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:02.892023    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-cb69565bc-9j98r_770e2f94-66a5-4b95-82bb-86a289a90d57/authorino/0.log"
Jul 28 20:32:09.071804 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:09.071727    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jj74k_24f6d720-7c14-4328-8f02-1f44696aab58/server/0.log"
Jul 28 20:32:09.628162 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:09.628133    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f4d69945-pklc4_765ce775-7f76-49b0-a6e8-5b3d983674a8/copy-manifests/0.log"
Jul 28 20:32:09.636795 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:09.636773    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f4d69945-pklc4_765ce775-7f76-49b0-a6e8-5b3d983674a8/manager/0.log"
Jul 28 20:32:11.418769 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:11.418744    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp_a4f82d7c-c1eb-4de0-8c61-c95471ac75f8/util/0.log"
Jul 28 20:32:11.426260 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:11.426238    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp_a4f82d7c-c1eb-4de0-8c61-c95471ac75f8/pull/0.log"
Jul 28 20:32:11.433376 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:11.433350    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp_a4f82d7c-c1eb-4de0-8c61-c95471ac75f8/extract/0.log"
Jul 28 20:32:11.559853 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:11.559829    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4_e64078b8-7322-4064-bc3d-775078f29364/util/0.log"
Jul 28 20:32:11.567293 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:11.567272    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4_e64078b8-7322-4064-bc3d-775078f29364/pull/0.log"
Jul 28 20:32:11.574347 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:11.574328    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4_e64078b8-7322-4064-bc3d-775078f29364/extract/0.log"
Jul 28 20:32:11.691638 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:11.691559    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf_8be42563-d715-459a-812e-91f094ad118c/pull/0.log"
Jul 28 20:32:11.704671 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:11.704648    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf_8be42563-d715-459a-812e-91f094ad118c/extract/0.log"
Jul 28 20:32:11.713341 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:11.713324    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf_8be42563-d715-459a-812e-91f094ad118c/util/0.log"
Jul 28 20:32:11.842731 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:11.842709    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5_e074634e-0b9b-4211-9d3a-ac49689ad9bd/util/0.log"
Jul 28 20:32:11.851094 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:11.851076    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5_e074634e-0b9b-4211-9d3a-ac49689ad9bd/pull/0.log"
Jul 28 20:32:11.860434 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:11.860419    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5_e074634e-0b9b-4211-9d3a-ac49689ad9bd/extract/0.log"
Jul 28 20:32:11.985795 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:11.985720    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-cb69565bc-9j98r_770e2f94-66a5-4b95-82bb-86a289a90d57/authorino/0.log"
Jul 28 20:32:12.775232 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:12.775202    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gkzgr_4b9c4817-5e7c-471a-b168-705fcc074712/limitador/0.log"
Jul 28 20:32:13.307234 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:13.307207    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c9j62r_22e38ea6-bc5b-4365-8ab6-6a2a36532114/istio-proxy/0.log"
Jul 28 20:32:13.576594 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:13.576490    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9868ff69-ql269_3b715383-6b15-41a2-bf7e-279e1a94ccf1/kube-auth-proxy/0.log"
Jul 28 20:32:21.259798 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.259758    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z498q/must-gather-xd7dd"]
Jul 28 20:32:21.260270 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260239    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26a971dd-501c-423c-86f1-6c075f194e93" containerName="main"
Jul 28 20:32:21.260270 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260257    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="26a971dd-501c-423c-86f1-6c075f194e93" containerName="main"
Jul 28 20:32:21.260392 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260275    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" containerName="istio-proxy"
Jul 28 20:32:21.260392 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260284    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" containerName="istio-proxy"
Jul 28 20:32:21.260392 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260297    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878ebedf-be68-4f49-b07c-60f5f1963f0e" containerName="istio-proxy"
Jul 28 20:32:21.260392 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260307    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="878ebedf-be68-4f49-b07c-60f5f1963f0e" containerName="istio-proxy"
Jul 28 20:32:21.260392 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260319    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8de5642b-3d88-4a3c-b239-d63024aacc98" containerName="istio-proxy"
Jul 28 20:32:21.260392 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260328    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8de5642b-3d88-4a3c-b239-d63024aacc98" containerName="istio-proxy"
Jul 28 20:32:21.260392 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260337    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878ebedf-be68-4f49-b07c-60f5f1963f0e" containerName="istio-proxy"
Jul 28 20:32:21.260392 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260345    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="878ebedf-be68-4f49-b07c-60f5f1963f0e" containerName="istio-proxy"
Jul 28 20:32:21.260392 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260357    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" containerName="istio-proxy"
Jul 28 20:32:21.260392 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260365    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" containerName="istio-proxy"
Jul 28 20:32:21.260392 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260391    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8de5642b-3d88-4a3c-b239-d63024aacc98" containerName="istio-proxy"
Jul 28 20:32:21.260976 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260399    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8de5642b-3d88-4a3c-b239-d63024aacc98" containerName="istio-proxy"
Jul 28 20:32:21.260976 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260479    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" containerName="istio-proxy"
Jul 28 20:32:21.260976 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260490    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="878ebedf-be68-4f49-b07c-60f5f1963f0e" containerName="istio-proxy"
Jul 28 20:32:21.260976 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260500    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed1df08b-4ef7-4b15-8bd2-539bd388cb1b" containerName="istio-proxy"
Jul 28 20:32:21.260976 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260508    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="26a971dd-501c-423c-86f1-6c075f194e93" containerName="main"
Jul 28 20:32:21.260976 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260517    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="878ebedf-be68-4f49-b07c-60f5f1963f0e" containerName="istio-proxy"
Jul 28 20:32:21.260976 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260527    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8de5642b-3d88-4a3c-b239-d63024aacc98" containerName="istio-proxy"
Jul 28 20:32:21.260976 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.260536    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8de5642b-3d88-4a3c-b239-d63024aacc98" containerName="istio-proxy"
Jul 28 20:32:21.265224 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.265203    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z498q/must-gather-xd7dd"
Jul 28 20:32:21.272554 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.272525    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z498q\"/\"kube-root-ca.crt\""
Jul 28 20:32:21.272672 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.272578    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z498q\"/\"default-dockercfg-xg8mv\""
Jul 28 20:32:21.273592 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.273574    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z498q\"/\"openshift-service-ca.crt\""
Jul 28 20:32:21.280344 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.280321    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z498q/must-gather-xd7dd"]
Jul 28 20:32:21.288590 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.288568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d36563cf-3277-4a09-866a-87e860f45836-must-gather-output\") pod \"must-gather-xd7dd\" (UID: \"d36563cf-3277-4a09-866a-87e860f45836\") " pod="openshift-must-gather-z498q/must-gather-xd7dd"
Jul 28 20:32:21.288686 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.288671    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67lwc\" (UniqueName: \"kubernetes.io/projected/d36563cf-3277-4a09-866a-87e860f45836-kube-api-access-67lwc\") pod \"must-gather-xd7dd\" (UID: \"d36563cf-3277-4a09-866a-87e860f45836\") " pod="openshift-must-gather-z498q/must-gather-xd7dd"
Jul 28 20:32:21.389528 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.389494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d36563cf-3277-4a09-866a-87e860f45836-must-gather-output\") pod \"must-gather-xd7dd\" (UID: \"d36563cf-3277-4a09-866a-87e860f45836\") " pod="openshift-must-gather-z498q/must-gather-xd7dd"
Jul 28 20:32:21.389706 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.389612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67lwc\" (UniqueName: \"kubernetes.io/projected/d36563cf-3277-4a09-866a-87e860f45836-kube-api-access-67lwc\") pod \"must-gather-xd7dd\" (UID: \"d36563cf-3277-4a09-866a-87e860f45836\") " pod="openshift-must-gather-z498q/must-gather-xd7dd"
Jul 28 20:32:21.389850 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.389830    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d36563cf-3277-4a09-866a-87e860f45836-must-gather-output\") pod \"must-gather-xd7dd\" (UID: \"d36563cf-3277-4a09-866a-87e860f45836\") " pod="openshift-must-gather-z498q/must-gather-xd7dd"
Jul 28 20:32:21.398058 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.398037    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67lwc\" (UniqueName: \"kubernetes.io/projected/d36563cf-3277-4a09-866a-87e860f45836-kube-api-access-67lwc\") pod \"must-gather-xd7dd\" (UID: \"d36563cf-3277-4a09-866a-87e860f45836\") " pod="openshift-must-gather-z498q/must-gather-xd7dd"
Jul 28 20:32:21.575032 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.574949    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z498q/must-gather-xd7dd"
Jul 28 20:32:21.723673 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.723642    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z498q/must-gather-xd7dd"]
Jul 28 20:32:21.725032 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:32:21.725008    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd36563cf_3277_4a09_866a_87e860f45836.slice/crio-c2300baaa35b93f7935b0267a9fd88e79eaf928f0d9848d7e55fa74517ac210d WatchSource:0}: Error finding container c2300baaa35b93f7935b0267a9fd88e79eaf928f0d9848d7e55fa74517ac210d: Status 404 returned error can't find the container with id c2300baaa35b93f7935b0267a9fd88e79eaf928f0d9848d7e55fa74517ac210d
Jul 28 20:32:21.726942 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:21.726919    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 20:32:22.729913 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:22.729814    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z498q/must-gather-xd7dd" event={"ID":"d36563cf-3277-4a09-866a-87e860f45836","Type":"ContainerStarted","Data":"cab6b30f877225030b672551b64ebbc1727b96fd58290aaa22c458931851463e"}
Jul 28 20:32:22.729913 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:22.729866    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z498q/must-gather-xd7dd" event={"ID":"d36563cf-3277-4a09-866a-87e860f45836","Type":"ContainerStarted","Data":"45978055c2e3ff5e4687705dd55ac84df40c2badb17fa9ad5a7ba31ddb1ab26a"}
Jul 28 20:32:22.729913 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:22.729884    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z498q/must-gather-xd7dd" event={"ID":"d36563cf-3277-4a09-866a-87e860f45836","Type":"ContainerStarted","Data":"c2300baaa35b93f7935b0267a9fd88e79eaf928f0d9848d7e55fa74517ac210d"}
Jul 28 20:32:22.749830 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:22.749778    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z498q/must-gather-xd7dd" podStartSLOduration=1.082751991 podStartE2EDuration="1.749762912s" totalImagesPullingTime="667.010921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 20:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:32:22.74758915 +0000 UTC m=+3427.769884744" watchObservedRunningTime="2026-07-28 20:32:22.749762912 +0000 UTC m=+3427.772058532"
Jul 28 20:32:23.996774 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:23.996747    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5lcrt_3e3f57e8-e5e3-446b-bca9-fddbef67f811/global-pull-secret-syncer/0.log"
Jul 28 20:32:24.277864 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:24.277786    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lqzln_30a8c748-7ce1-43f3-a4ba-f414ec8ee93c/konnectivity-agent/0.log"
Jul 28 20:32:24.350191 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:24.350161    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-52.ec2.internal_c42ef49a264502a7ba84c385b4bf7337/haproxy/0.log"
Jul 28 20:32:28.706852 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:28.706815    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp_a4f82d7c-c1eb-4de0-8c61-c95471ac75f8/extract/0.log"
Jul 28 20:32:28.732280 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:28.732243    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp_a4f82d7c-c1eb-4de0-8c61-c95471ac75f8/util/0.log"
Jul 28 20:32:28.758927 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:28.758897    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fpbjp_a4f82d7c-c1eb-4de0-8c61-c95471ac75f8/pull/0.log"
Jul 28 20:32:28.788744 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:28.788519    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4_e64078b8-7322-4064-bc3d-775078f29364/extract/0.log"
Jul 28 20:32:28.817611 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:28.817566    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4_e64078b8-7322-4064-bc3d-775078f29364/util/0.log"
Jul 28 20:32:28.841334 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:28.841310    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c48l4_e64078b8-7322-4064-bc3d-775078f29364/pull/0.log"
Jul 28 20:32:28.875474 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:28.875439    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf_8be42563-d715-459a-812e-91f094ad118c/extract/0.log"
Jul 28 20:32:28.897753 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:28.897730    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf_8be42563-d715-459a-812e-91f094ad118c/util/0.log"
Jul 28 20:32:28.930260 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:28.930230    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jqbmf_8be42563-d715-459a-812e-91f094ad118c/pull/0.log"
Jul 28 20:32:28.976166 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:28.976092    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5_e074634e-0b9b-4211-9d3a-ac49689ad9bd/extract/0.log"
Jul 28 20:32:29.000841 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:29.000727    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5_e074634e-0b9b-4211-9d3a-ac49689ad9bd/util/0.log"
Jul 28 20:32:29.034694 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:29.034667    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19htq5_e074634e-0b9b-4211-9d3a-ac49689ad9bd/pull/0.log"
Jul 28 20:32:29.519579 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:29.519026    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-cb69565bc-9j98r_770e2f94-66a5-4b95-82bb-86a289a90d57/authorino/0.log"
Jul 28 20:32:29.937792 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:29.937692    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gkzgr_4b9c4817-5e7c-471a-b168-705fcc074712/limitador/0.log"
Jul 28 20:32:31.634566 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:31.634522    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ca56512-8ecf-4dff-8f93-388dc9c65fe0/alertmanager/0.log"
Jul 28 20:32:31.668460 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:31.668423    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ca56512-8ecf-4dff-8f93-388dc9c65fe0/config-reloader/0.log"
Jul 28 20:32:31.694936 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:31.694908    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ca56512-8ecf-4dff-8f93-388dc9c65fe0/kube-rbac-proxy-web/0.log"
Jul 28 20:32:31.732598 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:31.732559    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ca56512-8ecf-4dff-8f93-388dc9c65fe0/kube-rbac-proxy/0.log"
Jul 28 20:32:31.772104 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:31.772057    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ca56512-8ecf-4dff-8f93-388dc9c65fe0/kube-rbac-proxy-metric/0.log"
Jul 28 20:32:31.796961 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:31.796928    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ca56512-8ecf-4dff-8f93-388dc9c65fe0/prom-label-proxy/0.log"
Jul 28 20:32:31.835603 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:31.835534    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ca56512-8ecf-4dff-8f93-388dc9c65fe0/init-config-reloader/0.log"
Jul 28 20:32:31.997277 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:31.997248    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7c6c74894d-ccx9h_fc36288a-b8d0-475b-9640-42bda1b1b5a0/metrics-server/0.log"
Jul 28 20:32:32.025660 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:32.025627    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-b6767_ed144203-56d4-4aef-9d87-c4a7c5004895/monitoring-plugin/0.log"
Jul 28 20:32:32.137888 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:32.137853    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j9prd_783ae030-92bb-4dda-81cd-56873afb6b9a/node-exporter/0.log"
Jul 28 20:32:32.163439 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:32.163409    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j9prd_783ae030-92bb-4dda-81cd-56873afb6b9a/kube-rbac-proxy/0.log"
Jul 28 20:32:32.185585 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:32.185555    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j9prd_783ae030-92bb-4dda-81cd-56873afb6b9a/init-textfile/0.log"
Jul 28 20:32:32.639733 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:32.639705    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-6t6d4_c1addcde-ec10-4b1d-b0b7-9e7c552d2b86/prometheus-operator/0.log"
Jul 28 20:32:32.661679 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:32.661652    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-6t6d4_c1addcde-ec10-4b1d-b0b7-9e7c552d2b86/kube-rbac-proxy/0.log"
Jul 28 20:32:32.724087 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:32.724038    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f8968b8f6-8wvhd_13f5d9a4-fbce-4145-8fb7-33b782c6c888/telemeter-client/0.log"
Jul 28 20:32:32.744172 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:32.744142    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f8968b8f6-8wvhd_13f5d9a4-fbce-4145-8fb7-33b782c6c888/reload/0.log"
Jul 28 20:32:32.770462 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:32.770422    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f8968b8f6-8wvhd_13f5d9a4-fbce-4145-8fb7-33b782c6c888/kube-rbac-proxy/0.log"
Jul 28 20:32:33.511346 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.511297    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"]
Jul 28 20:32:33.516029 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.516006    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.521518 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.521494    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"]
Jul 28 20:32:33.612083 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.612042    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/356e4168-f650-4f8b-9406-0f89f6aae40c-proc\") pod \"perf-node-gather-daemonset-nz8b2\" (UID: \"356e4168-f650-4f8b-9406-0f89f6aae40c\") " pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.612265 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.612162    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/356e4168-f650-4f8b-9406-0f89f6aae40c-lib-modules\") pod \"perf-node-gather-daemonset-nz8b2\" (UID: \"356e4168-f650-4f8b-9406-0f89f6aae40c\") " pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.612265 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.612238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp5dq\" (UniqueName: \"kubernetes.io/projected/356e4168-f650-4f8b-9406-0f89f6aae40c-kube-api-access-gp5dq\") pod \"perf-node-gather-daemonset-nz8b2\" (UID: \"356e4168-f650-4f8b-9406-0f89f6aae40c\") " pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.612387 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.612290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/356e4168-f650-4f8b-9406-0f89f6aae40c-sys\") pod \"perf-node-gather-daemonset-nz8b2\" (UID: \"356e4168-f650-4f8b-9406-0f89f6aae40c\") " pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.612387 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.612313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/356e4168-f650-4f8b-9406-0f89f6aae40c-podres\") pod \"perf-node-gather-daemonset-nz8b2\" (UID: \"356e4168-f650-4f8b-9406-0f89f6aae40c\") " pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.713607 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.713571    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/356e4168-f650-4f8b-9406-0f89f6aae40c-proc\") pod \"perf-node-gather-daemonset-nz8b2\" (UID: \"356e4168-f650-4f8b-9406-0f89f6aae40c\") " pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.714046 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.713638    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/356e4168-f650-4f8b-9406-0f89f6aae40c-lib-modules\") pod \"perf-node-gather-daemonset-nz8b2\" (UID: \"356e4168-f650-4f8b-9406-0f89f6aae40c\") " pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.714046 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.713682    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp5dq\" (UniqueName: \"kubernetes.io/projected/356e4168-f650-4f8b-9406-0f89f6aae40c-kube-api-access-gp5dq\") pod \"perf-node-gather-daemonset-nz8b2\" (UID: \"356e4168-f650-4f8b-9406-0f89f6aae40c\") " pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.714046 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.713709    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/356e4168-f650-4f8b-9406-0f89f6aae40c-sys\") pod \"perf-node-gather-daemonset-nz8b2\" (UID: \"356e4168-f650-4f8b-9406-0f89f6aae40c\") " pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.714046 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.713725    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/356e4168-f650-4f8b-9406-0f89f6aae40c-podres\") pod \"perf-node-gather-daemonset-nz8b2\" (UID: \"356e4168-f650-4f8b-9406-0f89f6aae40c\") " pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.714046 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.713751    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/356e4168-f650-4f8b-9406-0f89f6aae40c-proc\") pod \"perf-node-gather-daemonset-nz8b2\" (UID: \"356e4168-f650-4f8b-9406-0f89f6aae40c\") " pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.714046 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.713832    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/356e4168-f650-4f8b-9406-0f89f6aae40c-sys\") pod \"perf-node-gather-daemonset-nz8b2\" (UID: \"356e4168-f650-4f8b-9406-0f89f6aae40c\") " pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.714046 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.713871    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/356e4168-f650-4f8b-9406-0f89f6aae40c-podres\") pod \"perf-node-gather-daemonset-nz8b2\" (UID: \"356e4168-f650-4f8b-9406-0f89f6aae40c\") " pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.714046 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.713876    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/356e4168-f650-4f8b-9406-0f89f6aae40c-lib-modules\") pod \"perf-node-gather-daemonset-nz8b2\" (UID: \"356e4168-f650-4f8b-9406-0f89f6aae40c\") " pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.727242 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.727205    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp5dq\" (UniqueName: \"kubernetes.io/projected/356e4168-f650-4f8b-9406-0f89f6aae40c-kube-api-access-gp5dq\") pod \"perf-node-gather-daemonset-nz8b2\" (UID: \"356e4168-f650-4f8b-9406-0f89f6aae40c\") " pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:33.830325 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:33.830245    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:34.017806 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:34.017724    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"]
Jul 28 20:32:34.023267 ip-10-0-128-52 kubenswrapper[2563]: W0728 20:32:34.023241    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod356e4168_f650_4f8b_9406_0f89f6aae40c.slice/crio-17e47e002c7e37ad087eb719c9e097f7a31ba9b19285361f8ebb6e36f5c8f88f WatchSource:0}: Error finding container 17e47e002c7e37ad087eb719c9e097f7a31ba9b19285361f8ebb6e36f5c8f88f: Status 404 returned error can't find the container with id 17e47e002c7e37ad087eb719c9e097f7a31ba9b19285361f8ebb6e36f5c8f88f
Jul 28 20:32:34.848407 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:34.848366    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2" event={"ID":"356e4168-f650-4f8b-9406-0f89f6aae40c","Type":"ContainerStarted","Data":"2618b1333f223a8bde7032a17abf4608c0e3baad5fb180d667c7441d9643c91c"}
Jul 28 20:32:34.848994 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:34.848435    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2" event={"ID":"356e4168-f650-4f8b-9406-0f89f6aae40c","Type":"ContainerStarted","Data":"17e47e002c7e37ad087eb719c9e097f7a31ba9b19285361f8ebb6e36f5c8f88f"}
Jul 28 20:32:34.848994 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:34.848480    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:34.866442 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:34.866389    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2" podStartSLOduration=1.8663737089999999 podStartE2EDuration="1.866373709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 20:32:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 20:32:34.865393441 +0000 UTC m=+3439.887689030" watchObservedRunningTime="2026-07-28 20:32:34.866373709 +0000 UTC m=+3439.888669298"
Jul 28 20:32:36.807360 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:36.807334    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rlpcr_cf31643f-bcdc-4378-902e-760a2ea0ccf8/dns/0.log"
Jul 28 20:32:36.828403 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:36.828370    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rlpcr_cf31643f-bcdc-4378-902e-760a2ea0ccf8/kube-rbac-proxy/0.log"
Jul 28 20:32:36.929005 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:36.928968    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xwflf_31a203ac-b139-4b22-a764-b90bf128794e/dns-node-resolver/0.log"
Jul 28 20:32:37.577829 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:37.577784    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wjwd5_5c1c9e47-fe52-4009-b91f-4a1b3a5d448c/node-ca/0.log"
Jul 28 20:32:38.476911 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:38.476883    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c9j62r_22e38ea6-bc5b-4365-8ab6-6a2a36532114/istio-proxy/0.log"
Jul 28 20:32:38.769955 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:38.769929    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9868ff69-ql269_3b715383-6b15-41a2-bf7e-279e1a94ccf1/kube-auth-proxy/0.log"
Jul 28 20:32:39.828649 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:39.828615    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4jwdx_3dcd9731-9461-4b95-b1ce-2cb8cfc61537/serve-healthcheck-canary/0.log"
Jul 28 20:32:40.362578 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:40.362527    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dzzb7_a1d182ea-87e0-4a68-9df6-dc75285ac107/kube-rbac-proxy/0.log"
Jul 28 20:32:40.385021 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:40.384991    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dzzb7_a1d182ea-87e0-4a68-9df6-dc75285ac107/exporter/0.log"
Jul 28 20:32:40.405967 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:40.405933    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dzzb7_a1d182ea-87e0-4a68-9df6-dc75285ac107/extractor/0.log"
Jul 28 20:32:40.867605 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:40.867534    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z498q/perf-node-gather-daemonset-nz8b2"
Jul 28 20:32:43.953057 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:43.953009    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jj74k_24f6d720-7c14-4328-8f02-1f44696aab58/server/0.log"
Jul 28 20:32:44.000637 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:44.000590    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c9j62r_22e38ea6-bc5b-4365-8ab6-6a2a36532114/istio-proxy/0.log"
Jul 28 20:32:44.355705 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:44.355672    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9868ff69-ql269_3b715383-6b15-41a2-bf7e-279e1a94ccf1/kube-auth-proxy/0.log"
Jul 28 20:32:44.386760 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:44.386731    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f4d69945-pklc4_765ce775-7f76-49b0-a6e8-5b3d983674a8/manager/0.log"
Jul 28 20:32:44.409129 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:44.409103    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f4d69945-pklc4_765ce775-7f76-49b0-a6e8-5b3d983674a8/copy-manifests/0.log"
Jul 28 20:32:45.692237 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:45.692145    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-69b7dc5fd4-2wkzb_0131ae4d-357a-46ed-b45c-5b4043385965/manager/0.log"
Jul 28 20:32:45.751627 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:45.751591    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-btddl_d2f5019b-a0aa-48a2-8425-326ac4cdd7e2/openshift-lws-operator/0.log"
Jul 28 20:32:46.016394 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:46.016362    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c9j62r_22e38ea6-bc5b-4365-8ab6-6a2a36532114/istio-proxy/0.log"
Jul 28 20:32:46.315628 ip-10-0-128-52 kubenswrapper[2563]: I0728 20:32:46.315557    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9868ff69-ql269_3b715383-6b15-41a2-bf7e-279e1a94ccf1/kube-auth-proxy/0.log"